Searching for Audiovisual Content Cover [6Mm].Indd 1 2/12/08 16:35:39 IRIS Special: Searching for Audiovisual Content

Total Page:16

File Type:pdf, Size:1020Kb

Searching for Audiovisual Content Cover [6Mm].Indd 1 2/12/08 16:35:39 IRIS Special: Searching for Audiovisual Content Available in English, Special Serie French and German What can you expect from IRIS Special What is the source of the IRIS Special in terms of content? expertise? Published by the European IRIS Special is a series of publications from the European Every edition of IRIS Special is produced by the European Audiovisual Observatory that provides you comprehensive Audiovisual Observatory’s legal information department in Audiovisual Observatory factual information coupled with in-depth analysis. The themes cooperation with its partner organisations and an extensive chosen for IRIS Special are all topical issues in media law, which network of experts in media law. we explore for you from a legal perspective. IRIS Special’s The themes are either discussed at invitation-only workshops approach to its content is tri-dimensional, with overlap in or tackled by selected guest authors. Workshop participants some cases, depending on the theme. It offers: and authors are chosen in order to represent a wide range of 1. a detailed survey of relevant national legislation to facilitate professional, academic, national and cultural backgrounds. comparison of the legal position in different countries, for example IRIS Special: Broadcasters’ Obligations to Invest in IRIS Special - unique added value Cinematographic Production describes the rules applied by IRIS Special publications explore selected legal themes in a way that 34 European states; makes them accessible not just to lawyers. Every edition combines 2. identification and analysis of highly relevant issues, a high level of practical relevance with academic rigour. covering legal developments and trends as well as suggested While IRIS Special concentrates on issues and interactions solutions: for example IRIS Special, Audiovisual Media within Europe, it takes a broader geographical scope when the Services without Frontiers – Implementing the Rules offers theme so requires. a forward-looking analysis that will continue to be relevant long after the adoption of the EC Directive; Who needs to read IRIS Special? 3. an outline of the European or international legal If you hold a position of responsibility in the media industry, context influencing the national legislation, for example particularly cinema, broadcasting or new media, if you work for IRIS Special: To Have or Not to Have – Must-carry Rules a specialised law firm, for a regulatory authority or in media explains the European model and compares it with the and cultural policy making, or if media studies is your academic American approach. discipline, then the IRIS Special series is a must for you. So far published in the series: n Editorial Responsibility n Tomorrow’s Delivery of Audiovisual Services SearchingSearching forfor ISBN 978-92-871-6476-6 - 50 pages - © 2008 – EUR 75 ISBN 978-92-871-5707-2 - 56 pages - © 2005 - EUR 35 http://www.obs.coe.int/editresp http://www.obs.coe.int/tv-future n Legal Aspects of Video on Demand n Political Debate and the Role of the Media Audiovisual ISBN 978-92-871- 6391-2 - 91 pages - © 2008 - EUR 89 Audiovisual ISBN 978-92-871-5675-4 - 125 pages - © 2004 - EUR 44 http://www.obs.coe.int/vod-legal http://www.obs.coe.int/political-debate n The Public Service Broadcasting Culture n Regulating Access to Digital Television ISBN 978-92-871-6188-8 - 184 pages - © 2007 - EUR 62,50 ContentContent http://www.obs.coe.int/psb ISBN 978-92-871-5401-9 - 127 Pages + 28 pages Glossary - © 2004 - EUR 44 n Audiovisual Media Services http://www.obs.coe.int/digital-tv-access without Frontiers n ISBN 978-92-871-6115-4 - 76 pages - © 2006 - EUR 58,50 Co-Regulation of the Media in Europe http://www.obs.coe.int/av-media-services ISBN 978-92-871-5141-4 - 140 pages - © 2003 - EUR 27 http://www.obs.coe.int/co-regulation n Broadcasters’ Obligations to Invest in Cinematographic Production n Jurisdiction over Broadcasters in Europe ISBN 978-92-871-5971-7 - 127 pages - © 2006 - EUR 62,50 ISBN 978-92-871-4854-4 - 64 pages - © 2002 - EUR 27 http://www.obs.coe.int/tv-invest-film http://www.obs.coe.int/jurisdiction n To Have or Not to Have - Must-carry Rules n Television and Media Concentration ISBN 978-92-871-5897-0 - 52 pages - © 2005 - EUR 58,50 ISBN 978-92-871-4595-6 - 89 pages - © 2001 - EUR 27 http://www.obs.coe.int/must-carry http://www.obs.coe.int/media-concentration European Audiovisual Observatory: tel. +33 (0) 3 88 14 44 00 - fax +33 (0) 3 88 14 44 19 - E-mail [email protected] IRIS_Special_Searching for Audiovisual Content_Cover [6mm].indd 1 2/12/08 16:35:39 IRIS Special: Searching for Audiovisual Content European Audiovisual Observatory, Strasbourg 2008 ISBN: 978-92-871-6559-6 EUR 89 Director of the Publication: Wolfgang Closs, Executive Director of the European Audiovisual Observatory E-mail: [email protected] Editor and Coordinator: Dr. Susanne Nikoltchev, LL.M. (Florence/Italy, Ann Arbor/MI) Head of the Department for Legal Information E-mail: [email protected] Contributing Partner Institution: Institute for Information Law (IViR) Rokin 84 NL-1012 KX Amsterdam Tel.: +31 (0) 20 525 34 06 Fax: +31 (0) 20 525 30 33 E-mail: [email protected] URL: http://www.ivir.nl Editorial Assistant: Michelle Ganter Marketing: Markus Booms E-mail: [email protected] Translation/Proof-reading: Caroline Bletterer, Alison Hindhaugh, Amélie Lépinard, Bernard Ludewig, Stefan Pooth, Erwin Rohwer, Roland Schmid, Dorothée Seifert-Willer, Nathalie Sturlèse, Candelaria Van Strien-Reney, Anne-Lise Weidmann Typesetting/Print: Pointillés, Hoenheim (France) Publisher: European Audiovisual Observatory 76 Allée de la Robertsau F-67000 Strasbourg Tel.: +33 (0)3 88 14 44 00 Fax: +33 (0)3 88 14 44 19 E-mail: [email protected] http://www.obs.coe.int Please quote this publication as: Susanne Nikoltchev, Ed., IRIS Special: Searching for Audiovisual Content (Strasbourg, European Audiovisual Observatory, 2008) © European Audiovisual Observatory, 2008. Opinions expressed in this publication are personal and do not necessarily represent the views of the Observatory, its members or the Council of Europe. IRIS_Special_Searching for Audiovisual Content_Cover [6mm].indd 2 2/12/08 16:35:39 IRIS Special Searching for AudiovisualContent In 1989/90 Tim Berners-Lee developedthe World Wide Web(WWW) forthe European Organization forNuclear Research (CERN). Barely 20 years old,ithas made an unprecedented impact on theway we deal with information. TheWWW has becomeakey resource forprivate life andbusiness.Toeach of us it offers an unimaginable variety andquantity of contentand it calls on each of us to also use it in ordertoshareour own creationswith others.The WWW nurtures our expectationsofwhat information we can find, it influences our habits of howand wheretolook forcontent, anditgenerates fears as to whether we master themachineorthe machinemasters us. CERN was notonly theWeb’s midwife,itmight also serve as its role modelfor generating giganticamounts of information. CERN expects to producemorethan 15 millionGigabytes of data each year as aresult of acceleratinghundreds of millionsofsubatomicparticles in theLarge HadronCollider(LHC), theworld’slargest particle accelerator. This bears some resemblancewith theswellingmass of information floatingonthe WWW.What drives both systemsisour desire to gather information. When CERN launched its recentexperimenttoreconstruct thebig bangthat gave birth to our planet, critics remindedusthat notall thattechnology can do is without risk. Certainly the responsible managers andscientists at CERNwill do all they can to make their experimentsafe, yet they also admit that asingle mindcan no longercontrol andoverlook an experimentofthat magnitude.Accordingly,supervision is carried out by ateam with each of themanyteam members handlingonly asmall part of theproject. Arethere similar developments to be noticed forthe WWW? Arewestill in aposition to handle it or have we created an information monster that asingle humanbeingcan no longercontrol? Arewegradually beingwashed away by adelugeofinformation? These questionsmust lead us to reflect about theprincipal role or even several principal roles that theelectronicinformation supply plays in our lives: I. Theamountofinformation electronically processed is mind-boggling. Oneofthe contributionstothis publication mentions that in 2008 electronically created,stored and replicated information reached theequivalentofthree milliontimes theinformation in all books ever written andthat theamountwill multiply by six over thenexttwo years. No doubt somebodylookingfor relevantaudiovisual contentfaces abig challenge.The fact that we still manage to findwhat we arelookingfor is largely owed to electronichelpers such as search engines andelectronicprogrammingguides. In short: theabundanceofelectronicinformation compels us to develop andtrust in new search facilitatingtools. II. Themorecontentfromanincreasingnumber of sources is stored on arapidly growing number of platformsand made availabletomoreand more users withincreasingly diverse backgrounds,the more difficult it is to provide acoherentsystem that will enable everybodyto achieve satisfactory search results.The successful search foraudiovisual contentisaheightened challenge because most existingsearch tools aretext-based. Acoherentapproach to render data searchable requires acoherentmethodology for identifyingand classifyingthem. We need systematicorderingand taggingjust likewedid when we could still tidy away printed material in bookshelves. In short: theabundanceofelectronicinformation mightnecessitateuniversal content identification systems.
Recommended publications
  • Links (Including Embedded Links) – in General
    LINKS (INCLUDING EMBEDDED LINKS) – IN GENERAL Excerpted from Chapter 9 (Unique Intellectual Property Issues in Search Engine Marketing, Optimization and Related Indexing, Information Location Tools and Internet and Social Media Advertising Practices) from the April 2020 updates to E-Commerce and Internet Law: Legal Treatise with Forms 2d Edition A 5-volume legal treatise by Ian C. Ballon (Thomson/West Publishing, www.IanBallon.net) INTERNET, MOBILE AND DIGITAL LAW YEAR IN REVIEW: WHAT YOU NEED TO KNOW FOR 2021 AND BEYOND ASSOCIATION OF CORPORATE COUNSEL JANUARY 14, 2021 Ian C. Ballon Greenberg Traurig, LLP Silicon Valley: Los Angeles: 1900 University Avenue, 5th Fl. 1840 Century Park East, Ste. 1900 East Palo Alto, CA 914303 Los Angeles, CA 90067 Direct Dial: (650) 289-7881 Direct Dial: (310) 586-6575 Direct Fax: (650) 462-7881 Direct Fax: (310) 586-0575 [email protected] <www.ianballon.net> LinkedIn, Twitter, Facebook: IanBallon This paper has been excerpted from E-Commerce and Internet Law: Treatise with Forms 2d Edition (Thomson West April 2020 Annual Update), a 5-volume legal treatise by Ian C. Ballon, published by West, (888) 728-7677 www.ianballon.net Ian C. Ballon Silicon Valley 1900 University Avenue Shareholder 5th Floor Internet, Intellectual Property & Technology Litigation East Palo Alto, CA 94303 T 650.289.7881 Admitted: California, District of Columbia and Maryland F 650.462.7881 Second, Third, Fourth, Fifth, Seventh, Ninth, Eleventh and Federal Circuits Los Angeles U.S. Supreme Court 1840 Century Park East JD, LLM, CIPP/US Suite 1900 Los Angeles, CA 90067 [email protected] T 310.586.6575 LinkedIn, Twitter, Facebook: IanBallon F 310.586.0575 Ian C.
    [Show full text]
  • Online-Quellen Nutzen: Recherche Im Internet
    ONLINE-QUELLEN NUTZEN: RECHERCHE IM INTERNET Katharina Gilarski, Verena Müller, Martin Nissen (Stand: 08/2020) Inhaltsverzeichnis 1 Recherche mit Universalsuchmaschinen ............................................................. 2 1.1 Clever googlen ......................................................................................................... 2 1.2 Suchoperatoren für die einfache Suche ................................................................... 2 1.3 Die erweiterte Suche mit Google .............................................................................. 3 1.4 Die umgekehrte Bildersuche mit Google .................................................................. 4 1.5 Das Geheimnis der Treffersortierung in Google ....................................................... 5 1.6 Alternative universelle Suchmaschinen .................................................................... 6 1.7 Surface vs. Deep Web ............................................................................................. 9 1.8 Vor- und Nachteile von universellen Suchmaschinen ............................................. 10 1.9 Bewertung von Internetquellen ............................................................................... 10 2 Recherche mit wissenschaftlichen Suchmaschinen ......................................... 11 2.1 Google Scholar: Googles Suchmaschine für Wissenschaftler ................................ 11 2.2 Suchmöglichkeiten von Google Scholar ................................................................
    [Show full text]
  • Merging Multiple Search Results Approach for Meta-Search Engines
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by D-Scholarship@Pitt MERGING MULTIPLE SEARCH RESULTS APPROACH FOR META-SEARCH ENGINES By Khaled Abd-El-Fatah Mohamed B.S-------- Cairo University, Egypt, 1995 M.A-------Cairo University, Egypt, 1999 M.A------- University of Pittsburgh 2001 Submitted to the Graduate Faculty of School of Information Sciences in Partial Fulfillment of the requirements for the degree of Doctor of Philosophy University of Pittsburgh 2004 UNIVERSITY OF PITTSBURGH INFORMATION SCIENCES This dissertation was presented by Khaled Abd-El-Fatah Mohamed It was defended on Janauary 29, 2004 and approved by Chris Tomer, PhD, Associate Professor, DLIS Jose-Marie Griffiths, PhD, Professor, DLIS Don King, Research Professor, DLIS Amy Knapp, PhD, ULS Dissertation Director: Chris Tomer, PhD, Associate Professor MERGING MULTIPLE SEARCH RESULTS APPROACH FOR META-SEARCH ENGINES Khaled A. Mohamed, PhD University of Pittsburgh, 2004 Meta Search Engines are finding tools developed for enhancing the search performance by submitting user queries to multiple search engines and combining the search results in a unified ranked list. They utilized data fusion technique, which requires three major steps: databases selection, the results combination, and the results merging. This study tries to build a framework that can be used for merging the search results retrieved from any set of search engines. This framework based on answering three major questions: 1. How meta-search developers could define the optimal rank order for the selected engines. 2. How meta-search developers could choose the best search engines combination. 3. What is the optimal heuristic merging function that could be used for aggregating the rank order of the retrieved documents form incomparable search engines.
    [Show full text]
  • Web-Scale Responsive Visual Search at Bing
    Web-Scale Responsive Visual Search at Bing Houdong Hu, Yan Wang, Linjun Yang, Pavel Komlev, Li Huang, Xi (Stephen) Chen, Jiapei Huang, Ye Wu, Meenaz Merchant, Arun Sacheti Microsoft Redmond, Washington {houhu,wanyan,linjuny,pkomlev,huangli,chnxi,jiaphuan,wuye,meemerc,aruns}@microsoft.com ABSTRACT build a relevant, responsive, and scalable web-scale visual search In this paper, we introduce a web-scale general visual search system engine. To the best of the authors’ knowledge, this is the first work deployed in Microsoft Bing. The system accommodates tens of introducing a general web-scale visual search engine. billions of images in the index, with thousands of features for each Web-scale visual search engine is more than extending existing image, and can respond in less than 200 ms. In order to overcome visual search approaches to a larger database. Here web-scale means the challenges in relevance, latency, and scalability in such large the database is not restricted to a certain vertical or a certain web- scale of data, we employ a cascaded learning-to-rank framework site, but from a spider of a general web search engine. Usually the based on various latest deep learning visual features, and deploy in database contains tens of billions of images, if not more. With this a distributed heterogeneous computing platform. Quantitative and amount of data, the major challenges come from three aspects. First, qualitative experiments show that our system is able to support a lot of approaches that may work on a smaller dataset become im- various applications on Bing website and apps.
    [Show full text]
  • 10 Search Engines Suitable for Children
    www.medialiteracycouncil.sg 10 Search Engines suitable for Children Even if you have installed internet filters, there is no 100% guarantee that your kids will not be able to access or stumble onto inappropriate content like adult or horror content that may be disturbing for kids. Help is however on hand, in the form of “safe search engines” which help children find relevant information in a safe, kid-friendly setting. These search engines do not display results or images that are inappropriate for children. They are useful tools for children when they need to research on stuff for their school work or simply to explore the internet on their own. Get your kids to use one of these search engines today! 1. Safe Search (www.google.safesearchkids.com) – This search engine was the brainchild of a UK company that is dedicated to providing the best online resources for kids. It uses Google’s SafeSearch technology to filter out offensive content and also removes distracting ads from search results. It is a great site for home and school use. Unlike other Google Safe Search engines for kids, SafeSearch for Kids does not feature picture icons by search results, hence preventing the kids from seeing any inappropriate images unintentionally. SafeSearch for Kids is the child friendly search engine where safe search is always 'on', powered by Google. The safe browsing feature allows your kids to safely surf the web with a much lower risk of accidentally seeing illicit material. 2. Fact Monster (http://www.factmonster.com) – Does your child need help researching an assignment for school? Fact Monster is a free online almanac, dictionary, encyclopedia and thesaurus which will help kids quickly find the information they need.
    [Show full text]
  • Crypto Course Magdeburg 23. November 2019
    Crypto Course Magdeburg 23. November 2019 Jan & Julia Digitalcourage e.V. ▶ non-profit association for data protection and civil rights ▷ "for a world worth living in the digital age" ▷ Big Brother Awards ▷ Actions on current topics ▶ Digitalcourage university group Bielefeld (www.digitalcourage.de/hsg-bi) ▷ CryptoParties, Backup Parties, Linux Install Parties ▷ Regular meetings at the university CryptoParty ▶ Digital self-defense ▶ Protection against mass surveillance ▶ Beginner friendly ▶ Public, non-commercial, worldwide ▶ By users for users ▶ Join in and become part of the CryptoParty movement ▶ https://cryptoparty.in The Course at a Glance ▶ Why should I learn how to encrypt? ▶ How to secure my browser ▶ Basics of smartphone security LET'S GO! The Course at a Glance ▶ Why should I learn how to encrypt? ▶ How to secure my browser ▶ Basics of smartphone security Digital Identity Metadata ▶ Search terms (Search History) ▶ Entered, seen, clicked ▶ IP address ▶ Language ▶ Date, time ▶ Device, operating system, browser ▶ Location (GPS or Browser) ▶ https://myactivity.google.com/ Google Services To no one you are more honest than to the search field of google. Privacy Why do we need privacy? ▶ „The right to be left alone.“ ▶ Free development of personality ▶ Control over the consequences of one's own actions ▶ Self-determination (who knows what about me) ▶ Protection against criticism and discrimination ▶ Security (passwords, property,...) ▶ Freedom ▶ Intimacy? ▷ IMPORTANT FOR THE INDIVIDUAL Why does a society need privacy? ▶ Important
    [Show full text]
  • A Baker's Dozen of Tips for Be Er Web Searches
    A Baker’s Dozen of Tips for Beer Web Searches Anne Burnett, J.D., M.L.I.S. University of Georgia School of Law Library Athens, Georgia Lawyers use the § ABA Tech Report 2019 web for legal § 90% use free online resources research either regularly or occasionally When to use free resources § If item(s) likely to be freely available § If starting with free & switching to When do subscription for supplemental lawyers use the material will save $$$ web for § If time spent on free doesn’t outweigh research? $$ spent on paid § Recent primary legal information § Government information What is free § Company and directory information web good for? § Information about individuals § Reference information and statistics § Comprehensive sites--collecting all relevant material, from all jurisdictions § High quality, reliable secondary sources What is not § Annotated codes, cases with available? headnotes § Sophisticated citator services, such as Shepard's or KeyCite § Older materials The Tips Use Quotation Marks • Phrase searching • “consumer protection” #1 Can I Quote You? • “John F. Kennedy” • Single word in precise form • “childcare” ≠ “child care” Space = AND Google and Bing recognize OR Minus sign excludes terms • RICO –Puerto #2 • Vikings –football –team Smooth Operators AROUND(x) – proximity operator • John AROUND(2) Kennedy • John F. Kennedy • John Fitzgerald Kennedy • John Kennedy • Kennedy, John F. Limit by • Domain: .edu, .org., .gov, .int, -.com, .de • File type: .pdf, .com, .ppt, .xls • Language #3 • Country Learn Your Limits • Last update
    [Show full text]
  • Intercultural Dimensions of E-Learning
    Using the Internet for Intercultural Training! A pilot study of web sites in English for children, young adults, teachers and trainers - EUMC Using the Internet for Intercultural Training! A pilot study of web sites in English for children, young adults, teachers and trainers Vienna, September 2003 1 Using the Internet for Intercultural Training! A pilot study of web sites in English for children, young adults, teachers and trainers - EUMC Using the Internet for Intercultural Training! A pilot study of web sites in English for children, young adults, teachers and trainers on behalf of the European Monitoring Centre on Racism and Xenophobia (EUMC) by Andreas Hieronymus iMiR - Institut fuer Migrations- und Rassismusforschung Vienna, September 2003 2 Using the Internet for Intercultural Training! A pilot study of web sites in English for children, young adults, teachers and trainers - EUMC DISCLAIMER This Report has been carried out by Dr. Andreas Hieronymus at the Institut für Migrations- und Rassismusforschung (IMIR) on behalf of the EUMC. The opinions expressed by the author do not necessarily reflect the position of the EUMC. Reproduction is authorized, except for commercial purposes, provided the source is acknowledged and the attached text accompanies any reproduction: “This study has been carried out on behalf of the European Monitoring Centre on Racism and Xenophobia (EUMC). The opinions expressed by the author do not necessarily reflect the position of the EUMC. This publication contain references, and pointers, to information maintained by other organisations, over which the EUMC has no control and for which the EUMC assumes no responsibility. Please note that we do not control and cannot guarantee the relevance, timeliness or accuracy of outside materials.
    [Show full text]
  • Download Download
    International Journal of Management & Information Systems – Fourth Quarter 2011 Volume 15, Number 4 History Of Search Engines Tom Seymour, Minot State University, USA Dean Frantsvog, Minot State University, USA Satheesh Kumar, Minot State University, USA ABSTRACT As the number of sites on the Web increased in the mid-to-late 90s, search engines started appearing to help people find information quickly. Search engines developed business models to finance their services, such as pay per click programs offered by Open Text in 1996 and then Goto.com in 1998. Goto.com later changed its name to Overture in 2001, and was purchased by Yahoo! in 2003, and now offers paid search opportunities for advertisers through Yahoo! Search Marketing. Google also began to offer advertisements on search results pages in 2000 through the Google Ad Words program. By 2007, pay-per-click programs proved to be primary money-makers for search engines. In a market dominated by Google, in 2009 Yahoo! and Microsoft announced the intention to forge an alliance. The Yahoo! & Microsoft Search Alliance eventually received approval from regulators in the US and Europe in February 2010. Search engine optimization consultants expanded their offerings to help businesses learn about and use the advertising opportunities offered by search engines, and new agencies focusing primarily upon marketing and advertising through search engines emerged. The term "Search Engine Marketing" was proposed by Danny Sullivan in 2001 to cover the spectrum of activities involved in performing SEO, managing paid listings at the search engines, submitting sites to directories, and developing online marketing strategies for businesses, organizations, and individuals.
    [Show full text]
  • Interpix Introduces Enhanced Visual Search Engine That Uses Text
    Interpix Introduces Enhanced Visual Search Engine That Uses Text, Pictures To Locate Sites Yahoo!, Infoseek to Feature Link to New Internet Tool SANTA CLARA, CA -- September 27, 1996 -- Internet surfing just got easier with the introduction of Interpix Software Corporation's Image Surfer (http://isurf.interpix.com), a new tool available on the Internet which utilizes both key words and categories as its search criteria while displaying search results as pictures. Expanding its previous version, the new Image Surfer now adds a text-based search feature to its unique visual search engine, and will be a featured link on the new Infoseek Ultra service (http://ultra.infoseek.comhttp://ultra.infoseek.com) as well as Yahoo! (http://www.yahoo.com), where the original image-only search technology made its debut. On the Image Surfer Web site, users can type in key words or pick a particularly image-rich category such as "Cars," "Supermodels" or "Animation." Pictures from Web sites within the corresponding choice are displayed as "thumbnail" images (i.e. smaller versions of the actual pictures that take seconds to download) which offer a preview of what is contained on each page. Clicking on a thumbnail image will automatically access the Web site where that image is located. In addition to searching within the general categories, keywords can now be entered to find a collection of pictures for a specific subject. "Image Surfer's enhancement of the current Internet search process provides a unique solution for users interested in image-intensive Web browsing," said Michael T. Heylin, senior associate for San Francisco-based Creative Strategies Consulting.
    [Show full text]
  • Visual Search Engine for Handwritten and Typeset Math in Lecture Videos and LATEX Notes
    Visual Search Engine for Handwritten and Typeset Math in Lecture Videos and LATEX Notes Kenny Davila Richard Zanibbi Center for Unified Biometrics and Sensors Department of Computer Science University at Buffalo Rochester Institute of Technology Buffalo, NY 14260 Rochester, NY 14623 Email: [email protected] Email: [email protected] Abstract—To fill a gap in online educational tools, we are ways: 1) math is represented in images rather than symbolic working to support search in lecture videos using formulas representations such as LATEX code, and these images may from lecture notes and vice versa. We use an existing system to contain other content (e.g., text and diagrams), 2) we use a convert single-shot lecture videos to keyframe images that capture whiteboard contents along with the times they appear. We train non-hierarchical structure representation (Line-of-Sight (LOS) classifiers for handwritten symbols using the CROHME dataset, graphs), and 3) we use no language models apart from that and for LATEX symbols using generated images. Symbols detected represented in symbol recognizers, allowing extension to other in video keyframes and LATEX formula images are indexed using graphic types. Line-of-Sight graphs. For search, we lookup pairs of symbols that Our search engine is described in Sections III-V. Given a can ‘see’ each other, and connected pairs are merged to identify the largest match within each indexed image. We rank matches binary image, handwritten or typeset symbol recognition is using symbol class probabilities and angles between symbol pairs. applied. Detected symbols are then used to construct a Line- We demonstrate how our method effectively locates formulas of-Sight graph, with edges between pairs of symbols that ‘see’ between typeset and handwritten images using a set of linear one another along a straight line.
    [Show full text]
  • Visual Search Application for Android
    San Jose State University SJSU ScholarWorks Master's Projects Master's Theses and Graduate Research Fall 2012 VISUAL SEARCH APPLICATION FOR ANDROID Harsh Patel San Jose State University Follow this and additional works at: https://scholarworks.sjsu.edu/etd_projects Recommended Citation Patel, Harsh, "VISUAL SEARCH APPLICATION FOR ANDROID" (2012). Master's Projects. 260. DOI: https://doi.org/10.31979/etd.zf83-mgzy https://scholarworks.sjsu.edu/etd_projects/260 This Master's Project is brought to you for free and open access by the Master's Theses and Graduate Research at SJSU ScholarWorks. It has been accepted for inclusion in Master's Projects by an authorized administrator of SJSU ScholarWorks. For more information, please contact [email protected]. THE VISUAL SEARCH APPLICATION FOR ANDROID A Project Report Presented to The Faculty of the Department of Computer Science San Jose State University In Partial Fulfillment of the Requirements for the Degree Master of Science Submitted By: Harsh Patel June 2012 i © 2012 Harsh Patel ALL RIGHTS RESERVED SAN JOSÉ STATE UNIVERSITY ii The Undersigned Project Committee Approves the Project Titled VISUAL SEARCH APPLICATION FOR ANDROID By Harsh Patel APPROVED FOR THE DEPARTMENT OF COMPUTER SCIENCE __________________________________________________________ Dr. Soon Teoh, Department of Computer Science Date __________________________________________________________ Dr. Robert Chun, Department of Computer Science Date __________________________________________________________ Rajan Vyas, Software Engineer at Healthline Networks Date __________________________________________________________ Associate Dean Office of Graduate Studies and Research Date iii ABSTRACT The Visual Search Application for Android The Search Engine has played an important role in information society. Information in the form of text or a visual image is easily available over the internet.
    [Show full text]