Combining Depth, Color and Position Information for Object Instance Recognition on an Indoor Mobile Robot Louis-Charles Caron

Total Page:16

File Type:pdf, Size:1020Kb

Combining Depth, Color and Position Information for Object Instance Recognition on an Indoor Mobile Robot Louis-Charles Caron Combining Depth, Color and Position Information for Object Instance Recognition on an Indoor Mobile Robot Louis-Charles Caron To cite this version: Louis-Charles Caron. Combining Depth, Color and Position Information for Object Instance Recog- nition on an Indoor Mobile Robot. Computer Vision and Pattern Recognition [cs.CV]. ENSTA Paris- Tech, 2015. English. tel-01251481 HAL Id: tel-01251481 https://hal.archives-ouvertes.fr/tel-01251481 Submitted on 6 Jan 2016 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Thèse Combining Depth, Color and Position Information for Object Instance Recognition on an Indoor Mobile Robot Présentée à l’Unité d’Informatique et d’Ingénierie des Systèmes pour l’obtention du grade de Docteur de l’ENSTA ParisTech École Nationale Supérieure des Techniques Avancées Spécialité : Informatique par Louis-Charles Caron Thèse soutenue le 4 novembre 2015 devant le jury composé de Président: Youcef Mezouar Professeur — Institut Pascal Clermont-Ferrand Rapporteur: Fabien Moutarde Maître-assistant HdR — Mines ParisTech Rapporteur: Michel Devy Directeur de Recherche — LAAS-CNRS Examinateur: Guy Le Besnerais Maître de recherches HdR — ONERA Superviseur: David Filliat Professeur — ENSTA ParisTech Co-superviseur: Alexander Gepperth Maître de conférence — ENSTA ParisTech 2 Résumé Des robots mobiles ont déjà fait leur apparition dans nos domiciles pour accom- plir des tâches simples. Pour qu’un robot devienne un véritable assistant, il doit reconnaître les objects qui appartiennent à son propriétaire. Dans cette thèse, des algorithmes de reconnaissance d’instances d’objets sont développés pour faire face aux variations (angles de vue, illumination, etc.) qui surviennent dans un contexte de robotique mobile d’intérieur. Différentes manières de tirer profit de ce contexte sont étudiées. Premièrement, un algorithme de segmentation géometrique est proposé pour profiter de la structure inhérente aux scènes d’intérieur et y détecter des objects isolés. Un réseau de neurones pour la reconnaissance d’objets qui fusionne des informations de forme, couleur et texture provenant d’images de couleur et de profondeur est en- suite présenté. Cet algorithme met en évidence l’importance de combiner plusieurs sources d’information et la difficulté à utiliser la couleur en robotique. Enfin,une solution alternative à base de recherche de plus proche voisin, plus facile à entraîner que le réseau de neurones, est détaillée. Cette approche utilise des mesures comme la distance à l’objet pour éliminer certains paramètres dans la recherche de plus proche voisin et le partitionnement de données. L’information provenant de multiples vues d’un même objet sont aussi fusionnés. L’algorithme résultant fonctionne sur un robot mobile et peut reconnaître 52 ob- jects en 500 ms en moyenne (sur un Intel Core i5 avec 3 GB de RAM) avec un taux de succès de 80%. Les expériences menées dans cette thèse montrent qu’il est essentiel d’identifier et d’utiliser la structure et l’information présentes dans le contexte dela robotique d’intérieur pour faire face aux grandes variations qu’il peut y survenir. Abstract Mobile robots have already entered people’s homes to perform simple tasks for them. For robots at home to become real assistants, they have to be able to rec- ognize the objects in their owner’s home. In this thesis, object instance recognition algorithms are designed to cope with the variations (viewing angle, lighting condi- tions, etc.) that occur in the context of mobile robotics experiments. Several ways to take advantage of this context are studied. First, a geometric segmentation algorithm that benefits from the structure of indoor scenes to find isolated objects isdesigned. Then, a neural network based object recognition process that fuses shape, color and texture information provided by color and depth cameras is presented. This step highlights the importance of carefully combining multiple features and the difficulty to use color information in robotics. Finally, an alternative approach using a nearest neighbor classifier, which is easier to train than the neural network, is detailed. It relies on physical measures available to the robot to eliminate some parameters in clustering and nearest neighbor search procedures. Also, it uses information gathered through multiple sightings of the objects to reduce the negative impact of occlusions. The algorithm can recognize 52 objects with a success rate of 80% and runs in 500 ms on average (on an Intel Core i5 CPU with 3 GB of RAM) on a mobile robot. This work shows that identifying and taking advantage of the structure and information available is essential to handle the variations that happen in indoor mobile robot experiments. 3 4 Remerciments Merci à tous ceux qui m’ont aidé, accompagné, entretenu, supporté, enduré, encour- agé, hébergé et inspiré tout au long de ces 3 ans (et demie (et un peu plus)). Cette thèse a été financée par une bourse d’études supérieures du Conseil de recherches en sciences naturelles et en génie du Canada (CRSNG). This thesis was funded by a Postgraduate Scholarship from the Natural Sciences and Engineering Research Council of Canada (NSERC). 5 6 Contents 1 Introduction 15 1.1 Autonomous mobile robots........................ 15 1.2 Software aspects of a robot at home................... 16 1.3 Computer vision on a mobile robot................... 17 1.4 A scenario for a mobile robot at home................. 21 1.5 Contributions............................... 23 1.6 Structure of the thesis.......................... 26 2 State of the art 27 2.1 Image segmentation............................ 27 2.1.1 Over-segmentation........................ 28 2.1.2 Foreground-background separation............... 30 2.2 Feature-based image comparison..................... 32 2.2.1 From pixels to features...................... 32 2.2.2 Detector: from dense to sparse.................. 34 2.2.3 From an array to a set...................... 35 2.2.4 Vocabularies: from values to representatives.......... 37 2.3 Color in computer vision......................... 39 2.3.1 Models of photometric changes................. 39 2.3.2 Color representations....................... 40 2.3.3 Transformed color representation................ 42 2.3.4 Color moment invariants..................... 43 2.4 Using histograms for density estimation................. 44 2.4.1 Choosing parameters for histograms............... 44 2.4.2 Aliasing in histograms...................... 45 2.4.3 Comparing histograms...................... 46 2.5 Trends in object instance recognition algorithms for mobile robots.. 49 3 Methods 53 3.1 Hardware................................. 53 3.2 Software.................................. 54 3.3 Algorithms................................. 54 3.3.1 Parametric model fitting using RANSAC............ 54 3.3.2 Nearest neighbor search with kd-trees.............. 55 3.3.3 Adaptive occupancy representation using octrees........ 56 7 3.3.4 Computing point normals in a point cloud........... 57 3.3.5 Simultaneous localization and mapping............. 58 3.3.6 Scale invariant feature transform for texture description.... 58 3.3.7 Surflet-pair relation for shape description............ 59 3.3.8 Function approximation with feed-forward neural network.. 61 3.4 Data.................................... 63 3.4.1 Segmentation dataset....................... 63 3.4.2 ENSTA offline object dataset.................. 63 3.4.3 ENSTA online object dataset.................. 66 3.5 Multi-class classification performance measures............. 66 4 Geometrical indoor scene segmentation on a mobile robot 71 4.1 Introduction................................ 71 4.2 Design choices............................... 71 4.3 Implementation details.......................... 73 4.3.1 Offline calibration......................... 73 4.3.2 Pre-processing........................... 73 4.3.3 Floor removal........................... 73 4.3.4 Walls removal........................... 75 4.3.5 Object candidates over-segmentation.............. 77 4.3.6 Object candidates rejection................... 78 4.3.7 Parameters............................ 78 4.3.8 Process overview......................... 78 4.4 Experiments................................ 78 4.4.1 Segmentation performance.................... 78 4.4.2 Run time............................. 79 4.4.3 Use cases............................. 80 4.5 Discussion................................. 85 4.6 Conclusion................................. 85 5 Global object recognition by fusion of shape and texture information with a feed-forward neural network 87 5.1 Introduction................................ 87 5.2 Design choices............................... 87 5.3 Description of the features........................ 89 5.3.1 Histogram of occurrence of SIFT words............. 89 5.3.2 Saturation weighted hue histogram............... 91 5.3.3 Transformed RGB histogram................... 91 5.3.4 Surflet-pair-relation histogram.................. 91 5.4 Data fusion with a feed-forward neural network............ 92 5.4.1
Recommended publications
  • 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
    1 TABLE OF CONTENTS 2 I. INTRODUCTION ...................................................................................................... 2 3 II. JURISDICTION AND VENUE ................................................................................. 8 4 III. PARTIES .................................................................................................................... 9 5 A. Plaintiffs .......................................................................................................... 9 6 B. Defendants ....................................................................................................... 9 7 IV. FACTUAL ALLEGATIONS ................................................................................... 17 8 A. Alphabet’s Reputation as a “Good” Company is Key to Recruiting Valuable Employees and Collecting the User Data that Powers Its 9 Products ......................................................................................................... 17 10 B. Defendants Breached their Fiduciary Duties by Protecting and Rewarding Male Harassers ............................................................................ 19 11 1. The Board Has Allowed a Culture Hostile to Women to Fester 12 for Years ............................................................................................. 19 13 a) Sex Discrimination in Pay and Promotions: ........................... 20 14 b) Sex Stereotyping and Sexual Harassment: .............................. 23 15 2. The New York Times Reveals the Board’s Pattern
    [Show full text]
  • Should Google Be Taken at Its Word?
    CAN GOOGLE BE TRUSTED? SHOULD GOOGLE BE TAKEN AT ITS WORD? IF SO, WHICH ONE? GOOGLE RECENTLY POSTED ABOUT “THE PRINCIPLES THAT HAVE GUIDED US FROM THE BEGINNING.” THE FIVE PRINCIPLES ARE: DO WHAT’S BEST FOR THE USER. PROVIDE THE MOST RELEVANT ANSWERS AS QUICKLY AS POSSIBLE. LABEL ADVERTISEMENTS CLEARLY. BE TRANSPARENT. LOYALTY, NOT LOCK-IN. BUT, CAN GOOGLE BE TAKEN AT ITS WORD? AND IF SO, WHICH ONE? HERE’S A LOOK AT WHAT GOOGLE EXECUTIVES HAVE SAID ABOUT THESE PRINCIPLES IN THE PAST. DECIDE FOR YOURSELF WHO TO TRUST. “DO WHAT’S BEST FOR THE USER” “DO WHAT’S BEST FOR THE USER” “I actually think most people don't want Google to answer their questions. They want Google to tell them what they should be doing next.” Eric Schmidt The Wall Street Journal 8/14/10 EXEC. CHAIRMAN ERIC SCHMIDT “DO WHAT’S BEST FOR THE USER” “We expect that advertising funded search engines will be inherently biased towards the advertisers and away from the needs of consumers.” Larry Page & Sergey Brin Stanford Thesis 1998 FOUNDERS BRIN & PAGE “DO WHAT’S BEST FOR THE USER” “The Google policy on a lot of things is to get right up to the creepy line.” Eric Schmidt at the Washington Ideas Forum 10/1/10 EXEC. CHAIRMAN ERIC SCHMIDT “DO WHAT’S BEST FOR THE USER” “We don’t monetize the thing we create…We monetize the people that use it. The more people use our products,0 the more opportunity we have to advertise to them.” Andy Rubin In the Plex SVP OF MOBILE ANDY RUBIN “PROVIDE THE MOST RELEVANT ANSWERS AS QUICKLY AS POSSIBLE” “PROVIDE THE MOST RELEVANT ANSWERS AS QUICKLY
    [Show full text]
  • Ouellette, the Google Shortcut to Trademark Law, 102 CALIF
    Preferred citation: Lisa Larrimore Ouellette, The Google Shortcut to Trademark Law, 102 CALIF. L. REV. (forthcoming 2014), available at http://ssrn.com/abstract=2195989. The Google Shortcut to Trademark Law Lisa Larrimore Ouellette* Trademark distinctiveness—the extent to which consumers view a mark as identifying a particular source—is the key factual issue in assessing whether a mark is protectable and what the scope of that protection should be. But distinctiveness is difficult to evaluate in practice: assessments of “inherent distinctiveness” are highly subjective, survey evidence is expensive and unreliable, and other measures of “acquired distinctiveness” such as advertising spending are poor proxies for consumer perceptions. But there is now a simpler way to determine whether consumers associate a word or phrase with a certain product: Google. Through a study of trademark cases and contemporaneous search results, I argue that Google can generally capture both prongs of the test for trademark distinctiveness: if a mark is strong—either inherently distinctive or commercially strong—then many top search results for that mark relate to the source it identifies. The extent of results overlap between searches for two different marks can also be relevant for assessing the likelihood of confusion of those marks. In the cases where Google and the court disagree, I argue that Google more accurately reflects how consumers view a given mark. Courts have generally given online search results little weight in offline trademark disputes. But the key factual questions in these cases depend on the wisdom of the crowds, making Google’s “algorithmic authority” highly probative. * Yale Law School Information Society Project, Postdoctoral Associate in Law and Thomson Reuters Fellow.
    [Show full text]
  • Exploring Visual Content in Social Networks
    FACULDADE DE ENGENHARIA DA UNIVERSIDADE DO PORTO Exploring Visual Content in Social Networks Mariana Afonso WORKING VERSION PREPARATION FOR THE MSCDISSERTATION Supervisor: Prof. Dr. Luís Filipe Pinto de Almeida Teixeira February 18, 2015 c Mariana Fernandez Afonso, 2015 Contents 1 Introduction 1 1.1 Background . 1 1.2 Motivation . 2 1.3 Objectives . 2 1.4 Document Structure . 3 2 Related Concepts and Background 5 2.1 Social network mining . 5 2.1.1 Twitter . 6 2.1.2 Research directions and trends . 6 2.1.3 Opinion mining and sentiment analysis . 6 2.1.4 Cascade and Influence Maximization . 7 2.1.5 TweeProfiles . 8 2.2 Data mining techniques and algorithms . 9 2.2.1 Clustering . 10 2.2.2 Data Stream Clustering . 22 2.2.3 Cluster validity . 22 2.3 Content based image retrieval . 26 2.3.1 The semantic gap . 27 2.3.2 Reducing the sematic gap . 28 2.4 Image descriptors . 32 2.4.1 Low-level image features . 32 2.4.2 Mid level image descriptors . 54 2.5 Performance Evaluation . 58 2.5.1 Image databases . 59 2.6 Visualization of image collections . 61 2.7 Discussion . 65 3 Related Work 67 3.1 Discussion . 70 4 Work plan 71 4.1 Methodology . 71 4.2 Development Tools . 71 4.3 Task description and planning . 72 References 75 i ii CONTENTS List of Figures 2.1 Clusters in Portugal; Content proportion 100%. 9 2.2 Clusters in Portugal; Content 50% + Spacial 50%. 9 2.3 Clusters in Portugal; Content 50% + Temporal 50%.
    [Show full text]
  • Revisiting Search Engine Bias Eric Goldman
    William Mitchell Law Review Volume 38 | Issue 1 Article 14 2011 Revisiting Search Engine Bias Eric Goldman Follow this and additional works at: http://open.mitchellhamline.edu/wmlr Recommended Citation Goldman, Eric (2011) "Revisiting Search Engine Bias," William Mitchell Law Review: Vol. 38: Iss. 1, Article 14. Available at: http://open.mitchellhamline.edu/wmlr/vol38/iss1/14 This Article is brought to you for free and open access by the Law Reviews and Journals at Mitchell Hamline Open Access. It has been accepted for inclusion in William Mitchell Law Review by an authorized administrator of Mitchell Hamline Open Access. For more information, please contact [email protected]. © Mitchell Hamline School of Law Goldman: Revisiting Search Engine Bias REVISITING SEARCH ENGINE BIAS † Eric Goldman I. INTRODUCTION ........................................................................ 96 II. DEVELOPMENTS IN THE LAST HALF-DOZEN YEARS .................. 97 A. Google Rolled Up the Keyword Search Market but Faces Other New Competitors ........................................................ 97 B. Google’s Search Results Page Has Gotten More Complicated ...................................................................... 102 C. Google’s Portalization ........................................................ 103 D. “Net Neutrality” and “Search Neutrality” ........................... 105 III. THE END OF RATIONAL DISCUSSION ABOUT SEARCH ENGINE BIAS........................................................................... 107 I. INTRODUCTION
    [Show full text]
  • From #Deleteuber. to 'Hell': a Short History of Uber's Recent Struggles
    From #deleteUber to 'Hell': A short history of Uber's recent straggles - The Washington ... Page 1 of 5 sit- t I cur 3-14-t? The Washington post The Switch From #deleteUber. to 'Hell': A short history of Uber's recent struggles By Brian Fung May 5 Uber has not had a great start to the year. The ride-hailing company has been reeling from a public battering over claims of willful discrimination, allegations of intellectual-property theft and the departure of several executives. The controversies have resurfaced a debate over Uber's hard-charging internal culture and the consequences of its win-at-any-cost attitude to business and regulation. If you're having trouble keeping up with all the Uber news, here's a brief history of its struggles in 2017. Late January Hundreds of thousands of Uber customers reportedly canceled their accounts in response to the #deleteUber social media campaign after the company continued to run service while taxis were on strike at John F. Kennedy International Airport in New York. The strike was to protest President Trump's travel ban targeting foreign nationals from seven Muslim-majority countries. Some users viewed Uber's decision to continue to pick up passengers as an attempt at profiteering. Uber suffered a lo percent drop in rides that weekend, according to some estimates. Feb. 2 Amid continuing criticism for not suspending service to JFK over the travel ban, Uber chief executive Travis Kalanick stepped down from his position as a strategic adviser to Trump. Kalanick had been a member of a special advisory council to the White House that included Tesla chief executive Elon Musk and a number of other executives.
    [Show full text]
  • Revisiting Search Engine Bias Eric Goldman Santa Clara University School of Law, [email protected]
    Santa Clara Law Santa Clara Law Digital Commons Faculty Publications Faculty Scholarship 1-1-2011 Revisiting Search Engine Bias Eric Goldman Santa Clara University School of Law, [email protected] Follow this and additional works at: http://digitalcommons.law.scu.edu/facpubs Part of the Law Commons Recommended Citation 38 Wm. Mitchell L. Rev. 96 (2011-2012) This Article is brought to you for free and open access by the Faculty Scholarship at Santa Clara Law Digital Commons. It has been accepted for inclusion in Faculty Publications by an authorized administrator of Santa Clara Law Digital Commons. For more information, please contact [email protected]. REVISITING SEARCH ENGINE BIAS † Eric Goldman I. INTRODUCTION ........................................................................ 96 II. DEVELOPMENTS IN THE LAST HALF-DOZEN YEARS .................. 97 A. Google Rolled Up the Keyword Search Market but Faces Other New Competitors ........................................................ 97 B. Google’s Search Results Page Has Gotten More Complicated ...................................................................... 102 C. Google’s Portalization ........................................................ 103 D. “Net Neutrality” and “Search Neutrality” ........................... 105 III. THE END OF RATIONAL DISCUSSION ABOUT SEARCH ENGINE BIAS........................................................................... 107 I. INTRODUCTION Questions about search engine bias have percolated in the academic literature for over a decade. In the past few years, the issue has evolved from a quiet academic debate to a full blown regulatory and litigation frenzy. At the center of this maelstrom is Google, the dominant market player. This Essay looks at changes in the industry and political environment over the past half-dozen years that have contributed to the current situation,1 and supplements my prior contribution to † Associate Professor and Director, High Tech Law Institute, Santa Clara University School of Law.
    [Show full text]
  • Amended Complaint
    19CV341522 Santa Clara – Civil Electronically Filed 1 OTTINI OTTINI INC B & B , . by Superior Court of CA, FrancisA.Bottini,Jr.(SBN175783) County of Santa Clara, 2 AlbertY.Chang(SBN296065) on 8/16/2019 3:18 PM YuryA.Kolesnikov(SBN271173) 3 Reviewed By: R. Walker 7817IvanhoeAvenue,Suite102 Case #19CV341522 LaJolla,California92037 4 Envelope: 3274669 Telephone:(858)914-2001 5 Facsimile:(858)914-2002 Email:[email protected] 6 [email protected] [email protected] 7 8 COHENMILSTEINSELLERS&TOLLPLLC JulieGoldsmithReiser( ) 9 MollyBowen( ) 1100NewYorkAvenue,N.W.,Suite500 10 Washington,D.C.20005 11 Telephone:(202)408-4600 Facsimile:(202)408-4699 12 Email:[email protected] [email protected] 13 14 15 [AdditionalCounselonSignaturePage] 16 SUPERIORCOURTOFTHESTATEOFCALIFORNIA INANDFORTHECOUNTYOFSANTACLARA 17 18 INREALPHABETINC.SHAREHOLDER LeadCaseNo.19CV341522 19 DERIVATIVELITIGATION 20 CONSOLIDATED 21 STOCKHOLDERDERIVATIVE ThisDocumentRelatesto: COMPLAINTFOR: 22 DEMANDFUTILITYACTION (1)BREACHOFFIDUCIARYDUTY; 23 (2)UNJUSTENRICHMENT; (3)CORPORATEWASTE;and 24 (4)ABUSEOFCONTROL 25 JURYTRIALDEMANDED 26 27 PUBLIC-REDACTSMATERIALSFROMCONDITIONALLYSEALEDRECORD 28 CONSOLIDATEDSTOCKHOLDERDERIVATIVECOMPLAINT 1 TABLE OF CONTENTS 2 I. INTRODUCTION ...................................................................................................... 2 3 II. JURISDICTION AND VENUE ............................................................................... 11 4 III. PARTIES .................................................................................................................
    [Show full text]
  • 2012, Dec, Google Introduces Metaweb Searching
    Google Gets A Second Brain, Changing Everything About Search Wade Roush12/12/12Follow @wroush Share and Comment In the 1983 sci-fi/comedy flick The Man with Two Brains, Steve Martin played Michael Hfuhruhurr, a neurosurgeon who marries one of his patients but then falls in love with the disembodied brain of another woman, Anne. Michael and Anne share an entirely telepathic relationship, until Michael’s gold-digging wife is murdered, giving him the opportunity to transplant Anne’s brain into her body. Well, you may not have noticed it yet, but the search engine you use every day—by which I mean Google, of course—is also in the middle of a brain transplant. And, just as Dr. Hfuhruhurr did, you’re probably going to like the new version a lot better. You can think of Google, in its previous incarnation, as a kind of statistics savant. In addition to indexing hundreds of billions of Web pages by keyword, it had grown talented at tricky tasks like recognizing names, parsing phrases, and correcting misspelled words in users’ queries. But this was all mathematical sleight-of-hand, powered mostly by Google’s vast search logs, which give the company a detailed day-to-day picture of the queries people type and the links they click. There was no real understanding underneath; Google’s algorithms didn’t know that “San Francisco” is a city, for instance, while “San Francisco Giants” is a baseball team. Now that’s changing. Today, when you enter a search term into Google, the company kicks off two separate but parallel searches.
    [Show full text]
  • (2019-01-10) BUZZFEED. a New Lawsuit Claims Google's Board
    A New Lawsuit Claims Google's Board Tolerated Sexual Misconduct By Former Execs Andy Rubin And Amit Singhal 1/12/19, 10:26 AM REPORTING TO YOU TECH Google's Board Is Being Sued For Allegedly Silencing Misconduct Claims Against Former Executives Lawyers say an internal investigation by Google claimed to find bondage videos on former company executive Andy Rubin’s computer. “You won’t believe what’s in these [shareholder] minutes.” Davey Alba BuzzFeed News Reporter Ryan Mac BuzzFeed News Reporter https://www.buzzfeednews.com/article/daveyalba/google-board-lawsuit-silencing-sexual-misconduct-claims Page 1 of 9 A New Lawsuit Claims Google's Board Tolerated Sexual Misconduct By Former Execs Andy Rubin And Amit Singhal 1/12/19, 10:26 AM Last updated on January 11, 2019, at 2:41 p.m. ET Posted on January 10, 2019, at 5:01 p.m. ET Mason Trinca / Getty Images Attorneys representing a Google shareholder revealed details of a new lawsuit that claims the company's board of directors covered up sexual misconduct by former Google senior executives, including Andy Rubin, the creator of the popular mobile operating software Android, and Amit Singhal, the former head of search. Even after Google investigated and found that the allegations of Rubin's sexual misconduct were credible, the suit says, it allowed him to resign and approved a $90 million severance for him. The suit, which was filed in San Mateo County Superior Court in California https://www.buzzfeednews.com/article/daveyalba/google-board-lawsuit-silencing-sexual-misconduct-claims Page 2 of 9 A New Lawsuit Claims Google's Board Tolerated Sexual Misconduct By Former Execs Andy Rubin And Amit Singhal 1/12/19, 10:26 AM Thursday morning, contains minutes from board of directors meetings that detail how the tech giant dealt with employee complaints made against Rubin in 2014 and Singhal in 2016, and how it compensated these executives when they left the company.
    [Show full text]
  • Modern Information Retrieval: a Brief Overview
    Modern Information Retrieval: A Brief Overview Amit Singhal Google, Inc. [email protected] Abstract For thousands of years people have realized the importance of archiving and finding information. With the advent of computers, it became possible to store large amounts of information; and finding useful information from such collections became a necessity. The field of Information Retrieval (IR) was born in the 1950s out of this necessity. Over the last forty years, the field has matured considerably. Several IR systems are used on an everyday basis by a wide variety of users. This article is a brief overview of the key advances in the field of Information Retrieval, and a description of where the state-of-the-art is at in the field. 1 Brief History The practice of archiving written information can be traced back to around 3000 BC, when the Sumerians designated special areas to store clay tablets with cuneiform inscriptions. Even then the Sumerians realized that proper organization and access to the archives was critical for efficient use of information. They developed special classifications to identify every tablet and its content. (See http://www.libraries.gr for a wonderful historical perspective on modern libraries.) The need to store and retrieve written information became increasingly important over centuries, especially with inventions like paper and the printing press. Soon after computers were invented, people realized that they could be used for storing and mechanically retrieving large amounts of information. In 1945 Vannevar Bush published a ground breaking article titled “As We May Think” that gave birth to the idea of automatic access to large amounts of stored knowledge.
    [Show full text]
  • Google's Worldwidewatch Over the Worldwideweb
    Google’s WorldWideWatch over the WorldWideWeb Charting Google’s Internet Empire & Data Hegemony Google’s Data Dominance is Vast, Purposeful, Lasting & Harmful By Scott Cleland* President, Precursor LLC** [email protected] Publisher, www.GoogleMonitor.com & www.Googleopoly.net Author, Search & Destroy: Why You Can’t Trust Google Inc. www.SearchAndDestroyBook.com September 2014 * The views expressed in this presentation are the author’s; see Scott Cleland’s full biography at: www.ScottCleland.com **Precursor LLC serves Fortune 500 clients, some of which are Google competitors. September 2014 Scott Cleland -- Precursor LLC 1 Outline • Executive Summary • Introduction • Google’s Data Dominance is: – Vast – Purposeful – Lasting – Harmful • Recommendations Appendices September 2014 Scott Cleland -- Precursor LLC 2 EXECUTIVE SUMMARY September 2014 Scott Cleland -- Precursor LLC 3 Executive Summary Of Google’s WorldWideWatch Google’s Internet Empire & Data Hegemony/Dominance Google’s de facto WorldWideWatch. • Sir Tim Berners-Lee invented the WorldWideWeb, a public and decentralized system to enable universal access to information online; Google’s Larry Page has invented, and is perfecting, Google’s de facto WorldWideWatch, a privately-controlled and hyper- centralized universal system to enable universal accessibility to information Google determines is “useful.” • Google’s unique WorldWideWatch surveillance and data collection capabilities have created an unrivaled Internet empire and data hegemony, because Google’s data dominance is demonstrably vast, purposeful, and lasting. Google’s Vast Internet Empire is Unique (and on path to corner most of the global data economy). • Over half of all daily Internet traffic involves Google in some way, and Google Analytics tracks 98% of top ~15 million websites • Google controls 5 of the top 6, billion-user, universal web platforms: search, video, mobile, maps, and browser.
    [Show full text]