DOCSLIB.ORG

Data Science Resources

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Data Science Resources PAWEL CISLO M S C D A T A S C I E N T I S T Data Science Resources P A W E L C I S L O . C O M FOREWORD First of all, I would like to extremely thank you for deciding to be one of my newsletter subscribers. I will try to be quick right there, as this e-book will consist of a lot of resources stored alphabetically (tutorials, links, tools and datasets) that I definitely recommend to check out in your free time. All of the links you are about to see have been collected on my long internet journey (since 2016). Without a doubt, there are tons of other sites to visit; however, I considered these to be the one that stood out to me (I wish to knew them when I was starting). As I browse the web, I might add more links to this e-book. You can find the most up to date book on the book address given in your e-mail. Enjoy! P A W E L C I S L O . C O M TUTORIALS Side Note: If you are looking for any other tutorials, I recommend to use the browser of all the online courses (courseroot.com); however, you will usually be redirected to Udemy, Coursera and edX. Moreover, on my website, I will try to post my own notes from the courses that I have completed. • 39 Machine Learning Resources that will help you in every essential step • A Data Science Framework: To Achieve 99% Accuracy <--- very good tutorial for beginners in Python • Another Book on Data Science <--- learn R & Python in parallel • A short & practical HOW-TO guide to scrape data from a website using Python • Awesome Learn Datascience <--- list of tutorials & resources for beginners • AWS Machine Learning Course <--- free (30 lessons, 45 hours) • D3 Graph Theory <--- learn graph theory visually • Data Science Essentials (edX) <--- one of the courses I have finished • Deep Learning for Self-Driving Cars (MIT 6.S094) • Deep Learning Ocean <--- kick-starter into deep learning • Deep Learning World (repo) <--- resources for Deep Learning Researchers and Developers • Easy-TensorFlow <--- comprehensive tutorials • Guide to deep learning • Immersive Linear Algebra <--- world's first linear algebra book with fully interactive figures • Kaggle Learn <--- set of courses to go through • Lecture Collection | Convolutional Neural Networks for Visual Recognition (Spring 2017) <--- very good - YouTube based, recommended by "About Data - Krzysztof Sopyła" • Learn Data Science • Learn Machine Learning in 3 Months <--- list of resources by Siraj Raval P A W E L C I S L O . C O M • Machine Learning & Deep Learning Tutorials • Machine Learning Crash Course <--- by Google for free. After continue with paid TensorFlow course • Machine Learning Course by Andrew Ng <--- mostly recommended course by Stanford University, which I finished as well • Machine Learning Course with Python (repo) • Machine Learning Crash Course (HN) <--- with TensorFlow APIs (by Google) • Machine Learning for Everyone <--- explained in simple words • Machine Learning Guides <--- by Google • Machine Learning with Python <--- small scale machine learning projects • March 2019 Machine Learning Study Path <--- complete ML study path • Microsoft Professional Program for Big Data • MIT Deep Learning <--- MIT Deep Learning related courses • mlcourse.ai <--- open Machine Learning course, both in English and Russian • MVA - Introduction to Data Science • Notes from Coursera Deep Learning courses by Andrew • Pandas Cookbook <--- online e-book (534 pages) • PracticalAI <--- practical approach to learning machine learning • Principles and Techniques of Data Science <--- online book • Production Data Science (Reddit) <--- bridge the gap between exploration in data science and productionisation in software development • Project Based Learning <--- curated list of project-based tutorials • Python Data Science Handbook • PyTorch Tutorial • Quantee Tutorial <--- Data Science tutorial by Dawid Kopczyk • R and Python <--- how to integrate both into your workflow • Seeing Theory <--- visualization of data • Spinning Up <--- learn deep reinforcement learning • Stawiamy własny serwer <--- do programowania w R i Pythonie • TensorFlow Course <--- Simple and ready-to-use tutorials for TensorFlow • The most comprehensive Data Science learning plan for 2017 • The neural network zoo <--- explanation of all the neural architectures • The Open Source Data Science Masters P A W E L C I S L O . C O M LINKS Side Note: Here you can find links to interesting articles and things that did not fit into any other category. • 5 Career Paths in Big Data and Data Science, Explained • 7 myths in machine learning research • 8 ways to perform simple linear regression and measure their speed using Python • 10+2 Data Science Methods that Every Data Scientist Should Know in 2016 • 10 must-know algorithms and data structures for a software engineer • 11 most read Deep Learning Articles from Analytics Vidhya in 2017 • 12 essential command line tools for data scientists • 16 Useful Advices for Aspiring Data Scientists • 20 Big Data Repositories You Should Check Out • 21 Must-Know Data Science Interview Questions and Answers • 100 Days of ML Coding <--- great respository with lots of ML terms • A Concise Handbook of TensorFlow <--- well-explanatory PDF • AI & Architecture <--- use of AI to generate floor designs and their styles • Algorithm_Interview_Notes <--- in Chinese • All the best big data tools and how to use them • Amazon Mechanical Turk <--- access a global, on-demand, 24x7 workforce • Artificial Neural Networks Explained • As a data scientist, what tips would you have for a younger version of yourself? • Awesome (better graphical form) ○ Awesome AI ○ Awesome Big Data ○ Awesome Computer Vision ○ Awesome Data Science ○ Awesome Data Science Interview Questions ○ Awesome Deep Learning ○ Awesome Deep Vision P A W E L C I S L O . C O M ○ Awesome Information Retrieval ○ Awesome Machine Learning ○ Awesome Pytorch List ○ Awesome Speech and NLP • Awful AI <--- curated list to track current scary usages of AI • Big Data Landscape 2017 (Source) • blink-182 Song Similarity <--- style progression of a band over time • Bringing the best out of Jupyter Notebooks for Data Science • Building a Deep Neural Net In Google Sheets • Build Handwriting Recognizer & Ship It To App Store • Cheat Sheets ○ Cheat Sheets for AI, Neural Networks, Machine Learning, Deep Learning ○ Cheat Sheets for Machine Learning and Deep Learning Engineers ○ Cheat Sheets - Data Science Resources <--- R/Python/Numpy/Pandas ○ DataCamp Cheat Sheets ○ Data Science Cheatsheets <--- list of cheatsheets on GitHub ○ Data-Science--Cheat-Sheet ○ Deep Learning cheatsheets for Stanford's CS 230 ○ Machine Learning cheatsheets for Stanford's CS 229 <--- repo ○ Most general cheat sheet • Checklist for debugging neural networks • Choosing the right metric for evaluating Machine Learning models • Classification datasets results (MNIST, CIFAR, STL-10, SVHN, ILSVRC2012) • Convolutional Neural Networks <--- very good explanation • Cybercrimes Investigation and Intrusion Detection in Internet of Thing • Data Science Blogs <--- list of all blogs • Data Science Interview Guide • Data Science map • DataScienceWeekly <--- weekly newsletter • Deep Learning 500 questions <--- with anserws (Chinese) • Deep Learning Papers Reading Roadmap • DeepForge <--- modern development environment for deep learning • DeepLearn <--- implementation of research papers on Deep Learning P A W E L C I S L O . C O M • deep learning object detection <--- paper list • Deep Neural Network implemented in pure SQL over BigQuery • Descriptive Statistics • Docker for Data Science • Encoding data in dubstep songs (HN) • End-to-End Deep Learning for Self-Driving Cars • Essentials of Machine Learning Algorithms <--- (with Python & R codes) • Feature Selection algorithms <--- in Python • Generate Quick and Accurate Time Series Forecasts using Facebook’s Prophet • Genetic algorithm in machine learning • Getting Spark, Python, and Jupyter Notebook running on Amazon EC2 • Global Heatmap • Google AI Research <--- repository with code released by Google AI Research • Homemade Machine Learning <--- Python examples of popular ML algorithms • How Docker Can Help You Become A More Effective Data Scientist • How far can you travel in one hour by car? • How Much Hotter Is Your Hometown Than When You Were Born? • How to Build an End-to-End Conversational AI System using Behavior Trees • How to build your own AlphaZero AI using Python and Keras • How to Deploy Machine Learning Models: The Ultimate Guide • How to easily Detect Objects with Deep Learning on Raspberry Pi (HN) • How to extract data from MS Word Documents using Python • How to Develop a Word-Level Neural Language Model and Use it to Generate Text • How to recognize fake AI-generated images • How to setup a data science blog • How to solve 90% of NLP problems <--- step-by-step guide • How to train Keras model x20 times faster with TPU for free • How you can train an AI to convert your design mockups into HTML and CSS (HN) • Illustrated Word2vec • Inside - AI <--- subscribe to daily news about AI • Interactive Machine Learning List (Repository) <--- I have also contributed ;) • Introduction to Matplotlib <--- good summary of my Udemy notes • Introduction to NumPy and Pandas <--- simple tutorial • Japanese scientists just used AI to read minds and it's amazing • Kaggle <--- home of data science & machine learning • Kaggle’s State of Data Science & Machine Learning Report, 2017 (conclusions) • Kto wygra finał mistrzostw świata w piłce nożnej 2018? <--- good tutorial of cleaning and merging two datasets by Mateusz Grzyb P A
Load more

Recommended publications
  • 2020 Vision: Info Pro Skills for a New Decade
    2020 Vision: Info Pro Skills for a New Decade Search Skills for Today’s Info Pros and Thriving in the New Information Landscape Presented by: Mary Ellen Bates Bates Information Services BatesInfo.com Presented for: Initiative Fortbildung e.V. 9 and 10 May 2019 2020 VISION DAY 1: Search Skills for Today’s Info Pros INSIDE A SEARCHER’S MIND: BRINGING THE DETECTIVE TO THE SEARCH ..........................................1 TECHNIQUES OF A DETECTIVE ......................................................................................................................2 DIFFERENT SEARCH APPROACHES.................................................................................................................3 GETTING CREATIVE....................................................................................................................................5 WHAT’S NEW (OR AT LEAST USEFUL) WITH GOOGLE: TIPS AND TOOLS FOR TODAY’S GOOGLE .........6 GOOGLE TRICKS........................................................................................................................................6 SEARCHING THE DEEP WEB / GREY LITERATURE ................................................................................8 SEARCH STRATEGIES FOR GREY LITERATURE....................................................................................................9 SOME GREY LIT/DEEP WEB TOOLS.............................................................................................................10 GLEANING INSIGHT FROM SOCIAL MEDIA........................................................................................12
    [Show full text]
  • Ciência De Dados Na Ciência Da Informação
    Ciência da Informação v. 49 n.3 set./dez. 2020 ISSN 0100-1965 eISSN 1518-8353 Edição especial temática Special thematic issue / Edición temática especial Ciência de dados na ciência da informação Data science in Information Sience Ciencia de datos en la Ciencia de la Información Instituto Brasileiro de Informação em Ciência e Tecnologia (Ibict) Diretoria Indexação Cecília Leite Oliveira Ciência da Informação tem seus artigos indexados ou resumidos. Coordenação-Geral de Pesquisa e Desenvolvimento de Novos Produtos (CGNP) Bases Internacionais Anderson Luis Cambraia Itaborahy Directory of Open Access Journals - DOAJ. Paschal Thema: Science de L’Information, Documentation. Library and Coordenação-Geral de Pesquisa e Manutenção de Produtos Consolidados (CGPC) Information Science Abstracts. PAIS Foreign Language Bianca Amaro Index. Information Science Abstracts. Library and Literature. Páginas de Contenido: Ciências de la Información. Coordenação-Geral de Tecnologias de Informação e Informática EDUCACCION: Notícias de Educación, Ciencia y Cultura (CGTI) Tiago Emmanuel Nunes Braga Iberoamericanas. Referativnyi Zhurnal: Informatika. ISTA Information Science & Technology Abstracts. LISTA Library, Coordenação de Ensino e Pesquisa, Ciência e Tecnologia da Information Science & Technology Abstracts. SciELO Informação (COEPPE) Scientific Electronic Library On-line. Latindex – Sistema Gustavo Saldanha Regional de Información em Línea para Revistas Científicas Coordenação de Planejamento, Acompanhamento e Avaliação de América Latina el Caribe, España y Portugal, México. (COPAV) INFOBILA: Información Bibliotecológica Latinoamericana. José Luis dos Santos Nascimento Indexação em Bases de Dados Nacionais Coordenação de Administração (COADM) Reginaldo de Araújo Silva Portal de Periódicos LivRe – Portal de Periódicos de Livre Acesso. Comissão Divisão de Editoração Científica Nacional de Energia Nuclear (Cnen). Portal Periódicos Ramón Martins Sodoma da Fonseca da Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (Capes).
    [Show full text]
  • Cc5212-1 Procesamiento Masivo De Datos Otoño 2020
    CC5212-1 PROCESAMIENTO MASIVO DE DATOS OTOÑO 2020 Lecture 4.5 Projects, Practice with Pig/Hadoop Aidan Hogan [email protected] Course Marking (Revised) • 75% for Weekly Labs (~9% a lab) – 4/4 obligatory, 4/7 optional • 25% for Class Project • Need to pass in overall grade Assignments each week Hands-on each week! Working in groups Working in groups! CLASS PROJECTS Class Project • Done in threes • Goal: Use what you’ve learned to do something cool/fun (hopefully) • Process: – Form groups of three (in the forum, before April 30th) – On April 30th we will assign the rest automatically – Start thinking up topics / find interesting datasets! – Register topic (deadline around May 21st) – Work on projects during semester – Deliverables will due be around week 13 • Deliverables: 4 minute presentation (video) & short report • Marked on: Difficulty, appropriateness, scale, good use of techniques, presentation, coolness, creativity, value – Ambition is appreciated, even if you don’t succeed Desiderata for project • Must focus around some technique from the course! • Expected difficulty: similar to a lab, but without any instructions • Data not too small: – Should have >250,000 tuples/entries • Data not too large: – Should have <1,000,000,000 tuples/entries – If very large, perhaps take a sample? • In case of COVID-19 data, we can make exceptions Where to find/explore data? • Kaggle: – https://www.kaggle.com/ • Google Dataset Search: – https://datasetsearch.research.google.com/ • Datos Abiertos de Chile: – https://datos.gob.cl/ – https://es.datachile.io/ • … PRACTICE WITH HADOOP/PIG Practice with Hadoop • Optional Assignment 1 (not evaluated): – Hadoop: Find the number of good movies in which each actor/actresses has starred.
    [Show full text]
  • Dataset Search: a Lightweight, Community-Built Tool to Support Research Data Discovery
    Journal of eScience Librarianship Volume 10 Issue 1 Special Issue: Research Data and Article 3 Preservation (RDAP) Summit 2020 2021-01-19 Dataset Search: A lightweight, community-built tool to support research data discovery Sara Mannheimer Montana State University Et al. Let us know how access to this document benefits ou.y Follow this and additional works at: https://escholarship.umassmed.edu/jeslib Part of the Scholarly Communication Commons Repository Citation Mannheimer S, Clark JA, Hagerman K, Schultz J, Espeland J. Dataset Search: A lightweight, community- built tool to support research data discovery. Journal of eScience Librarianship 2021;10(1): e1189. https://doi.org/10.7191/jeslib.2021.1189. Retrieved from https://escholarship.umassmed.edu/jeslib/ vol10/iss1/3 Creative Commons License This work is licensed under a Creative Commons Attribution 4.0 License. This material is brought to you by eScholarship@UMMS. It has been accepted for inclusion in Journal of eScience Librarianship by an authorized administrator of eScholarship@UMMS. For more information, please contact [email protected]. ISSN 2161-3974 JeSLIB 2021; 10(1): e1189 https://doi.org/10.7191/jeslib.2021.1189 Full-Length Paper Dataset Search: A lightweight, community-built tool to support research data discovery Sara Mannheimer, Jason A. Clark, Kyle Hagerman, Jakob Schultz, and James Espeland Montana State University, Bozeman, MT, USA Abstract Objective: Promoting discovery of research data helps archived data realize its potential to advance knowledge. Montana
    [Show full text]
  • Talks & Abstracts
    TALKS & ABSTRACTS MONDAY, MAY 13 Welcome & Opening Remarks: Keith Webster, Dean, Carnegie Mellon University Libraries Michael McQuade, Vice President for Research, Carnegie Mellon University Beth A. Plale, Science Advisor, CISE/OAC, National Science Foundation Keynote 1: Tom Mitchell, Interim Dean, E. Fredkin University Professor, School of Computer Science, Carnegie Mellon University Title: Discovery from Brain Image Data Abstract: How does the human brain use neural activity to create and represent meanings of words, phrases, sentences and stories? One way to study this question is to collect brain image data to observe neural activity while people read text. We have been doing such experiments with fMRI (1 mm spatial resolution) and MEG (1 msec time resolution) brain imaging, and developing novel machine learning approaches to analyze this data. As a result, we have learned answers to questions such as "Are the neural encodings of word meaning the same in your brain and mine?", and "What sequence of neurally encoded information flows through the brain during the half-second in which the brain comprehends a word?" This talk will summarize our machine learning approach to data discovery, and some of what we have learned about the human brain as a result. We will also consider the question of how reuse and aggregation of such scientific data might change the future of research in cognitive neuroscience. Session 1: Automation in data curation and metadata generation Session Chair: Paola Buitrago, Director for AI and Big Data, Pittsburgh Supercomputing Center 1.1 Keyphrase extraction from scholarly documents for data discovery and reuse Cornelia Caragea and C.
    [Show full text]
  • Search, Reuse and Sharing of Research Data in Materials Science and Engineering—A Qualitative Interview Study
    PLOS ONE RESEARCH ARTICLE Search, reuse and sharing of research data in materials science and engineeringÐA qualitative interview study Bettina SuhrID*, Johanna Dungl, Alexander StockerID Virtual Vehicle Research GmbH, Graz, Austria * [email protected] a1111111111 a1111111111 a1111111111 Abstract a1111111111 a1111111111 Open research data practices are a relatively new, thus still evolving part of scientific work, and their usage varies strongly within different scientific domains. In the literature, the inves- tigation of open research data practices covers the whole range of big empirical studies covering multiple scientific domains to smaller, in depth studies analysing a single field of OPEN ACCESS research. Despite the richness of literature on this topic, there is still a lack of knowledge on Citation: Suhr B, Dungl J, Stocker A (2020) the (open) research data awareness and practices in materials science and engineering. Search, reuse and sharing of research data in While most current studies focus only on some aspects of open research data practices, we materials science and engineeringÐA qualitative aim for a comprehensive understanding of all practices with respect to the considered scien- interview study. PLoS ONE 15(9): e0239216. https://doi.org/10.1371/journal.pone.0239216 tific domain. Hence this study aims at 1) drawing the whole picture of search, reuse and sharing of research data 2) while focusing on materials science and engineering. The cho- Editor: Marco Lepidi, University of Genova, ITALY sen approach allows to explore the connections between different aspects of open research Received: February 27, 2020 data practices, e.g. between data sharing and data search. In depth interviews with 13 Accepted: September 1, 2020 researchers in this field were conducted, transcribed verbatim, coded and analysed using Published: September 15, 2020 content analysis.
    [Show full text]
  • A Day Without a Search Engine: an Experimental Study of Online and Offline Searches∗
    A Day without a Search Engine: An Experimental Study of Online and Offline Searches∗ Yan Chen Grace YoungJoo Jeon Yong-Mi Kim March 6, 2013 Abstract With the advent of the Web and search engines, online searching has become a common method for obtaining information. Given this popularity, the question arises as to how much time people save by using search engines for their information needs, and the extent to which online search affects search experiences and outcomes. Using a random sample of queries from a major search engine and a sample of reference questions from the Internet Public Library (IPL), we conduct a real-effort experiment to compare online and offline search experiences and outcomes. We find that participants are significantly more likely to find an answer on the Web, compared to offline searching. Restricting to the set of questions in which participants find answers in both treatments, a Web search takes on average 7 (9) minutes, whereas the corresponding offline search takes 22 (19) minutes for a search-engine (IPL) question. While library sources are judged to be significantly more trustworthy and authoritative than the corresponding Web sources, Web sources are judged to be significantly more relevant. Balancing all factors, the overall source quality is not significantly different between the two treatments for search-engine questions. However, for IPL questions, non-Web sources are judged to have significantly higher overall quality than the corresponding Web sources. Lastly, post-search questionnaires reveal that participants find online searching more enjoyable than offline searching. Keywords: search, productivity, experiment JEL Classification: C93, H41 ∗We would like to thank David Campbell, Jacob Goeree, Jeffrey MacKie-Mason, Karen Markey, Betsy Masiello, Soo Young Rieh and Hal Varian for helpful discussions, Donna Hayward and her colleagues at the University of Michi- gan Hatcher Graduate Library for facilitating the non-Web treatment, Ashlee Stratakis and Dan Stuart for excellent research assistance.
    [Show full text]
  • U.S. Government Publishing Office Style Manual
    Style Manual An official guide to the form and style of Federal Government publishing | 2016 Keeping America Informed | OFFICIAL | DIGITAL | SECURE [email protected] Production and Distribution Notes This publication was typeset electronically using Helvetica and Minion Pro typefaces. It was printed using vegetable oil-based ink on recycled paper containing 30% post consumer waste. The GPO Style Manual will be distributed to libraries in the Federal Depository Library Program. To find a depository library near you, please go to the Federal depository library directory at http://catalog.gpo.gov/fdlpdir/public.jsp. The electronic text of this publication is available for public use free of charge at https://www.govinfo.gov/gpo-style-manual. Library of Congress Cataloging-in-Publication Data Names: United States. Government Publishing Office, author. Title: Style manual : an official guide to the form and style of federal government publications / U.S. Government Publishing Office. Other titles: Official guide to the form and style of federal government publications | Also known as: GPO style manual Description: 2016; official U.S. Government edition. | Washington, DC : U.S. Government Publishing Office, 2016. | Includes index. Identifiers: LCCN 2016055634| ISBN 9780160936029 (cloth) | ISBN 0160936020 (cloth) | ISBN 9780160936012 (paper) | ISBN 0160936012 (paper) Subjects: LCSH: Printing—United States—Style manuals. | Printing, Public—United States—Handbooks, manuals, etc. | Publishers and publishing—United States—Handbooks, manuals, etc. | Authorship—Style manuals. | Editing—Handbooks, manuals, etc. Classification: LCC Z253 .U58 2016 | DDC 808/.02—dc23 | SUDOC GP 1.23/4:ST 9/2016 LC record available at https://lccn.loc.gov/2016055634 Use of ISBN Prefix This is the official U.S.
    [Show full text]
  • JLEP-Issue-9.2.Pdf
    JOURNAL OF LAW , ECONOMICS & POLICY VOLUME 9 WINTER 2013 NUMBER 2 EDITORIAL BOARD 2012-2013 Adam Park Editor-in-Chief Nathaniel Harris Morgan Shields Benjamin Charlton Executive Editor Publications Editor Managing Editor Genevieve Miller Carolyn Head Jennifer Johnston Senior Articles Editor Senior Notes Editor Senior Research Editor Peter Anderson Emily Barber David Brodian Kylie Caporuscio Juan Kassar Jason Malashevich Anthony Kanakis Mark Stevens Tom Randall Articles Editors Notes Editors Research Editors Anthony Kanakis Tom Randall Articles Submissions Editor Technology Editor Mark Weiss Jacob Merrill Associate Articles Outreach Editor Submissions Editor MEMBERS Michael Brody Louise Martin Robert Strange Hollie Kapos Elizabeth Newell Lauren Wynns Adam Schneider CANDIDATE MEMBERS Josh Branson Kevin Hill Ian Rothfuss Marie Keiko Breyan Ryan Leavitt Maxwell Slackman Victoria Clarke Sarah Mernin Kyra Smerkanich Brady Cummins Mariam Noori Jonathan Stapor David Dubin Catherine Oryl Charles Thresher Steven Dunn Erica Peterson Allison Walsh Meagan Dziura Michael Rogers Preston Wise Kelly Fryberger Crystal Yi i 1 JOURNAL OF LAW , ECONOMICS & POLICY VOLUME 9 WINTER 2013 NUMBER 2 BOARD OF ADVISORS Lisa E. Bernstein Francesco Parisi James M. Buchanan Eric Posner Judge Guido Calabresi Judge Richard A. Posner Lloyd R. Cohen Roberta Romano Robert D. Cooter Hans-Bernd Schäfer Robert C. Ellickson Steven M. Shavell Richard A. Epstein Henry E. Smith Judge Douglas H. Ginsburg Vernon L. Smith Mark F. Grady Gordon Tullock Bruce H. Kobayashi Thomas S. Ulen Henry G. Manne W. Kip Viscusi A. Douglas Melamed Todd J. Zywicki ii JOURNAL OF LAW , ECONOMICS & POLICY VOLUME 9 WINTER 2013 NUMBER 2 CONTENTS ARTICLES 169 ANTITRUST FOR HIGH-TECH AND LOW:REGULATION,INNOVATION, AND RISK Ronald A.
    [Show full text]
  • Sustainability of (Open) Data Portal Infrastructures a Distributed Version Control Approach to Creating Portals for Reuse
    Sustainability of (Open) Data Portal Infrastructures A Distributed Version Control Approach to Creating Portals for Reuse This study has been prepared by the University of Southampton as part of the European Data Portal. The European Data Portal is an initiative of the European Commission, implemented with the support of a consortium led by Capgemini Invent, including Intrasoft International, Fraunhofer Fokus, con.terra, Sogeti, 52North, Time.Lex, the Lisbon Council, and the University of Southampton. The Publications Office of the European Union is responsible for contract management of the European Data Portal. For more information about this paper, please contact: European Commission Directorate General for Communications Networks, Content and Technology Unit G.1 Data Policy and Innovation Daniele Rizzi – Policy Officer Email: [email protected] European Data Portal Gianfranco Cecconi, European Data Portal Lead Esther Huyer Email: [email protected] Email: [email protected] Written and reviewed by: Luis-Daniel Ibáñez Johanna Walker Email: [email protected] Email: [email protected] Mike Hoffman Elena Simperl Email: [email protected] Email: [email protected] Last update: 02.03.2020 www: https://europeandataportal.eu/ @: [email protected] DISCLAIMER By the European Commission, Directorate-General of Communications Networks, Content and Technology. The information and views set out in this publication are those of the author(s) and do not necessarily reflect the official opinion of the Commission. The Commission does not guarantee the accuracy of the data included in this study. Neither the Commission nor any person acting on the Commission’s behalf may be held responsible for the use, which may be made of the information contained therein.
    [Show full text]
  • A Study on the Veracity of Semantic Markup for Dataset Pages
    Dataset or Not? A study on the veracity of semantic markup for dataset pages Tarfah Alrashed1, Dimitris Paparas2, Omar Benjelloun2, Ying Sheng2, and Natasha Noy2 1 CSAIL, MIT, USA [email protected] 2 Google Research, Google, USA fdpaparas, benjello, yingsheng, [email protected] Abstract. Semantic markup, such as Schema.org, allows providers on the Web to describe content using a shared controlled vocabulary. This markup is invaluable in enabling a broad range of applications, from vertical search engines, to rich snippets in search results, to actions on emails, to many others. In this paper, we focus on semantic markup for datasets, specifically in the context of developing a vertical search engine for datasets on the Web, Google's Dataset Search. Dataset Search relies on Schema.org to identify pages that describe datasets. While Schema.org was the core enabling technology for this vertical search, we also discovered that we need to address the following problem: pages from 61% of internet hosts that provide Schema.org/Dataset markup do not actually describe datasets. We analyze the veracity of dataset markup for Dataset Search's Web-scale corpus and categorize pages where this markup is not reliable. We then propose a way to drastically increase the quality of the dataset metadata corpus by developing a deep neural-network classifier that identifies whether or not a page with Schema.org/Dataset markup is a dataset page. Our classifier achieves 96.7% recall at the 95% precision point. This level of precision enables Dataset Search to circumvent the noise in semantic markup and to use the metadata to provide high quality results to users.
    [Show full text]
  • Automl: a Survey of the State-Of-The-Art
    AutoML: A Survey of the State-of-the-Art Xin He, Kaiyong Zhao, Xiaowen Chu∗ Department of Computer Science, Hong Kong Baptist University Abstract Deep learning (DL) techniques have obtained remarkable achievements on various tasks, such as image recognition, object detection, and language modeling. However, building a high-quality DL system for a specific task highly relies on human expertise, hindering its wide application. Meanwhile, automated machine learning (AutoML) is a promising solution for building a DL system without human assistance and is being extensively studied. This paper presents a comprehensive and up-to-date review of the state-of-the-art (SOTA) in AutoML. According to the DL pipeline, we introduce AutoML methods {{ covering data preparation, feature engineering, hyperparameter optimization, and neural architecture search (NAS) {{ with a particular focus on NAS, as it is currently a hot sub-topic of AutoML. We summarize the representative NAS algorithms' performance on the CIFAR-10 and ImageNet datasets and further discuss the following subjects of NAS methods: one/two-stage NAS, one-shot NAS, joint hyperparameter and architecture optimization, and resource-aware NAS. Finally, we discuss some open problems related to the existing AutoML methods for future research. Keywords: deep learning, automated machine learning (AutoML), neural architecture search (NAS), hyperparameter optimization (HPO) 1. Introduction can be understood to involve the automated construction of an ML pipeline on the limited computational budget. In recent years, deep learning has been applied in vari- With the exponential growth of computing power, AutoML ous fields and used to solve many challenging AI tasks, in has become a hot topic in both industry and academia.
    [Show full text]