Graph Databases
Total Page:16
File Type:pdf, Size:1020Kb
Learning Neo4j Run blazingly fast queries on complex graph datasets with the power of the Neo4j graph database Rik Van Bruggen BIRMINGHAM - MUMBAI Learning Neo4j Copyright © 2014 Packt Publishing All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews. Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book. Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information. First published: August 2014 Production reference: 1190814 Published by Packt Publishing Ltd. Livery Place 35 Livery Street Birmingham B3 2PB, UK. ISBN 978-1-84951-716-4 www.packtpub.com Cover image by Pratyush Mohanta ([email protected]) Credits Author Project Coordinator Rik Van Bruggen Mary Alex Reviewers Proofreaders Jussi Heinonen Simran Bhogal Michael Hunger Maria Gould Andreas Kolleger Ameesha Green Max De Marzi Paul Hindle Mark Needham Indexers Yavor Stoychev Hemangini Bari Ron Van Weverwijk Tejal Soni Acquisition Editor Priya Subramani Nikhil Karkal Graphics Content Development Editor Sheetal Aute Poonam Jain Ronak Dhruv Valentina D'silva Technical Editors Tanvi Bhatt Disha Haria Akash Rajiv Sharma Abhinash Sahu Faisal Siddiqui Production Coordinator Aman Preet Singh Komal Ramchandani Copy Editors Cover Work Roshni Banerjee Komal Ramchandani Sayanee Mukherjee Aditya Nair Deepa Nambiar About the Author Rik Van Bruggen is the regional territory manager for Neo Technology for Benelux, UK, and the Nordic region. He has been working for startup companies for most of his career, including eCom Interactive Expertise, SilverStream Software, Imprivata, and Courion. While he has an interest in technology, his real passion is business and how to make technology work for a business. He lives in Antwerp, Belgium, with his wife and three lovely kids, and enjoys technology, orienteering, jogging, and Belgian beer. This book and all of the work that went on around it would not have been possible without the unconditional support of my wife, Katleen, and our three lovely kids, Mit, Toon, and Cas. Thank you! About the Reviewers Michael Hunger has been passionate about software development for a long time. He is particularly interested in the people who develop software, software craftsmanship, programming languages, and improving code. For the past few years, he has been working with Neo Technology on the Neo4j graph database. As the project lead of Spring Data Neo4j, he helped develop the idea to make it a convenient and complete solution for object graph mapping. He now takes care of all the aspects of the Neo4j developer community. Good relationships are everywhere in Michael's life. His life revolves around his family and children, running his coffee shop and co-working space, having fun in the depths of a text-based, multiuser dungeon, tinkering with and without Lego, and much more. As a developer, he loves to work with many aspects of programming languages—learning new things every day, participating in exciting and ambitious open source projects, and contributing and writing software-related books and articles. He is also an active speaker at conferences and events, and a longtime editor at InfoQ. He is one of the important contributors to the expert book, 97 Things Every Programmer Should Know by Kevin Henney, O'Reilly. He has co-authored Spring Data, by Mark Pollack, Oliver Gierke, Thomas Risberg, and Jon Brisbin, O'Reilly and has also reviewed the following books: • NoSQL Distilled, Pramod J. Sadalage and Martin Fowler, Pearson • Domain-Specific Languages Patterns, Martin Fowler and Rebecca Parsons, Pearson • Pragmatic Guide to Git, Travis Swicegood, The Pragmatic Bookshelf • Art of Readable Code, Dustin Boswell and Trevor Foucher, O'Reilly • Apprenticeship Patterns, David H. Hoover and Adewale Oshineye, O'Reilly I want to thank the four wonderful women in my life who make me happy every day and let me achieve many things. Ron Van Weverwijk is an experienced software developer at GoDataDriven in Netherlands. He has years of experience developing both backend and frontend applications. For the last few years, he has been building applications to explore and visualize complex network data using Neo4j. He is an expert Neo4j developer and community member. He has given several Neo4j trainings, and has spoken about Neo4j at a number of recent conferences. www.PacktPub.com Support files, eBooks, discount offers and more You might want to visit www.PacktPub.com for support files and downloads related to your book. Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.PacktPub.com and as a print book customer, you are entitled to a discount on the eBook copy. Get in touch with us at [email protected] for more details. At www.PacktPub.com, you can also read a collection of free technical articles, sign up for a range of free newsletters and receive exclusive discounts and offers on Packt books and eBooks. TM http://PacktLib.PacktPub.com Do you need instant solutions to your IT questions? PacktLib is Packt's online digital book library. Here, you can access, read and search across Packt's entire library of books. Why Subscribe? • Fully searchable across every book published by Packt • Copy and paste, print and bookmark content • On demand and accessible via web browser Free Access for Packt account holders If you have an account with Packt at www.PacktPub.com, you can use this to access PacktLib today and view nine entirely free books. Simply use your login credentials for immediate access. "To Katleen, Mit, Toon, and Cas" –with love, Rik Table of Contents Preface 1 Chapter 1: Graphs and Graph Theory – an Introduction 7 Introduction to and history of graphs 7 Definition and usage of graph theory 11 Social studies 13 Biological studies 14 Computer science 15 Flow problems 16 Route problems 17 Web search 18 Test questions 19 Summary 20 Chapter 2: Graph Databases – Overview 21 Background 21 Navigational databases 23 Relational databases 25 NoSQL databases 28 Key-Value stores 29 Column-Family stores 30 Document stores 31 Graph databases 32 The Property Graph model of graph databases 34 Node labels 36 Relationship types 36 Why (or why not) graph databases 37 Why use a graph database? 37 Complex queries 37 In-the-clickstream queries on live data 39 Path finding queries 39 Table of Contents Why not use a graph database, and what to use instead 40 Large, set-oriented queries 40 Graph global operations 40 Simple, aggregate-oriented queries 41 Test questions 41 Summary 42 Chapter 3: Getting Started with Neo4j 43 Neo4j – key concepts and characteristics 43 Built for graphs, from the ground up 44 Transactional, ACID-compliant database 44 Made for Online Transaction Processing 46 Designed for scalability 48 A declarative query language – Cypher 49 Sweet spot use cases of Neo4j 50 Complex, join-intensive queries 51 Path finding queries 51 Committed to open source 52 The features 53 The support 53 The license conditions 54 Installing Neo4j 56 Installing Neo4j on Windows 56 Installing Neo4j on Mac or Linux 62 Using Neo4j in a cloud environment 65 Test Questions 71 Summary 71 Chapter 4: Modeling Data for Neo4j 73 The four fundamental data constructs 73 How to start modeling for graph databases 75 What we know – ER diagrams and relational schemas 75 Introducing complexity through join tables 77 A graph model – a simple, high-fidelity model of reality 78 Graph modeling – best practices and pitfalls 79 Graph modeling best practices 79 Design for query-ability 80 Align relationships with use cases 80 Look for n-ary relationships 81 Granulate nodes 82 Use in-graph indexes when appropriate 84 Graph database modeling pitfalls 86 Using "rich" properties 86 Node representing multiple concepts 87 [ ii ] Table of Contents Unconnected graphs 88 The dense node pattern 88 Test questions 89 Summary 90 Chapter 5: Importing Data into Neo4j 91 Alternative approaches to importing data into Neo4j 92 Know your import problem – choose your tooling 93 Importing small(ish) datasets 96 Importing data using spreadsheets 96 Importing using Neo4j-shell-tools 100 Importing using Load CSV 103 Scaling the import 107 Questions and answers 110 Summary 111 Chapter 6: Use Case Example – Recommendations 113 Recommender systems dissected 113 Using a graph model for recommendations 115 Specific query examples for recommendations 117 Recommendations based on product purchases 118 Recommendations based on brand loyalty 119 Recommendations based on social ties 120 Bringing it all together – compound recommendations 121 Business variations on recommendations 122 Fraud detection systems 123 Access control systems 124 Social networking systems 125 Questions and answers 126 Summary 126 Chapter 7: Use Case Example – Impact Analysis and Simulation 127 Impact analysis systems dissected 128 Impact analysis in