ACID Transac ons at the PB Scale with MarkLogic Server A talk by Nuno Job, Welcome to Berlin Buzzwords 2011!
PB Scalable Transactions @dscape | #bbuzz portugal, new york, toronto, san francisco, london! 83! 08! 09! 10! 11!
past.! H E L L O my name is
present.! stuff I like! Nuno @dscape foreseeable future.!
the idea !
search! engines!
Structure ims! rdbms! idms! dinosaurs ! are ! Pre-defined Ad-hoc fun!! (o0)—’,--! Pre-defined Ad-hoc! ! Queries
modern database! relational! search ! NoSQL! ancestors! bloom! engine! 60’s! 80’s! 00’s! timeline! 90’s!
PB Scalable Transactions @dscape | #bbuzz a database for unstructured information
unstructured! also stores:! schema-less*! c++ core! text and binaries! easy evolution.! ~ pb scale! xml or json.! features! acid, backups! replication, query ! native search! language (xquery).! a database built! on a search engine?!
stop shredding your data! no tables, rows, columns! !!!start storing data as is! thinkin’ documents! uris? looks like a filesystem! * they have this universal index thing.! an inverted index that is structure aware! PB Scalable Transactions @dscape | #bbuzz application server
single tier:! XQuery: ! - no boundaries ! dynamic, functional! between languages!
programming language! - smaller stack! - king is dead!! long live the king!! features:! ! stop exposing your database! - easy geospatial! !start exposing your data! - http client! !! - facets! - alerting! - store applications! apps! in the database! marklogic! - url rewriting! api! ! apps!
other dbs! github.com/dscape/rewrite! apps! ( for rails like routing, session later on )! REST! PB Scalable Transactions @dscape | #bbuzz In MarkLogic we were thinkin’
thinkin’ documents.! ✓ Unstructured Informa on flexible! json or xml?! ✓ Mul ple TBs to PB scale ! big!
✓ Sub-second response mes fast! ever wonder what! that lotus flower! ✓ Data immediately durable realtime! video-clip is all ! ✓ about?! ! Mix of complex database queries, aler ng, full text search, transforma ons, love to talk ! about this! geospa al, and real me analy cs.
unstructured?
To be great, be whole; ! blank verse! Exclude nothing, ! line! exaggerate nothing that is not you. ! Be whole in everything. ! Put all you are ! Into the smallest thing you do. ! So, in each lake, the moon shines ! Because it blooms up above.! buttons! ! thread! Ricardo Reis, Odes! Wool! author! silk! title! poem! unstructured! relational! closet! closet! universal index universal index:! slides:! an inverted index that understands http://www.slideshare.net/cbiow/ structure, organization, and security! mark-logic-strangeloop-2010!
“berlin” 123, 126, 130, 152, … “buzzwords” 122, 125, 126, 130, … “fast” 123, 126, 130, 142, … “nosql” 123, 130, 131, 135, … Document “hadoop” 125, 131, 167, 212, … References