ALISE 2012 Dallas, January 19, 2012 Cristina Pattuelli School of Information and Library Science Pratt Institute, New York, NY, USA linking networks of people Experimenting with the application of Linked Open Data (LOD) technology to digital archives of jazz history. Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/ Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. hp://lod-cloud.net/ project goals 1. To help identify and give legibility to the network of relationships among the jazz artists described in primary sources. 2. To expose archival data to the web in the form of LOD that would facilitate discovery and increase visibility of archival content beyond the boundaries of institutional repositories. “A Great Day in Harlem” Red Allen, Buster Bailey, Count Basie, Emme@ Berry, Art Blakey, Lawrence Brown, Scoville Browne, Buck Clayton, Bill Crump, Vic Dickenson, Roy Eldridge, Art Farmer, Bud Freeman, Dizzy Gillespie, Tyree Glenn, Benny Golson, Sonny Greer, Johnny Griffin, Gigi Gryce, Coleman Hawkins, J.C. Heard, Jay C. Higginbotham, Milt Hinton, Chubby Jackson, Hilton Jefferson, Osie Johnson, Hank Jones, Jo Jones, Jimmy Jones, Ta Jordan, Max Kaminsky, Gene Krupa, Eddie Locke, Marian McPartland, Charles Mingus, Miff Mole, Thelonious Monk, Gerry Mulligan, Oscar Peford, Rudy Powell, Luckey Roberts, Sonny Rollins, Jimmy Rushing, Pee Wee Russell, Sahib Shihab, Horace Silver, Zuy Singleton, Stuff Smith, Rex Stewart, Maxine Sullivan, Joe Thomas, Wilbur Ware, Dickie Wells, George We@ling, Ernie Wilkins, Mary Lou Williams, Lester Young “A Great Day in Harlem” Red Allen, Buster Bailey, Count Basie, Emme@ Berry, Art Blakey, Lawrence Brown, Scoville Browne, Buck Clayton, Bill Crump, Vic Dickenson, Roy Eldridge, Art Farmer, Bud Freeman, Dizzy Gillespie, Tyree Glenn, Benny Golson, Sonny Greer, Johnny Griffin, Gigi Gryce, Coleman Hawkins, J.C. Heard, Jay C. Higginbotham, Milt Hinton, Chubby Jackson, Hilton Jefferson, Osie Johnson, Hank Jones, Jo Jones, Jimmy Jones, Ta Jordan, Max Kaminsky, Gene Krupa, Eddie Locke, Marian McPartland, Charles Mingus, Miff Mole, Thelonious Monk, Gerry Mulligan, Oscar Peford, Rudy Powell, Luckey Roberts, Sonny Rollins, Jimmy Rushing, Pee Wee Russell, Sahib Shihab, Horace Silver, Zuy Singleton, Stuff Smith, Rex Stewart, Maxine Sullivan, Joe Thomas, Wilbur Ware, Dickie Wells, George We@ling, Ernie Wilkins, Mary Lou Williams, Lester Young h"p://dbpedia.org/resource/Marian_McPartland h"p://dbpedia.org/resource/Thelonious_Monk h"p://dbpedia.org/resource/Mary_Lou_Williams How many people does this artist know? Is this artist connected to another specific artist? What type of relationship do these artists have? methodology Create a dataset of RDF triples representing jazz artists and their connections that can be queried and visualized. Sample: 12 transcripts of taped interviews with jazz musicians. FOAF in the archive Friend of A Friend (FOAF) ontology applied to represent relationships among people from the past • Core FOAF vocabulary (foaf:knows) • Extension of FOAF methods – Create a directory of names. – Find matches between names from the directory and the transcripts. – Record the relationship between the interview subject and the resulting match in the format of an RDF triple. Background Seman_c Web project Knowledge base Conclusions Linked Data cloud 31/03/2008 name directory DBpedia INTERVIEW TRANSCRIPT Ms. Williams: So with me when I went in this place I had Oscar Pettiford, Kenny Clarke on drums, Kenny Durham on trumpet, and Kai Winding on trombone. SPARQL • Inconsistencies within QUERIES DBpedia • Refinement as an ongoing NAMED ENTITY RECOGNITION SCRIPT JAZZ DIRECTORY <http://dbpedia.org/resource/Herbie_Hancock> process <http://dbpedia.org/property/label> "Herbie Hancock". <http://dbpedia.org/resource/Thelonious_Monk> INTERVIEW TRANSCRIPT <http://xmlns.com/foaf/0.1/name> "Thelonious Monk" . • 11,066 triples describing Ms. Williams: So with me when I went in this <http://dbpedia.org/resource/Coleman_Hawkins> place I had Oscar Pettiford, Kenny Clarke on <http://xmlns.com/foaf/0.1/name> "Coleman Hawkins" . drums, Kenny Durham on trumpet, and Kai <http://dbpedia.org/resource/Oscar_Pettiford> <http:// 6,444 individualsWinding on trombone. dbpedia.org/property/label> "Oscar Pettiford". <http://dbpedia.org/resource/Miles_Davis>!"#$%& #'()<http://%" xmlns.com/foaf/0.1/name> “Miles !"#Davis”$%&&'''()*$+),-(./ 0&/.+1.2/! 3+&4-/567.268,99,-:1;< !"#$%&&=:9>1(3.:&?.-?&@(A&B>.'1;<*+,-.//01-20345678/ 7296:7;2/<9;47=>2?@670A5 !"#$%&&'''()*$+),-(./0&/+1.2/3+&4-/567.268,99,-:1;< !"#$%&&=:9>1(3.:&?.-?&@(A&B>.'1;<*+,-.//01-20345678/ 7296:7;2/B2CCD=EF47G2A5 !"#$%&&'''()*$+),-(./0&/+1.2/3+&4-/567.268,99,-:1;< !"#$%&&=:9>1(3.:&?.-?&@(A&B>.'1;'*+,-.//01-20345678/ 7296:7;2/B2CCD=H:7+4IA5 ((( “No, we jammed here. Thelonious Monk—I remember once one morning I got sleepy so I said, ‘I'm going to bed.’ When the guys le@, the door was open and Monk rang the doorbell and he came inside […] I screamed. He yelled too and ran out the door and ran in to the closet and the clothes fell on him...” “…and this was the, like the biggest jazz fesJval ever. Mary Lou Williams played it and I played it and Toshiko Akiyoshi had her big band, and I mean it was a large event.” “Later on a@er I met Count Basie and Art Tatum, Buck showed me a run that Art Tatum—it was his famous run. He made it from top to boPom and Buck had taught me that run.” searching and matching DBpedia INTERVIEW TRANSCRIPT Ms. Williams: So with me when I went in this place I had Oscar Pettiford, Kenny Clarke on drums, Kenny Durham on trumpet, and Kai Winding on trombone. SPARQL QUERIES NAMED ENTITY RECOGNITION SCRIPT JAZZ DIRECTORY <http://dbpedia.org/resource/Herbie_Hancock> <http://dbpedia.org/property/label> "Herbie Hancock". <http://dbpedia.org/resource/Thelonious_Monk> INTERVIEW TRANSCRIPT <http://xmlns.com/foaf/0.1/name> "Thelonious Monk" . Ms. Williams: So with me when I went in this <http://dbpedia.org/resource/Coleman_Hawkins> place I had Oscar Pettiford, Kenny Clarke on <http://xmlns.com/foaf/0.1/name> "Coleman Hawkins" . drums, Kenny Durham on trumpet, and Kai <http://dbpedia.org/resource/Oscar_Pettiford> <http:// Winding on trombone. dbpedia.org/property/label> "Oscar Pettiford". To search for and record the instance of the names, a Python script !"#$%&#'()%" !"#$%&&'''()*$+),-(./0&/+1.2/3+&4-/567.268,99,-:1;< was wri@en that parsed the jazz directory and searched for each !"#$%&&=:9>1(3.:&?.-?&@(A&B>.'1;<*+,-.//01-20345678/ name in the transcript. 7296:7;2/<9;47=>2?@670A5 !"#$%&&'''()*$+),-(./0&/+1.2/3+&4-/567.268,99,-:1;< !"#$%&&=:9>1(3.:&?.-?&@(A&B>.'1;<*+,-.//01-20345678/ 7296:7;2/B2CCD=EF47G2A5 !"#$%&&'''()*$+),-(./0&/+1.2/3+&4-/567.268,99,-:1;< !"#$%&&=:9>1(3.:&?.-?&@(A&B>.'1;'*+,-.//01-20345678/ 7296:7;2/B2CCD=H:7+4IA5 ((( DBpedia INTERVIEW TRANSCRIPT Ms. Williams: So with me when I went in this place I had Oscar Pettiford, Kenny Clarke on drums, Kenny Durham on trumpet, and Kai Winding on trombone. SPARQL QUERIES NAMED ENTITY RECOGNITION SCRIPT JAZZ DIRECTORY <http://dbpedia.org/resource/Herbie_Hancock> <http://dbpedia.org/property/label> "Herbie Hancock". <http://dbpedia.org/resource/Thelonious_Monk> INTERVIEW TRANSCRIPT <http://xmlns.com/foaf/0.1/name> "Thelonious Monk" . Ms. Williams: So with me when I went in this <http://dbpedia.org/resource/Coleman_Hawkins> place I had Oscar Pettiford, Kenny Clarke on <http://xmlns.com/foaf/0.1/name> "Coleman Hawkins" . drums, Kenny Durham on trumpet, and Kai <http://dbpedia.org/resource/Oscar_Pettiford> <http:// Winding on trombone. dbpedia.org/property/label> "Oscar Pettiford". !"#$%&#'()%" encoding connections !"#$%&&'''()*$+),-(./0&/+1.2/3+&4-/567.268,99,-:1;< !"#$%&&=:9>1(3.:&?.-?&@(A&B>.'1;<*+,-.//01-20345678/ 7296:7;2/<9;47=>2?@670A5 !"#$%&&'''()*$+),-(./0&/+1.2/3+&4-/567.268,99,-:1;< !"#$%&&=:9>1(3.:&?.-?&@(A&B>.'1;<*+,-.//01-20345678/ <http://dbpedia.org/resource/ 7296:7;2/B2CCD=EF47G2A5 Mary_Lou_Williams>! !"#$%&&'''()*$+),-(./0&/+1.2/3+&4-/567.268,99,-:1;< <http://xmlns.com/foaf/0.1/knows> ! !"#$%&&=:9>1(3.:&?.-?&@(A&B>.'1;'*+,-.//01-20345678/ <http://dpedia.org/resource/Art_Blakey> !7296:7;2/B2CCD=H:7+4IA5 ((( hp://dbpedia.org/ hp://dbpedia.org/ resource/ foaf:knows! resource/ Mary_Lou_Williams Marian_McPartland foaf:knows! foaf:knows! hp://dbpedia.org/ hp://dbpedia.org/ resource/ resource/ Thelonious_Monk Count_Basie . degree of knowing someone doesn’t know rel:knows_of rel:knows by_reputaon rel:knows_in_passing rel:has_met foaf:knows rel:acquaintance_of rel:close_friend_of rel:influenced_by mo:collaborated_with rel:mentor_of “…the biggest jazz fesJval ever. Mary rel: knows of! Lou Williams played it…” Count Basie…” foaf: knows! “Jack Howard as far as of professional things it rel: mentor of! would have taken me years and years to learn.” Thelonious Monk rel: close friend of! d… relationship refinement Two combined approaches for refining and validating foaf:knows relationships: – machine-driven – human-driven low hanging fruit doesn’t know rel:knows_of rel:knows by_reputaon rel:knows_in_passing rel:has_met foaf:knows rel:acquaintance_of rel:close_friend_of rel:influenced_by mo:collaborated_with rel:mentor_of Public Linked Data Sources" The script searches discographies and album metadata for musicians and producers who contributed to recordings together. It then adds a triple to the dataset that connects musicians using mo:collaborated_with. Team members" Cristina Pattuelli" Chris Weller" Ben Fino-Radin" Jared Negley" Sara Rubinow" Jeff Walloch" Genevieve Szablya" Thank you! Questions? Linked Jazz: http://linkedjazz.prattsils.org/ Contact: [email protected] .