Viszards 2010: last.fm Music Where is the Jazz?

Lothar Krempel Max-Planck-Institut or the Study of Societies Cologne, Germany [email protected]

July 3 2010

INSNA International Network Conference Sunbelt XXX Riva Del Garda, Italy June 29- July 2010

– Typeset by FoilTEX – The last.fm Dataset

• These are the raw data files corresponding to the Last.fm artist map project at http://sixdegrees.hu/last.fm, gathered some time around late 2007 (so they are unlikely to be up- to-date now).

• The similarity network is directed and asymmetric; it is not guaranteed that the similarity of artist A to B is the same as the similarity of artist B to A. (In fact, they are likely to be unequal). This is due to the fact that the similarity scores given by the Last.fm API are always normalized s.t. the similarity of artist A towards its most similar artist is always 100.

Lothar Krempel: Viszards 2010 1 Miles to Go -Where is the Jazz ?

• What can you learn about Jazz from the from the last.fm similarity data ?

• Are there Jazz listerners ?

• To whom do they listen ?

• Who are the most connected Jazz artists ?

• Idea: scan patterns of strong connected artists

Lothar Krempel: Viszards 2010 2 Miles to Go -Steps in Pajek

1. use dataset LastFmarcs.net (74999)

2. remove lines lower than 90

3. all recursive degree reduction 4: 765

4. weak Components > 1 : 95 components

5. Draw –

(a) make constant Partition (b) Layers 3d (c) optimize layers in xy plane complete (several times)

Lothar Krempel: Viszards 2010 3 .

The Result: Kind of Blue

The Letter of Early in Matchbook Zero Hux Bamboo Silicon S.U.N. Plain Romance Kills the Blank Blackstreet Ginuwine Marques Portishead Lamb Jermook Goldfrapp Björk Air Cosma November Solar Joe Avant Houston 7 Flux Forest Sound Project View Year & Hybrid Chicane Syncopix Stone Nu:Tone Cyantific Armor Jones The Senses Hawthorne JamisonParker Starting for Massive Thievery Fail Heights Paul Way Keith Dru Faith Morcheeba Moloko Röyksopp Télépopmusik Koxbox Yahel Talamasca Line Sleep 4 Way Sweat 112 Mya Monica Attack Corporation Psysex 4 van Out Sweat Hill Evans Danny Strings BT Elektricity Jimmy Dyk West Byrd Elektricity The Something Taking Spill Eat Back Sugarcult Christina Mary Groove The Corporate SWV TLC Blu Fluke Moby Tosca Jaffa Lemongrass Zeca Marisa Total Doof GMS Astrix Canvas World Sunday Marco Milian Cantrell Aaliyah J. Armada Avalanches Eclipse Ferry Motorcycle Andain Blige Baleiro Monte Etnica Corsten V The The Kruder dZihan Man Icebird Lunatic Lemon Boozoo Mo’ Infected 1200 Ataris Ron Destiny’s Propellerheads Chemical & & Chi−A.D.Paulinho Cosmosis With Electric Ciara Beyoncé Sabelle Brandy Calm Jelly Bajou Horizons Lenine Maria Etnica No Universe Mushroom Micrograms van System Randy Child Brothers Dorfmeister Kamien Q Moska Rita Future den F Katana Project Cut Name Seabound Project Unwritten Beuken Pitchfork Eric Nightmares The Foo Living Unwritten B. Missy Ja Minus Astral Fighters Syndication Law Kelis Ashanti Twista Fabolous Faithless Jazzanova on Beanfield Funky X−Dream Cause Hallucinogen Rank Angels & Elliott Rule Wax 8 Lowlives Total Technical Usual Projection Assemblage Gouryella Evil’s Rakim 4 Red 1 & Science Itch Suspects Hot 23 Toy Kyoto Concern Sergio Nirvana Agony Boogie Big Nuspirit Trüby Les Mendes Chili Down EPMD Daddy Ludacris Nelly Mase Azymuth Jazz Soldiers Three Helsinki Trio Gammas Future Concord & of Peppers Signum Pride Lights Productions Kane Massive Teebee Raiden Drives Funker Decoded Prophecies Dawn Konflict Brasil Twilight and of Feedback Fall Vogt Euphoria Jeru Naughty ’66 Gang Nicola the Gang by Nas Jay−Z Atjazz Walter Edu Marc The Starr Conte Lee Augustus Black Fred Heartthrob Icon Damaja Nature Muffler Corrupt WanderleyRawthang Lobo Everything Houle Thrillseekers VNV God Hocico Pablo Sun Souls Skynet Nation Covenant of Module Charles John Empire Coil Mingus Coltrane Quarteto KRS−One Wu−Tang Linton Troy Dominik Clan Steel Black The King Stakka Kerriem Julius Bah Audion Kwesi King Ill.Skillz & Chandler Papp Samba Pierce Eulberg Combichrist :wumpscut: Suicide Grendel Pulse Uhuru Upsetters Tubby Klingonz Cy Commando Thelonious Charlie Bill Johnson Kurt Skynet Monk Parker Evans GZA/Genius Ghostface Alex Alex Mathew Martin Michael Claes−Göran Raquel Israel Burning Max Horace Djavan Ananda The Gadjo Shapeshifters Aleena Culture Far The Mad The Aquanote Under Smoke Jonson Solveig Gray Hederström Rastenni Vibration Spear Romeo Andy Hellbillys Guana Project Rurals Dexter Sonny Wayne I Batz Meteors Sin Quakes Gordon Rollins Shorter David Junior Raekwon Third Peter Dennis Big Mikey Miguel Andy Nathan Ricardo StoneBridge Axwell Simon Dario Camillo Markus Demented Fake Villalobos Guetta Jack Casey Landgren World Tosh Brown Youth Dread Frenzy Batmobile Are Nekromantix Migs Caldwell Warrant Cinderella Campeotto Felgen Oscar Cannonball Art Joe Go! Armand Peterson Adderley Pepper Henderson The Gilberto Baden Elza Bob Brandsta Bunny Cornell Johnny Reverend van Tereza François Katy Roger Mighty Gil Powell Soares Sinclar Skid City Wailer Campbell Clarke Horton Helden Poison Skid Miles Diamonds Evelyn Poison Row Deguelt Bødtger Bens Släckers Cheo McCoy Horace Freddie Heat Change Lotta Birthe Feliciano Davis Tyner Silver Hubbard Althea Dorival Nilsson Wilke Quintet The Junior Alton Gal Elis Nara ???? Clara ??????? & Inger Robert & Maria & Costa Leão Nunes Caymmi Mötley Judas Heptones Murvin Ellis Carlos Regina W.A.S.P. Glenn Cogoi GilbertoGustav Rey The Teresa Donna Crüe Priest Jacobsen Santa Victor Lee The do Shalamar Heatwave Borgkvist WincklerSanta Manuelle Ruiz Rolling Steppenwolf de Elizabeth Rosa Manuelle Morgan Animals Carmo Paulinho Stones Ken Delroy Noronha Milton Beth The Gontiti DEPAPEPE Kurban Cotten Ludwig Nascimento da Carvalho Knez Re−Union Boothe Wilson Jeff Richard Michael Viola Maytals Puerto van CJ Carlos Amália Joana Accept Dio Grupo Tito The Creedence Mysonne Kashiwa Elliot Lington Imagination Chic Blind Rican Beethoven The Cream Mac Zel Rodrigues Amendoeira Niche Rojas Who Cream Clearwater Willie Power Revival Johann Wolfgang Gonzaguinha The The The Direc−t Duman McTell Fruko Jacky Roy Jeff Kim Chieli Peter Velvet Melodians Ethiopians Pioneers Sebastian Amadeus Made Jones Katia Cristina Sister Saxon y Oscar Led Lynyrd Men DarkthroneJasper Immortal Golub Waters Minucci White Narcosis Blind Bach Mozart Led Eagles Jr. Guerreiro Branco Sledge Blind Sus D’Leon Zeppelin Skynyrd Mor Leadbelly Lemon Olga Tesos Jaz−O No The Derrick Desmond The ve 110 Jefferson Johannes Claude Mr. and Big Wayman Steve Euge NormanLight Kazuya VehemenceParagons Morgan Dekker Skatalites Ötesi Brahms Debussy Tisdale Oliver Groove Brownfor Ishigami 6.2 Debussy SatyriconServ−On GorgorothThe Mike Absolute Madredeus Albert Big Charley Son Immobilarie Tomorrow Bill Beginner Collins Bill Patton House Totale Prince Laurel Kargo Teoman Vega Broonzy Franz George Franz Maurice Warren Joe Rick Buster Aitken Carpathian Dysthymia Ethah ????? Liszt Gershwin Ravel 1349 Fünf Hill McBride Braun Rex Schubert Forest Aes Matrix Muddy Buddy Otis Bukka Sterne Beginner Mystical Solar Gildo Bukka Dana Fields Waters Guy Rush White Blitz Deluxe Sun Fields Gustav Johann Gabriel Felix Strauss ???? Mahler Peter Bizzy Layzie Roy Christian Radio Antonio ???????Duncan ???? Fauré Mendelssohn II Eins Carbon Howlin’Japan Elmore and Torch Doppelkopf Massive Bone Bone Black Anders Futura Flores Dhu the Cockney Zwo Töne Based Cell Ishq Wolf James Sir Lifeforms Ashley David Hector Antonín Test Rejects Der Hamilton Shutrick Edward Tube Tobi DJ Andy Chris HeavenSonny Danza Nacha La ????? ??????? Dvo?ák Tube Bone KrayzieE−Noid Bone Visage Sonny Berlioz Babies Eins Das Dione Borg Roberts Boy17 Invisible Pop Unión Elgar & Rag Thugs−N−Harmony Bone Brothers Anti−Nowhere Angelic The Zwo Das Bo Williamson Camille League UpstartsLee Oppressed Carlo 3SL 2Lips Magnets Jean Gioacchino Edvard ILS Bo Maria James Antonio Leonard Kings The ???? Grieg Coombs Levine Los Sibelius Saint−Saëns Rossini Grieg Denyo Giulini Salieri Slatkin Deicide Have Endymion Ultravox Human Ferris Afrob Lulu Secretos Capital MC 77 Afrob ??? Long Random The League Frejat Santos Inicial Soul The Love Diego Louise Arms Bounty Joe Council Gustav Carl Georges Richard Rennie of Liz De Julia Albert Uuno Leila Ermanno Frank Bothy MorbidUnited Mancino Carver Tovey Killer Holst Orff Bizet Wagner Pilgrem Man Carroll Dannan Thornton Lortzing Josefowicz Wolf−Ferrari The Rosa Neljä The Band Klami Franz The Angel PMMP & Dione Don’s Jota A Groop Mota Ruusua Deep Skank Man Ferdinand Strokes??? ??? the Mobile Quest TheLux Old Young Joseph Elephant Freeze Mr. Giuseppe Called Anthony SnowboyPaul Nikita John Gary Pyros T.O.K. Barbers Freeland Tannahill Blind Disciples Bolt Joan Man Mice Vegas 10?? ????8 Verdi ????? Adam Newman Lincke Koshkin Martin Stanley Ryan Dismember Sven Zen Rancho Enanitos Aterciopelados Ola Weavers Dogs Kaiser Arctic Thrower of Tiktak Verdes Kraus Regener Café Diablo Tommy frukt José Chiefs Monkeys ?? Ass Afterlife Galliano Mother Sir George Ferms och Padilla Earth Leevi Emily Los Christine Colin Jones Los Café7?? SALT5 flingor ZYX ??? ??5 Madetoja ViolaineMitchell Robert Fabulosos Café Pilzer Davis Grobschnitt KaisaEloy Agit Tacuba Rental Korhonen Prop Cadillacs 34 Ricky Mållbergarna Gametime ??? Bruch Merle Tim Guns Below I Thousand Ash Haggard ??? ???4 Cosette Jocelyne Cosmic McGraw Up! Nine Pillar Foot Jokers Ra Triumvirat Kristiina The Tempel Stunt Six Tom Krutch Halkola Modernist??? Down Zero Day Eldorados Monkey Patsy Loretta Brad Chance Laura LawndaleMonique Troccoli’s to Outbreak Slide Jeff The Role Agitation Cline Lynn Paisley Finlin HombresUlmer Thubert Dog Minusbaby Vlad Nothing Model Sonicflood SkilletFree Juicehead Belketre Reinhard Fifth Mike The Tepes Voigt???? ??? Wade Säwes Reagan Maximo Johann mg4 Year O. Leaving October Jorge Migraines Kenny Nicole Trains Faction By Big KillswitchDiego Stamitz Power Chesney Crush Brown Pierre Morel Lady Manuel de Paquin Paza the Daddy EngagePujol Quest Jonas G Ron Cris Diversion Mütiilation Cardoso la Tree Weave Bernhard Carl Karl Francesco Bering Sally The Fish Velasco Ferdinand DionisioAs Benjamin Eddie Rue Henrik Frankel Reinecke Goldmark South Maria Taylor Slides Jacobus Ries AguadoI DragonlandVeracini Crusell Lay Clemens Michelle Micah Pech Dusminguet Digitalism DyingKeith Margareth non Crispin Stampley Copperpenny Leib Edmund JosephDeana Timbalada Michael Joseph Hampshire Joseph Menezes Papa Joseph Glantz JoachimCarter Wolff MarkIl Razed Achron Rubbra Macka SimianMs. Pistel In Balletto Tramaine Ramones Sex DiamondJustice MobileThing with Black JohannPistolsLee Di Worm HawkinsSarah PagliaroSheryl Ann Olodum Kaigal−ool Oleg DangerBronzo vs. Bang All Jakob Khovalyg Kuular Girl Transmutator JackIs McLachlan Crow Womack MNQNN Banco Gang Owens That Froberger Axenstar Cheb Quella del Green The Amparanoia Vecchia del Daryl Remains Jo Balowski Vecchia Mutuo Clash Locanda Coley Dee Kongar−ool Soccorso Wayne Jewel The OpgezwolleOndar AmpopGerald Burton Messina Cochran Marks Lane Polyphonics

Jimmy Die Viszards 2010 Jawat! Kubus Cheerleader Evans

Jesse MilesToGo Lee

http://www.mpifg.de/people/lk Turner © Lothar Krempel, Max Planck Institute for the Study of Societies, Cologne

.

Lothar Krempel: Viszards 2010 4 .

Kind of Blue: XXL

Wax Kyoto Nuspirit Les Ludacris Nelly Mase Azymuth Jazz Trüby Massive Helsinki Trio Gammas

Nicola Nas Jay−Z Charles John Conte Atjazz Lee Mingus Coltrane

Thelonious Charlie Bill Steel Black Linton Monk Parker Evans Pulse Uhuru Kwesi Johnson

Dexter Sonny Wayne Israel Max Claes−Göran Raquel Gordon Culture Burning Hederström Rastenni Aleena Rollins ShorterVibration Spear Romeo

Oscar Cannonball Art Joe Third Peter Dennis Dario Camillo MarkusPeterson Adderley Pepper Henderson Campeotto Felgen Landgren World Tosh Brown Miles Brandsta McCoy Horace Freddie Bunny The François Katy Roger Tyner Davis Mighty City Silver Hubbard Quintet Wailer Deguelt Bødtger Bens Släckers Cheo Diamonds Birthe Feliciano Wilke Lee The Inger Robert & Morgan Gilberto Heptones Jacobsen Cogoi Gustav Victor Rey The Santa Rolling The Borgkvist Elizabeth Winckler Manuelle Ruiz Animals Steppenwolf

http://www.mpifg.de/people/lk Rosa

© Lothar Krempel, Max Planck Institute for the Study of Societies, Cologne Stones Ken Delroy Re−Union Cotten Ludwig . Boothe Wilson

Lothar Krempel: Viszards 2010 5 We want Miles ..

• Where Miles Davis ?

• Which artists are connected to Miles ?

Lothar Krempel: Viszards 2010 6 We want Miles .. II

–> Use Lastfm.net (74999) –> remove lines lower than 80 –> Partition; Complete neighbours of vertice 28333 –> extract –> partition [0-3] (180) —————>Miles3step.net –> Bidirected arcs of vertices (Max) –> Betweenes centrality —————->Miles3step3Dbetween.vec –> draw partition vector layers 3d - 3 step environment

Lothar Krempel: Viszards 2010 7 .

We want Miles .. III

Miles Davis Viszards 2010 We want Miles Herbie Hancock Chet Baker

Thelonious Miles Miles Monk Davis and Akira Davis Sakata and Quintet John Gil Coltrane Evans John Charles Coltrane Mingus Thelonious Monk & Maceo John Parker Coltrane

Weather Report Sarah

The Chick Vaughan Headhunters Corea Jimmy Smith Gerry Chet Mulligan Bill Ernestine Till Baker Brönner & Anderson Quartet Chet Evans Baker

Freddie Horace Cannonball Stan Dizzy Hubbard Silver Adderley Getz Gillespie Lee Joe Sonny Dexter Thelonious Jon Morgan Gordon Hassell Henderson Rollins Monk Bill Wayne Wynton Charlie John The Evans Marsalis Parker Coltrane Quintet & Shorter Quartet Charles Jim Mingus Hall & Buster Chick Williams Billy Marcus Corea Carlos BlossomEric Etta Nancy Julie Dianne Cassandra Defunkt Dolphy Cobham Miller Akoustic Eric GarnettRoland DearieSun James Wilson London Reeves Wilson Band Return Alexander Kirk Ra Stanley Jaco to Perico Anita Dinah Peggy Jane Madeleine Clarke PastoriusSun Forever Sambeat O’Day Washington LeeElla Monheit Peyroux Ra Dee Fitzgerald The John & John Avishai Jacky Kurt Carmen & Ella Nina His McLaughlin McRae Dee Fitzgerald Crusaders Patitucci Cohen Terrasson Elling Bridgewater The Simone Ronnie Solar−Myth Jimmy John Ella Ink Lonnie Smith Aziza Coltrane Fitzgerald Nat Earl ArkestraBarbara Smith Gary Fitzgerald Louis Spots Diana Billie Liston & and Mustafa and & King Billie Dennerlein Burton Armstrong Krall Holiday Smith The Wes Zadeh JohnnyJohn Count Ella Cole Ella Ella Broadcasters Montgomery HartmanColtrane Basie Fitzgerald Fitzgerald The Mel Bob Keith Betty Fitzgerald Fitzgerald Saturnino Michel & & & & Blackbyrds Brown Moses Jarrett Carter Petrucciani Johnny Joe Louis Duke The Hartman Pass Armstrong Ellington Cannonball Wes Grant Bill Django Count Frank Kyle Gerry Horace George Dieter Mulligan Adderley Montgomery Green Parlan Shearing Evans Reith Reinhardt Basie Chastenier Eastwood Quintet Clifford Trio Quartet Brown Donald Clifford Sonny McCoy Oscar Art Markus Duke Byrd & Brown Clark Tyner Peterson Tatum Ellington Max Art Stockhausen Blakey The Roach Henry Benny Kenny Blue & Art Bud Dave Galt Benny Grimes Golson Burrell Mitchell The Pepper Powell Brubeck MacDermot Jazz Quartet Trio Thelonious Brian Bobby Hank MessengersArt Oliver Hampton Paul Monk Eno Nat Mose Nathalie and Jon & Hutcherson Adderley Mobley StanleyBlakey Nelson Hawes Desmond Allison Cole Hassel & Turrentine Charlie Sonny Jon Lincoln Rollins Hassell Jackie Gerry Sigurd Parker Robin Kenny Stanley Center Ben Køhn Grand Ann Paul Eubanks Dorham McLean Webster Mulligan & Burton Eubanks Turrentine Jazz Quartet Dizzy Mal Burton Bley Orchestra Gillespie Andrew Jeff Roy Joshua Don Coleman Serge Michael Tim White Hill Hargrove Redman Braden Hawkins Chaloff Buckley WyntonProject Brian Marsalis Dave Duke Zoot Brian Wardell Jaki Eric Ornette Marsalis Holland Blade Jaki & Pearson Sims Blade Gray Byard Dolphy Coleman Quintet Fellowship Ellis Marsalis Lester Cecil Albert Joe Joe Gilad Pepper Frank Annette Moondog Farrell Lovano Atzmon Young Adams Lowe Taylor Ayler Peacock Moondog http://www.mpifg.de/people/lk © Lothar Krempel, Max Planck Institute for the Study of Societies, Cologne

.

Lothar Krempel: Viszards 2010 8 Milestones - So what ?

• Who are the artists from whom Miles attracts (relatively) more listeners (has higher net flows) ?

Lothar Krempel: Viszards 2010 9 Milestones - So what ? II

• Idea: treat data as asymmetric

• decompose similarity matrix using Gower decomposition

A = A − AT

• analyze skewed asymmetric matrix

Lothar Krempel: Viszards 2010 10 Milestones - So what ? Steps in Pajek

1. read

2. transpose - make new matrix (a) multiply by -1

3. matrix and transposed matrix : (a) union lines (b) net transform remove multiple lines sum values

4. remove lines higher than -60

5. remove degree less than 1

6. numbering depth first strong

7. partition indegree

8. draw partition vector Lothar Krempel: Viszards 2010 11 .

Milestones - So what ? III

Chick Corea

Herbie Viszards 2010 Hancock So What ? Net Flows

The Sonny Dave Herb Brubeck Ellis Rollins Quartet Miles Freddie Hubbard Thelonious Davis Charlie John Parker Coltrane Monk Dizzy Gillespie McCoy Bill Tyner Evans

The Dirty Polar Oscar Sarah Dexter Cannonball David Bear Peterson Vaughan Dozen Axelrod Gordon Adderley Brass Band Kenny Michael Lennie DaveLee Ornette Wayne Morphine Brubeck Coleman Burrell Brecker Shorter Tristano Konitz The Sun Eric Ella KeithJoe Ray Ra Fitzgerald McPhee Brecker Dolphy JarrettArt Brown Brothers Blakey Victor Dave Tortoise & Wooten The Holland Jazz DaveBig Mike Charles Wynton Messengers HollandBand Lee Terrana Big Ritenour Mingus Marsalis Band Nicholas Yellowjackets David Payton Sanborn

Bob James Muhal Charlie Return Muhal Count Charlie to Richard Duke George Fourplay Hunter to Basie Duke Fourplay Forever Abrams Ellington Duke Chick The Treat Soweto Red OscarJohn Pharaoh Corea Courtney Pat Marcus Paul Norvo Scofield Sanders Elektric Pine Her Bonerama Desmond Kinch Peterson The Right Metheny Belgrave TheloniousTrio Band HoraceMonk Chet Cannonball Brian Lee Craig Ken and Roland Barney Taborn McIntyre Blade Morgan Wilen SilverJohn Kirk Adderley Béla Fellowship Brad Coltrane Baker Fleck Max NathalieHerbie Akira Chrisand Gerry Art Art Mehldau Mann Quintet Mulligan Blakey Trio Roach Cole Sakata CliffordWhitethe Farmer Thelonious Miles Flecktones Chicago Monk Davis Billy Brown Coleman Booker Underground Zony TerrySteve Chris Hiram & and Cobham & Hawkins Ervin Turre Quartet CharlesJohn Gil Max Mash Gibbs Botti Bullock Chicago The MingusColtrane Evans Tomasz MahavishnuRoach John Danilo Joe Sta?ko Oliver Frank CharlesMike Tom Underground Perez& Orchestra RosolinoColtrane Lloyd Trio Grassy Henderson Quartet Nelson Mainieri Harrell TheloniousEric Herbie Quartet Charlie LincolnKnoll Monk Hancock Center Dolphy The Markus Wardell Hunter and Stockhausen Gray & Quartet Jazz Sonny Quintet Chick Wayne Orchestra Rollins Shorter Tony Mose Django Corea The Chuck Williams Allison Reinhardt Akoustic Headhunters Mangione Jean−Luc BandStan Ponty Getz Charlie Milt Hunter Blue Jackson Trio Mitchell Pat Clifford Hampton Joe Bobby Olu Hawes Dara Metheny Supersax Brown Farrell Hutcherson Trio Chet Robin Joo Baker Tal Jimmy Charlie Eubanks Kraus Quartet Farlow Heath Haden Jeff George Albert Jan Gilfema Madeleine Shelly Ingrid Garbarek Peyroux Lewis Mangelsdorff Manne Jensen Egberto Gismonti Tony Jeff Manu Williams Manfred Booker Parker Katche Lifetime Schoof Little http://www.mpifg.de/people/lk © Lothar Krempel, Max Planck Institute for the Study of Societies, Cologne

.

Lothar Krempel: Viszards 2010 12 Thank you

Lothar Krempel: Viszards 2010 13