Data Curation The Current Landscape
Carly Strasser, PhD California Digital Library Microsoft eScience Workshop @carlystrasser Oct 2012
Digital data
of WHOI of
Courtesey
Flickmor
From Flickr by Flickr From
C. Strasser
deltaMike
From Flickr by by Flickr From www.woodrow.org
From Flickr by US Army Environmental Command Environmental Army US by Flickr From From Flickr by DW0825by Flickr From Digital data + Complex workflows
From Calisphere via San Jose Public Library From Flickr by diylibrarian
www
blog.order2disorder.com
From Flickrby csessums
Data
Metadata From Flickrby
csessums
Recreated from Klump et al. 2006 From Flickr by diylibrarian
www
Data www Metadata
From Flickr by torkildr
Recreated from Klump et al. 2006 The Fallout
Data Reuse
Data Sharing
Data Management UGLY TRUTH
Many (most?)
researchers… btrgroup.com
are not taught data management are not effectively managingWHY? or organizing their data don’t share data publicly or store it in an archive aren’t convinced they should share data don’t know about tools that can help them
Hurdles to Data
Stewardship iowa_spirit_walker From Flickr Flickr From by
• Cost • Confusion about standards • Disparate datasets • Lack of training • Fear of lost rights or benefits • No incentives From Flickr by diylibrarian
www ? Data www Metadata
From Flickr by torkildr
Recreated from Klump et al. 2006 Who cares?
From Flickr by Redden-McAllister
www.rba.gov.au Data are first class
products of research
Moross From Flickr by Richard Richard by Flickr From Data are first class
products of research
Moross
Requiring Data Management Richard by Flickr From Journal publishers Journal publishers
Funders Data management requirements
Data are first class
products of research
Moross
Publishing Data Richard by Flickr From
Data Publication
Data are first class
products of research
Moross
Citing Data Richard by Flickr From Data Citation
Example: Sidlauskas, B. 2007. Data from: Testing for unequal rates of morphological diversification in the absence of a detailed phylogeny: a case study from characiform fishes. Dryad Digital Repository. doi:10.5061/dryad.20
Data are first class
products of research
Moross
Creating Incentives Richard by Flickr From Incentivizing
www.rba.gov.au
bthomso From Flickr by by Flickr From Data are first class
products of research
Moross
Providing Infrastructure & Tools Richard by Flickr From NSF funded DataNet Project Office of Cyberinfrastructure www.dataone.org B
A C B
A C B
A C B
A C B
A C B
A C Intercept researchers where they already work
29 Investigator Toolkit Support
Plan
Analyze Collect Kepler
Integrate Assure
Discover Describe
Preserve Facilitate Archiving Data Data Reuse & management Sharing & organization Reproducibility Publishing Open Source Tool Add-in & Web Application Earth, environmental, ecological researchers Requirements
Features Best practices check Generate metadata Generate citation Post data to repository Data Repository for Anyone | Anywhere B
A C C dataup.cdlib.org Build community
Add repositories
Add metadata animationresources.org
From From schema
dataup.cdlib.org @DataUpCDL facebook.com/DataUpCDL Data Management Plans: dmp.cdlib.org carlystrasser.net @carlystrasser [email protected] Jeff Dozier Researcher
Bill Michener Project Lead
Chris Mentzel Funder
Dave Vieglais Cyberinfrastructure dude
Stephanie Wright Librarian Data quality problem: How to identify questionable measurements Dana Meadows snow pillow, evening of June 25 2009
4 “ SWE
-8 “ SWE
12” SWE decline after removal
(J. Lundquist)