Gaia data in ESASky Christophe Arviset Bruno Merín Deborah Baines Sara Nieto Fabrizio Giordano Elena Racero Juan González Jesús Salgado Raúl Gutiérrez María Henar Sarmiento Belén López Martí Pilar de Teodoro Thanks to : Mark Allen, Pierre Fernique and Thomas Boch (CDS), Roberto Prieto, Alejandro Lorca and Rubén Álvarez (CSG), Pedro Rodriguez, Nora Loiseau, Antonio Talavera & María Santos Lleó (XMM-Newton SOC), Guillaume Belanger & Peter Kretschmar (INTEGRAL SOC), Eva Verdugo , Göran Pilbratt & Pedro García-Lario (Herschel SOC), Marcos López-Caniego, Jan Tauber (Planck SO), Anthony Marston (JWST) and Daniel Durand (CADC HST team) Issue/Revision: 1.0 Reference: ESA Sky Status: Issued ESA UNCLASSIFIED - Releasable to the Public ESASky concept Ø Goal: to facilitate data discovery and archival science for ALL users ● Multi-wavelength ● Project agnostic ● Exploration Bruno Merín | ESASky | Gaia DR1 2016 workshop ESAC | 4/11/2016 | Slide 2 ESA UNCLASSIFIED - Releasable to the Public ESASky concept Ø Goal: to facilitate data discovery and archival science for ALL users ● Multi-wavelength ● Project agnostic ● Exploration Ø Interface to all astronomy archives ESASky Legacy: Future: XMM- JWST, Herschel Newton HST Planck ISO Integral EXOSAT Gaia IUE, .. Euclid, .. Ø First release in May 2016: http://sky.esa.int Bruno Merín | ESASky | Gaia DR1 2016 workshop ESAC | 4/11/2016 | Slide 3 ESA UNCLASSIFIED - Releasable to the Public ESASky data contents roadmap Prototype First Release Second release (summer 2014) (May 2016) (fall of 2016) • All-sky HiPS mosaics: • All-sky HiPS mosaics: • All-sky HiPS mosaics • XMM-Newton (CDS) • EXOSAT (ESA) • Science ready data (imaging • HST (CDS) • INTEGRAL (ESA) and spectra): • Planck (CDS) • XMM-Newton (ESA) • EXOSAT • Herschel-SPIRE (ESA) • HST (ESA) • INTEGRAL • Science ready data • ISO (ESA) • XMM-Newton (imaging): • AKARI (ESA) • IUE • XMM-Newton • Herschel (ESA) • HST • HST (core) • Planck (ESA) • ISOCAM • Herschel-SPIRE • JAXA/SUZAKU • Herschel • Catalogs: • Science ready data (imaging): • Catalogs: • 3XMM-DR4 • INTEGRAL • 3XMM-DR6 • XMM Slew • XMM-Newton • XMM Slew • XMM OM • HST • XMM OM • ISOCAM • Hubble Source catalog • Herschel • Hipparcos • JAXA/SUZAKU • Gaia • Catalogs: • AKARI catalogs • 3XMM-DR5 • Herschel Point Source Catalogs • XMM Slew • Planck catalogs • XMM OM • Hubble Source catalog • Hipparcos • AKARI catalogs • Planck catalogs Aim: continuous integration, testing and releasing Bruno Merín | ESASky | Gaia DR1 2016 workshop ESAC | 4/11/2016 | Slide 4 ESA UNCLASSIFIED - Releasable to the Public ESASky feature roadmap Prototype First Release Second release Third release (summer 2014) (May 2016) (fall 2016) (2017) • Web interface • Scientific validation of • Link to Vizier/Simbad • Sample manipulation • All-sky HiPS mosaics footprints and ESA all- • Generation of detailed • Time-series from CDS sky HiPS by ESA footprints (spectra) • Observation planning • Detailed footprints • Download management • Imaging and • State-fullness (imaging) • Multi-target summary spectroscopic data • Massive data • Multi-target functionality table • Online visualization of visualization • Interoperability with VO data • Link to publications? tools • On demand overlaying • Mobile app? • Documentation of footprints for pre- • Helpdesk Support planning • Hardware scaling requirements • Refactoring of prototype into robust and stable application Aim: continuous integration, testing and releasing Bruno Merín | ESASky | Gaia DR1 2016 workshop ESAC | 4/11/2016 | Slide 5 ESA UNCLASSIFIED - Releasable to the Public Gaia DR1 TGAS in ESASky Search in optical catalogues click on Gaia DR1 TGAS And visualise and/or download the catalogue Bruno Merín | ESASky | Gaia DR1 2016 workshop ESAC | 4/11/2016 | Slide 6 ESA UNCLASSIFIED - Releasable to the Public Thanks! http://sky.esa.int [email protected] BrunoMerin http://www.cosmos.esa.int/web/esdc/esasky-help Bruno Merín | ESASky | Gaia DR1 2016 workshop ESAC | 4/11/2016 | Slide 7 ESA UNCLASSIFIED - Releasable to the Public Additional slides Bruno Merín | ESASky | Gaia DR1 2016 workshop ESAC | 4/11/2016 | Slide 8 ESA UNCLASSIFIED - Releasable to the Public ESASky v1.0 - Backend Data Generation Ø HiPS: Hierarchical Progressive Survey ● HEALPix sky tessellation ● Number of levels depend on pixel angular resolution – Planck (low) 3 levels – Herschel(medium) 7 levels – HST(high) 14 levels Ø Footprints ● HST: Provided by project ● Herschel: Footprint Finder (ST-ECF) ● XMM: Instrumental + pointing Bruno Merín | ESASky | Gaia DR1 2016 workshop ESAC | 4/11/2016 | Slide 9 ESA UNCLASSIFIED - Releasable to the Public ESASky v1.0- Backend Data Access Ø Apache HTTP Server ● Serves HiPS requests Ø Java Servlet container ● Serves TAP & Target Resolver requests Ø Database ● PostgreSQL DB ● Spherical data types library (PgSphere) ● Footprints -> Spherical data types Ø Usage of IVOA Protocols & Standards ● TAP requests ● ADQL translation to SQL + PgSphere ● Storage of STC-S footprint information Bruno Merín | ESASky | Gaia DR1 2016 workshop ESAC | 4/11/2016 | Slide 10 ESA UNCLASSIFIED - Releasable to the Public ESASky v1.0 - Frontend Ø Running on a Web Browser (HTML5/ CSS3) Ø Google Web Toolkit ● Aladin Lite wrapper (JSNI) ● Data Visualization (Highcharts) Ø Usage of IVOA Protocols ● TAP accessing archive metadata ● ADQL describing complex FoVs Ø Astronomical services access ● Target coordinates resolver ● Angular size resolver Bruno Merín | ESASky | Gaia DR1 2016 workshop ESAC | 4/11/2016 | Slide 11 ESA UNCLASSIFIED - Releasable to the Public ESASky team • Fabrizio Giordano (key person, full-time) • María Henar Sarmiento (part-time, GUI) • Elena Racero (part-time, HiPS and footprints) • Belén López Martí (full-time EXPRO, HiPS development) • Pilar de Teodoro (part-time, DB) • Sara Nieto (part-time, DB ingestion) • Raúl Gutiérrez (part-time, backend) • Juan González (part-time, DB optimization) Bruno Merín | ESASky | Gaia DR1 2016 workshop ESAC | 4/11/2016 | Slide 12 ESA UNCLASSIFIED - Releasable to the Public .