Belgian Science Policy Office (BELSPO) / Federal Scientific Institutes (FSIs)

I. Update on Cal/Val Activities

Jean-Christopher Lambert Royal Belgian Institute for Space Aeronomy (IASB-BIRA)

Agency Reports I WGCV Plenary # 41 Tokyo, September 5-7, 2016 Working Group on Calibration and Validation Working Group on Calibration and Validation 2

IASB - , VITO

authority USOC

- BIRA FSIs Onderzoek

BELSPO BELSPO

under

)

Technologisch

FSIs BELSPO / BELSPO Agency Reports I ULg voor

Institute for Space Aeronomy, Aeronomy, for Space Institute

Instelling

institutes

partners

Scientific Institutes ( Institutes Scientific

Université libre de Bruxelles, ULB de Bruxelles, libre Université de Liège, Université Vlaamse Belgian User Support and Operation Centre, B Centre, Operation and Support User Belgian Liège, CSL de Centre spatial Royal IRSN of Belgium, Sciences Natural of Institute Royal RMIB of Belgium, Institute Meteorological Royal ROB of Belgium, Observatory Royal Royal Belgian Belgian Royal

• • • • • • • • •

Regional

Federal Contributing Working Group on Calibration and Validation 3

) FSIs

presented BELSPO / BELSPO

Agency Reports I

methods systems

Validation Validation Validation Validation data Validation EO missions EO

Background Background information (not

• • • • Updates on: Working Group on Calibration and Validation 4

-

polarimetric SAF, O3M NOMAD/TGO CubeSat

-

NG - IASB‘s - IASI

IASI (CM

2018/10):

- PICASSO/

BIRA and

and 2 - FSIs with

IASB‘s

2017/10 UVN - 5 (L -

ExoMars

1A/1B - MSG MSG GOME

ESA

and to

processor :

mission TROPOMI, TROPOMI, BIRA

BELSPO / BELSPO

4 UVN, Sentinel 4 A/B - /PROBA (Phase B2) /PROBA - Ice on SAOCOM

DInSAR Update on missions EO Altius /

transferred MetOp

Precursor Snow/ Roscosmos

5 - - C, Sentinel - InSAR 3A L 2016/02) FTS; KNMI/NASA Aura KNMI/NASA OMI FTS; IASB‘s - - - +

and

cooperation : ESA

3 (S 3 : - MetOp Sentinel BIRA

: ago : :

CSL 1 (L 2001/10) - - ScanSAR year Oceans

months

CONAE SAR/ PROBA V (L 2013/05) EU Sentinel PROBA Approved Next Next Upcoming SAF); SAF); ACE CSA 6 Phase F: GOME, ESA GOMOS, MIPAS, SCIAMACHY Phase E: EUMETSAT

• • • •

Land, • • • • • • Atmosphere Working Group on Calibration and Validation

Working Group on Calibration and Validation

Working Group on Calibration and Validation 7

m); m); μ by

CNRS CNRS

100 by

provided nm

developed

;

): ):

nm

radiometers

thermal (200 thermal

3000

and μm –

nm spectrum IASB -

visible instrument’s

): 180 ): LSW (Germany) LSW

UV, UV, one Spectrophotometers -

and with ) near )

Belgium measurements

Monitor): irradiance

Extreme UV/UV UV/UV Extreme L2008)

Switzerland ( IASB ( IASB - Update missions EO on Update irradiance from 17 nm to 100 Irradiance

Irradiance BIRA

Solar Calibrating IPM (Germany) IPM -

and with

by

Formation for flying corona observations Space weather Space weather mission with Sun observations

Auto

SPECtral

) Variable

PMOD/WRC (Davos, (Davos, PMOD/WRC

SOLar ( SOLar partnership

( developed (L2009) (L2018) by

Belgium SOlar 2 3 ( on ISS/Columbus on ISS/Columbus - - ACES

KMI ( KMI - Support Centre: Belgian USOC Support hosted USOC Centre: by BIRA Belgian -

EUV/UV; EUV/UV;

IRM SOL SOVIM SOVIM developed SOLSPEC in (France)

99% of solar energy)

PROBA PROBA

• • • ( Measurement of solar spectral

Facility Facility SOLAR SOLAR Working Group on Calibration and Validation 8

FTIR FTIR & : WP4

campaigns

QA4ECV Sea

calibration AROMAPEX characterization

2

stations - North

and member error

FSIs CLIM WP2, over , -

Uccle TCCON/OCO

in in AROMAT in AROMAT

SeaDataNet

for Network Network (7 RT stationsBelgium+ inAntarctic Belgian parameters

]

China, China, reprocessing

, centre

with

BELSPO / BELSPO (BMDC),

campaign instruments

websites

600 nm, broadband, clouds,sunshineduration… meteorological Update on validation data calibration - campaign

Centre

harmonization DOAS DOAS 2

cooperation - on and

various [ based - based uvindex.aeronomie.be CINDI - effort AirCore+FTIRs : : centralised car shore

Visible Irradiance VisibleMonitoring chemical http://www.mumm.ac.be/datacentre - , Maritime Data

http://

and and

- -

UAV FRM4DOAS, FRM4DOAS, FRM4GHG, International International MAXDOAS bilateral AERONET, AERONET, EEA/EMEP, TCCON, NDACC, WMO/GAW Spectral irradiance 280 Solar UV Base), with

Physical Ship Belgian

• • Solar: Solar: • • • Marine: • • • • • Atmosphere Working Group on Calibration and Validation

9

IASB - IASB - measurements , BIRA , , BIRA , Bolsée IASB UV radiation IASB UV radiation Mazière -

BIRA FTIR instruments instruments FTIR and TCCON) (NDACC

W) ULg ° Contact D. Contact S, 63.9 S, ° IASB IASB and - Contact M. M. De Contact BIRA Porto Velho (8.8 Velho Porto

IASB -

, BIRA ,

Hendrick Update on validation Update validation on data , IRSN/MUMM Contribution networksto and F. and

measurements

Scory Sea

North Roozendael sondes in Uccle, H. De Backer, RMIB Backer,H. De in Uccle, sondes 3 Contact S. Contact /O IRSN/MUMM Brewer + Contact M. VanM. Contact Working Group on Calibration and Validation

=>

over : for new NDACC/TCCON FTIR NDACC/TCCON newfor

forest low low albedo Update on validation Update validation on data Brazil Paramaribo Paramaribo

aircraft due to Amazon with based remote emissions

- of

forest Rationale for atmospheric large uncertainties

ground

SWIR satelliteobservations of - Porto Velho in in Velho Porto

campaigns measurements composition FTIR Area investigatedby Heterogeneity complementarity sensing(column/profile) observations over Amazon forest the Amazon Very few NIR GHG have biogenic, biomass burning and burning biomassbiogenic, greenhouse gas Amazon rainforest = important

5. 4.

3. 2.

1. Why Working Group on Calibration and Validation 11

s

Campaign

et al., 2013

ESA sponsored campaigns in 2014/09, 2015/08, 2017 2015/08, 2014/09, in campaigns ESA sponsored AROMAT AROMAT Update on validation Update validation on data Merlaud Ref: SWING/UAV

BIRA - IASB Working Group on Calibration and Validation

12

2016

measurement results of the morning flight, 21 April 2016 April 21 flight, morning the of results measurement

AirMAP

Campaign et al., 2013 et

DOAS and and DOAS - Merlaud

Ref: Update on validation Update validation on data EUFAR/ESA sponsored campaign over Berlin, in 2016/04 in Berlin, over campaign sponsored EUFAR/ESA Fig 3. Preliminary mobile Preliminary 3. Fig AROMAPEX AROMAPEX Aeromobil

DOAS on - CAR

Merlaud

: A. : BIRA BIRA SWING on FUB Cessna - -

IASB IASB Courtesy Working Group on Calibration and Validation 13

) vs.

DQA) - sites spread

and

28 NDACC NDACC 28

bias and

in WMO/GAW WMO/GAW O3S

sites to

FSIs (WOUDC, NDACC, SHADOZ, ESRL…) SHADOZ, NDACC, (WOUDC, Sep. 2016Sep. type, type, manufacturer, solutionstrength

homogeneity

contribution (

2013; 60 WOUDC 60 2013; - archives

evaluate

DQA meeting,DQA - (2000 to

ozonesonde data

of BELSPO / BELSPO

station

approach

homogeneity

caused by caused by : D. Hubert,O3S: Update on validation data consistency Courtesy ozonesonde ensemble

network all

: mutual based - over

product -

Network Network inhomogeneity By altitude

• •

• Ozonesonde Working Group on Calibration and Validation 14

CEOS WGCV / ACC ACSG interaction ESA through OzoneCCI Being implemented QA4ECV in Atmosphere Validation (AVS) Server

cci ACC ozone protocol WGCV methods

L2 data validation

Update on AC validation AC validation on Update Generic Working Group on Calibration and Validation

protocol methods

L2 data validation

Update on AC validation AC validation on Update Generic Working Group on Calibration and Validation 16

)

" (Geneva, 2008 (Geneva,

Climate4Impact)

vocabulary) - TASTE,CCI… - methods

ENES project ( projectENES - 2016

June uncertainties

rectification, … rectification, - I/II, Multi PASODOBLE, - CEOS Workshop on QA for the GEOSS the QA foron CEOS Workshop - , QA4ECV TR,QA4ECV ,

Niemeier and S. and

Update on validation Update validation on

QA4ECV Technical Review, MSSL, Surrey, 15 June 2016 June 15 Surrey, MSSL, Review, Technical QA4ECV "Confidence in Compernolle CEOS WGCV list proposed to GEO to proposedWGCV list CEOS

slides: S. slides:

CLIM CLIM Drawn from IPCC Data distribution centre, EUPORIAS project,IS centre, EUPORIAS distribution Data from IPCC Drawn Metrology, data correlation, data harmonization, geo harmonization, data correlation, dataMetrology, - terms GUM/VIM metrology general of explanation NPL:short by note Guidance closure budget error comparison termsand specialised comparisons: ofdata D3.2.Metrology Initially metrology, remote sensing, monitoring; further enhanced with modelling aspects in MACC in aspects modelling with enhancedfurther monitoring; sensing, remote metrology, Initially MACC forprotocols QA/validationin Implemented interpretation and explanation More Heritage Heritage (e.g., VIM, sources ISOGUM, from formalTDs, NIST)literally definitions andTerms next

• • • • • • • • • CLIPC (http://www.clipc.eu/glossary) CLIPC GAIA FIDUCEO vocabulary (working draft) (www.fiduceo.eu/content/fiduceo draft) (working vocabulary FIDUCEO QA4ECV Atmosphere list: Atmosphere QA4ECV

Courtesy

• •

• Approaches Approaches and scopes in Climate EU Services pioneering projects Working Group on Calibration and Validation 17

" methods uncertainties

Update on validation Update validation on "Confidence in Working Group on Calibration and Validation 18

" methods uncertainties

Update on validation Update validation on

4 (systematic effect only) "Confidence in - 3 (qualitativeterm) vs 4 (numerical)

-

2 (any 2 (any deviation) vs 3 2 - -

1 1 Inconsistent definitions! Inconsistent Working Group on Calibration and Validation 19

" methods uncertainties

Update on validation Update validation on "Confidence in Working Group on Calibration and Validation 20

" methods uncertainties

Update on validation Update validation on "Confidence in Working Group on Calibration and Validation 21 - /multi -

"

, HCHO, on, CO) 2 5p MPC…) methods -

uncertainties SAF, SAF, S

- in error calculation

ozone/GHG, O3M Update on validation Update validation on ): - "Confidence in linearities

-

ongoing (

steps

mission, L2/L3, unsmoothed/smoothed…) Uncertainties on SI2N ozone profile trend assessments (single Audit of responses to this QA4ECV questionnaire of non Effects terminology, traceability chains, calculation of uncertainties Questionnaire to QA4ECV ECV producers (NO Propagation of standard terminology at working level (QA4ECV, NDACC CCI WGs, Tentative harmonization between EU H2020 projects

• • •

• •

• Next Working Group on Calibration and Validation

mep.esa.int - v -

V - systems http:// validation validation

on on 2018 MEP PROBA MEP -

Update Update

products

needed for

V

- V - data

derived party party projects and users - VEGETATION VEGETATION (1998) till - correlative release 2016, iterations 2016 -

Cal/Valand present PROBA SPACEBEL big and data standards TRASYS,

Pre Tools/libraries/applications AlsoMERIS and AVHRR Also Data: SPOT Engaged third Operational platform hosted by VITO; ESA pathfinderESA project

• •

(MEP) PROBA (MEP) Mission Exploration Platform Platform Exploration Mission Belgian Science Policy Office (BELSPO) / Federal Scientific Institutes (FSIs)

II. Background information

Jean-Christopher Lambert Royal Belgian Institute for Space Aeronomy (IASB-BIRA)

Agency Reports I WGCV Plenary # 41 Tokyo, September 5-8, 2016 Working Group on Calibration and Validation