Update on the SPASE metadata registry for the ESA Heliophysics missions activities
Abstract
Report on SPASE metadata registry of ESA heliophysics missions.
Full text
1 ESA UNCLASSIFIED - For ESA Official Use Only Update on the SPASE metadata registry for the ESA Heliophysics missions activities *Support Archive Scientist - Telespazio for ESA, ESAC, Spain Joana S. Oliveira*, Arnaud Masson, Leonard Garcia, Lee Bargatze, Helen Middleton, Shing Fung
2 Introduction ESAC Science Data Centre (ESDC): •COMMITMENT: Increase data discoverability and interoperability to boost the open exchange of ESA Heliophysics data. •STRATEGY: Issue DOIs per instrument, per dataset, etc. •ACTION: to describe heliophysics Datasets using the metadata model created and maintained by the heliophysics community (SPASE). https://hpa.esa.int The v0.1.0 of the ESA / ESDC Heliophysics Archive (HPA) was released in April 2025.
3 DOI - Status Currently: •DOIs are issued for instruments onboard ESA Heliophysics missions: https://www.cosmos.esa.int/web/esdc/doi/heliophysics •Each instrument DOI is related to a landing page at ESDC*. •No SPASE descriptions were needed to issue the DOI. •However, instrument SPASE descriptions is ongoing. •Some derived products relevant to the community (including multi experiment dataset, e.g. MAG+SCM for Solar Orbiter). Near future: •Each dataset will be given a DOI: •Large number of datasets (1000s) •Only for Cluster there are more than 800 datasets. •Needs first SPASE description •automatized process is preferred given the large numbers. Ex: landing page for Cluster STAFF instrument (link). *ESAC Science Data Centre
4 SPASE activities – HPA GitHub •https://github.com/HPA-ESDC-ESA-INT •First public release on January 2025
5 SPASE activities – HPA GitHub •https://github.com/HPA-ESDC-ESA-INT •First public release on January 2025 complex naming authorities Name adapted to our needs Metadata contact point is HPA lead for all datasets
6 SPASE activities – Privacy Notice •Personal data used in SPASE descriptions might be sensitive according to ESA personal data rules. •A privacy notice was made available in the HPA GitHub https://github.com/HPA-ESDC-ESAINT/SPASE/blob/ead95de59b5b9be7de50784836de26b6a29550e6/SCI_Heliophysics-Archive-(HPA)_privacy-notice_DPNR-2851_28042025.pdf •During iterations with the instrument teams the team is made aware: •“Note, by approving the datasets SPASE descriptions you agree with the ESA privacy notice.”
7 SPASE activities - Status Solar Orbiter Cluster Ulysses Proba2 Double Star SOHO SMILE Proba3 spacecraft spacecraft spacecraft spacecraft spacecraft spacecraft spacecraft spacecraft MAG STAFF COSPIN SWAP ASPOC CDS SXI ASPIICS SWA FGM DUST LYRA FGM CELIAS UVI DARA RPW DWP EPAC DSLP HEED COSTEP MAG 3DEES EPD CIS GAS HIA EIT LIA EUI EDI GRB HID ERNE Metis PEACE HISCALE PEACE GOLF SPICE WHISPER SCE STAFF/DWP LASCO SO/PHI WBD SWICS AUX MDI Multi -experiment EFW SWOOPS SUMER RAPID URAP SWAN VHM/FGM UVCS VIRGO Done Ongoing Provided by the team
8 SPASE activities – “pipeline” Metadata currently available in data files. E.g. Solar Orbiter: CDF, FITS; and Cluster: CEF Use of ADAPT NASA tool to convert to XML SPASE datasets descriptions draft (provided by Lee Bargatze) Deep revision from Archive Scientists comparing data files and SPASE description (Thanks to Len Garcia) First iteration with the Instrument Team for team revision Applying corrections/comments from Instrument Teams Last iteration for green light and consent for personal data being public released Public release at HPA GitHub Mirror SPASE descriptions at HPDE Github and associated landing page at HPDE.io website
9 Summary •SPASE model evolution to accommodate ESA needs: •VariableCadence descriptions, specifying Cadence, CadenceMin and CadenceMax attributes. •ESA-NASA NamingAuthority - recognizes contributions from all institutions for collaborative missions. •ESA/PERSON folder contains the Person files for all stakeholders of ESA missions/Archive. •use of ESA/Person instead of SMWG/Person. •MetadataContact for ESA Heliophysics missions is set to be the archive science lead. •HPA team maintains HPA-ESDC-ESA-INT GitHub to publicly release HPA metadata descriptions using SPASE metadata model. •All SPASE descriptions are revised and approved by the instrument PI, before its public release. •Approval of datasets implies agreement with personal data notice. •First Instrument Team started producing their own SPASE metadata descriptions (ongoing). •Introduce the concept for future missions (SMILE and Proba3) that instrument teams are to provide the SPASE descriptions (knowledge of the instrument and produced datasets and their caveats).