Metadata mappings and transformations for the PUNCH4NFDI Science Data Portal

Metadata mappings and transformations for the PUNCH4NFDI Science Data Portal Digital Research Products We present a systematic and scalable metadata framework that extends DataCite through the Digital Research Products (DRP) layer to the discipline-specific standards in PUNCH communities. Through mappings and transformations between these levels, we aim to enable easier dataset discovery, linking, workflow reproducibility and improve data reusability across the PUNCH Data Portal V. Tokareva*1, I. Knežević2, H. Enke3, A. Haungs1, C. Schmidt-Sonntag4, A. K. Mistry2 PUNCH4NFDI on ZENODO Particles, Universe, NuClei and Hadrons for the NFDI – the consortium of particle, astroparticle, hadron & nuclear physics and astronomy Future plans Metadata harvesting and transformation Metadata framework for PUNCH4NFDI Data Portal PUNCH4NFDI Communities and established [meta]data management practices ●PUNCH4NFDI is representing ~9000 scientists in Germany, who are involved in international research communities with established data management practices ●Multiple international and community standards (IVOA, LQCD, CERN Open Data, KCDC, NAPMIX), based on different data models and conventions ●Different levels of data reconstruction, from raw to processed to high-level analysis products ●High variety and heterogeneity of digital research outputs ●Particle physics Astroparticle physics Hadron & nuclear physics Astrophysics Digital research products (DRPs) containerize dynamical collection of datasets, software, workflows, relevant publications, project information, provenance data and all relevant metadata, used to create and modify the digital research output and necessary for its further interpretation and reuse. Dynamic sketch of DRP bit.ly/47FoMii Scan and find our first DRPs https://zenodo.org/ records/8358506 ●Support “live analysis” and “live peer review” by making workflows and code executable and modifiable ●Are executable using PUNCH federated infrastructure ●Allow search and analysis based on metadata and data properties (blind discovery) ●Promote reproducibility and transparency in data-intensive research ●Facilitate interdisciplinary reuse and open science ●Allow future reinterpretation and analysis of today’s data as new questions arise Motivation ●PUNCH4NFDI multi-layered metadata model: ○ Builds on the widely used DataCite Kernel required keywords ○ Supports incorporation of discipline-specific schemas from PUNCH communities ○ To support interoperability, OAI-PMH is adopted as a standard harvesting protocol ○ Metadata exchange format: XML, JSON ●Hierarchical approach. Higher-level data products reference lower-level ones, allowing metadata to efficiently reuse existing information ●Recursive model. Metadata records can link to datasets, workflows, algorithms, and other metadata, supporting traceability and reproducibility ●Schema comparison and alignment. Cross-community schema analysis defines what belongs at the common top level and how it maps to domain-specific metadata ●Curation continuum. Metadata ranges from minimal descriptions for short-term collaboration to enriched records for long-term preservation and reuse Have a question? Contact me! * Victoria Tokareva, [email protected] Or directly at: [email protected] https://results.punch4nfdi.de/ ●Further advance and standardization of the multi-layered metadata schema ●Development of user documentation ●Support the development of FAIR (Findable, Accessible, Interoperable, Reusable) DRPs on the Science Data Platform ●Documenting data curation policies and procedures within the SDP ●Enable metadata exchange via APIs and standard protocols ●Integration with European and international infrastructures Definition PUNCH4NFDI Science Data Platform Data Portal is the central element of the Science Data Platform, which serves as a habitat for the entire lifecycle of digital research products of PUNCH4NFDI Digital Research Products (DRP). 1 Karlsruhe Institute of Technology, Karlsruhe, Germany 2 GSI Helmholtz Centre for Heavy Ion Research, Darmstadt, Germany 3 Leibniz-Institute for Astrophysics, Potsdam, Germany 4 Univerist ¨at Bielefeld, Bielefeld, Germany This work is supported by the DFG fund ‘NFDI 39/1’ for the PUNCH4NFDI consortium https://zenodo.org/ records/16637860 DRP vs. FDO, s.6 PUNCH4NFDI.de ●Metadata records for the digital research products are being harvested in the Research Product Registry (RPR) ●RPR stores DRP metadata and preserves pointers to the [meta]data repositories, software environments (containers), and execution parameters ●Preferred harvesting method: OAI-PMH, with additional other supported endpoints (preferred REST based APis) ●Support integration of external data sources ●Architecture with a central harvester is proposed