IG High-Pe o mance Compu ing in
Ea h Sys em Sciences (HPC in ESS):
Ac i i y Repo by June 2023
o he IG:
S ephan F ickenhaus, Al ed Wegene Ins i u e (AWI, B eme ha en & U. B emen)
S ephan Hachinge , Leibniz Supe compu ing Cen e (LRZ, Ga ching b.M.)
1
2
IG HPC in ESS: Mo i a ion
Why FAIR is easie said han done in HPC
Obse a ion:
Reposi o ies a e pe ec ... bu :
... mos “a e age” eposi o ies canno
hold huge da ase s as p oduced in HPC
(in pa icula in ESS).
... ma ying RDM and FAIR p inciples wi h
compu a ional wo k lows is no easy.
FAIR „ s.“ HPC in ESS: Lo s o challenges!
▪Technical: Da ase s p oduced oo la ge o many eposi o ies –
sa elli e da a & global/la ge-scale high- esolu ion da ase s
▪Me hodical: Rep oducibili y –simula ion/analy ics ou pu
depends on compile swi ches, lib a ies, e c.
“Wild” communi y so wa e usage: ne CDF, eccodes, …
▪Adminis a i e: Compu ing needs g an s and accoun ing, bu
esea che s wan o quickly wo k whe e hei da a a e.
▪P ac ical: “E e yone alks while I ha e 1PB o handle!”
G ouping challenges:
Me ada a & Findabili y –Access –In e ope abili y –Fede a ion & Compu e- o-Da a
3
IG HPC in ESS: Mo i a ion
Ac i i y epo o he las yea
4
12 mee ings since 1s Plena y + 3 side-mee ings o Pilo p oposal
Online-mee ing pa icipan s
~12 dis inc pe sons
~6 pa icipan s e e y ime on a e age
Ins i u e pa icipa ion (numbe o people on mailing lis ):
AWI (4)
DKRZ (3)
DLR (2)
FZJ-JSC (1)
GEOMAR (1)
HEREON (1)
HLRS (2)
KIT (1)
LRZ (4)
MPI-BGC (1)
TU Be lin (1)
TUDD (2)
TUDD-ZIH (3)
TUM (1)
▪Ou pu : Pilo CAPICE
▪Ne wo king: 10.11.22 wo kshop wi h NHR „Fede a ed and FAIR Da a in HPC“
Ac i i y epo (con d., o yea be o e)
5
•Ou pu :
Publicly a ailable concep pape :
•Ne wo king: con ibu ion o NHR Wo skhop on RDM@HPC
h ps:// u-d esden.de/zih/hochleis ungs echnen/nh -e en s/ dm-nh -beyond
h ps://doi.o g/10.5281/zenodo.6565405
Plans: Concep Pape Upda e
6
▪Concep Pape had p esen ed 17 ecommenda ions
▪Gene al
▪On „(Me a-)da a Fo ma s, In e ope abili y and Rep oducibili y”
▪On „Fede a ed Access, Findabili y and Accessibili y“
▪Concep Pape ToDo‘s e e y ~18 (12-24) mon hs
▪S a us su ey w/ / ecommenda ions
▪Concep pape upda e (adap ing o wha has happened)
(new e sions o same Zenodo documen )
I means: We ha e wo k o he end o 2023 :)
Plans: Pilo P oposal „CAPICE“ &
Collabo a ion on Concep s wi h NHR & GCS
7
▪Dis ibu ed da a/modelling wo k low o ice shee modeling (CAPICE –
Combined Analysis and Publica ion o Ice-Shee Da a) as a concep es
▪Da a P ojec s wi h NHR and Gauss Alliance
▪In e ac ion wi h InHPC-DE p ojec (GCS cen es)
Wi h ou collabo a ions, we seek o maximise syne gies owa ds ou goals.
Thank You !
Wan o ge ac i e wi h us ?
Send a mail o s ephan. ickenhaus [@] awi.de and/o s ephan.hachinge [@] l z.de !
▪h ps://n di4ea h.de/2pa icipa e/ge -in ol ed-by-in e es -g oups/ig-high-pe o mance-compu ing-in-ea h-sys em-sciences
▪E e y 2nd Monday in he mon h we mee a 9:00 am
