Deli e able D1.5
De Ops me hodology and CI/CD s a egy o EMERALD-
1
Edi o (s):
Go ka Bengu ia Elguezabal, Iñaki E xaniz (TECNALIA)
Responsible Pa ne :
TECNALIA Resea ch and Inno a ion
S a us-Ve sion:
Final - 1.0
Da e:
30.04.2024
Type:
R
Dis ibu ion le el (SEN, PU):
PU
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 2 o 26
www.eme ald-he.eu
P ojec Numbe :
101120688
P ojec Ti le:
EMERALD
Ti le o Deli e able:
D1.5 De Ops me hodology and CI/CD s a egy o
EMERALD- 1
Due Da e o Deli e y o he EC
30.04.2024
Wo k package esponsible o he
Deli e able:
WP1 - Concep and me hodology o EMERALD
Edi o (s):
Go ka Bengu ia Elguezabal, Iñaki E xaniz (TECNALIA)
Con ibu o (s):
Re iewe (s):
F anz Deimling (FABA), C is ina Ma ínez (TECNALIA,
Juncal Alonso (TECNALIA)
App o ed by:
All Pa ne s
Recommended/manda o y
eade s:
WP1, WP2, WP3, WP4, WP5
Abs ac :
Ini ial e sion o he desc ip ion o he De Ops s a egy
and se ing up o CI/CD en i onmen s. De ails he
De Ops in as uc u e and ools o suppo he
con inuous in eg a ion and deploymen phases.
Desc ibes he CI/CD s a egy o he in eg a ion o he
EMERALD F amewo k.
Keywo d Lis :
De Ops, CI/CD, In eg a ion, Con aine , En i onmen ,
Releases
Licensing in o ma ion:
This wo k is licensed unde C ea i e Commons
A ibu ion-Sha eAlike 4.0 In e na ional (CC BY-SA 4.0
DEED h ps://c ea i ecommons.o g/licenses/by-sa/4.0/
Disclaime
Funded by he Eu opean Union. Views and opinions
exp essed a e howe e hose o he au ho (s) only and
do no necessa ily e lec hose o he Eu opean Union.
The Eu opean Union canno be held esponsible o
hem.
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 3 o 26
www.eme ald-he.eu
Documen Desc ip ion
Ve sion
Da e
Modi ica ions In oduced
Modi ica ion Reason
Modi ied by
0.1
15.04.2024
Fi s d a e sion
TECNALIA
0.2
17.04.2024
Typos co ec ed and s yle polished.
Sen o in e nal QA e iew
TECNALIA
0.3
22.04.2024
QA Re iew
F anz Deimling (FABA)
0.4
26.04.2024
Add essed all commen s ecei ed in
he In e nal QA e iew
TECNALIA
1.0
30.04.2024
Submi ed o he Eu opean
Commission
C is ina Ma ínez
(TECNALIA)
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 4 o 26
www.eme ald-he.eu
Table o con en s
Te ms and abb e ia ions ............................................................................................................... 5
Execu i e Summa y ....................................................................................................................... 6
1 In oduc ion ............................................................................................................................. 7
1.1 Abou his deli e able .................................................................................................... 7
1.2 Documen S uc u e ...................................................................................................... 8
2 De Ops Me hodology .............................................................................................................. 9
2.1 Con ex ........................................................................................................................... 9
2.2 Goals .............................................................................................................................. 9
2.3 P ocesses ..................................................................................................................... 10
2.4 Li ecycle ....................................................................................................................... 13
3 CI/CD S a egy ........................................................................................................................ 15
3.1 CI S a egy .................................................................................................................... 15
3.1.1 Con aine -based ................................................................................................ 15
3.1.2 En i onmen s wi h IaC ...................................................................................... 16
3.1.3 P og essi e Ve i ica ion ..................................................................................... 16
3.1.4 Au oma ion ........................................................................................................ 17
3.2 CD S a egy .................................................................................................................. 17
3.2.1 Releases ............................................................................................................. 17
3.2.2 Documen a ion .................................................................................................. 18
3.2.3 En i onmen s wi h IaC ...................................................................................... 18
3.2.4 Au oma ion ........................................................................................................ 18
4 Conclusions ............................................................................................................................ 20
5 Re e ences.............................................................................................................................. 21
APPENDIX A: P ojec Risks and impac in he De Ops me hodology ......................................... 23
APPENDIX B: P ojec Miles ones om DoA ................................................................................ 25
Lis o igu es
FIGURE 1. DEVOPS CYCLE ................................................................................................................. 11
FIGURE 2. LIST OF ISSUES RELATED TO CONCEPT & METHODOLOGY IN EMERALD ..................................... 13
FIGURE 3. A MERGE REQUEST RELATED TO CONCEPT & METHODOLOGY IN EMERALD .............................. 14
FIGURE 4. A MERGE REQUEST MECHANISM TO PRODUCE A NEW RELEASE IN EMERALD............................. 18
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 5 o 26
www.eme ald-he.eu
Te ms and abb e ia ions
CaaS
Ce i ica ion as a Se ice
CI
Con inuous In eg a ion
CD
Con inuous Deploymen
CMMI
Capabili y Ma u i y Model In eg a ion
CSA o EU CSA
EU Cybe secu i y Ac
CSP
Cloud Se ice P o ide
DoA
Desc ip ion o Ac ion
EC
Eu opean Commission
GA
G an Ag eemen o he p ojec
KPI
Key Pe o mance Indica o
IaC
In as uc u e as Code
ISO
In e na ional O ganiza ion o S anda diza ion
ITIL
In o ma ion Technology In as uc u e Lib a y
SW
So wa e
TRL
Technology Readiness Le el
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 6 o 26
www.eme ald-he.eu
Execu i e Summa y
EMERALD CaaS (Ce i ica ion-as-a-Se ice) F amewo k is buil up by se e al componen s. These
componen s ha e di e en le els o ma u i y and a e de eloped by di e en g oups. This
supposes a challenge when acing he in eg a ion o he CaaS F amewo k as a whole. On he
alida ion side, he p ojec has di e en pilo s, each one wi h hei needs and cons ains.
This documen desc ibes he De Ops Me hodology and CI/CD (Con inuous
In eg a ion/Con inuous Deploymen ) s a egies ha a e applied o he de elopmen o he
Ce i ica ion-as-a-Se ice (CaaS) F amewo k o manage he he e ogenei y o he componen s,
and o coo dina e he di e en eams in he de elopmen and ope a ion sides.
The documen audience is he EMERALD pa icipan s in cha ge o he coo dina ion o he
de elopmen and ope a ion ac i i ies. Besides, he documen is also ocussed o p o ide
in o ma ion o he es o pa ne s in he unde s anding on how he EMERALD CaaS F amewo k
was managed om a De Ops pe spec i e.
The documen also includes a pai o annexes ha p o ide ex a in o ma ion abou he p ojec ,
ha could help he eade g asp he con ex o he p ojec . Namely, hey include he isks and
he miles ones de ined in he Desc ip ion o Ac ion (DoA).
This documen is he i s e sion o he de elopmen and ope a ion coo dina ion app oach,
ha will be applied as a baseline du ing he i s s age o he p ojec . Du ing his i s s age, some
insigh s will su ely be ound. These lessons lea ned will be desc ibed in he nex e sion o he
documen , and om hem some modi ica ion o he app oach can be de i ed, ha will be
documen ed as well.
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 7 o 26
www.eme ald-he.eu
1 In oduc ion
This sec ion in oduces he con ex o he p ojec , he aim and audience o he con en and he
documen s uc u e. This deli e able is he esul o ask T1.3 Con inuous in eg a ion and
op imiza ion, and de ails he line o ac ion o be ollowed in he p ojec o achie e a smoo h and
quick ansi ion among he de elope s wo k and he inal esul : he EMERALD amewo k
deployed in he pilo s.
1.1 Abou his deli e able
F om he p ojec mission:
“EMERALD’s mission is o p o ide a use - iendly amewo k o help s akeholde s in he
cybe secu i y ield e icien ly manage ce i ica ions, enhancing he secu i y and e ec i eness o
cloud se ice usage. The p oposed EMERALD en i onmen will be he ounda ion o de ining a
new se ice o assis ing he ce i ica ion p ocess ha we named Ce i ica ion-as-a-Se ice
(CaaS).” [1]
To con ibu e o ha mission, his deli e able desc ibes he echnical coo dina ion app oach
ha will be ollowed in he EMERALD p ojec o con inuously in eg a e, upda e, and alida e
ha amewo k, he e in a e e e ed as CaaS F amewo k. The elemen s o he app oach ha e
been de ined conside ing he EMERALD p ojec con ex and he planned CaaS F amewo k, ha
a e de ailed in nex chap e s.
• In his documen we desc ibe he wo main elemen s o he echnical coo dina ion
app oach: he De Ops Me hodology, and he CI/CD S a egy.
The De Ops Me hodology in EMERALD will ocus on how he de elopmen , in eg a ion and
alida ion eams will collabo a e o build and e ol e he CaaS F amewo k h ough hei planned
eleases o achie e he e ol ing equi emen s conside ing he EMERALD p ojec esou ces and
cons ains.
The CI/CD S a egy desc ibes he echnical app oaches o be applied o con inuously in eg a e
and deploy he ou comes om he di e en de elopmen eams o be alida ed by he in ol ed
pipelines. The con inuous in eg a ion (CI) deals wi h he in eg a ion o he di e en componen s
ha build up he CaaS F amewo k and he e i ica ion o he in eg a ed e sion so ha i is eady
o i s deploymen . The con inuous deploymen (CD) deals wi h he deploymen o he
in eg a ion e sion in he p oduc ion en i onmen and he equi ed pilo en i onmen s o hei
alida ion. Wi hin he con inuous deploymen we will also es ablish he mechanisms o manage
he eedback in o new o ex ended equi emen s.
This a ge audience o his documen is wo old:
• Fi s o all, he people in cha ge o De Ops managemen du ing he EMERALD p ojec .
Fo hem his documen should be a guide o managing he in eg a ion o he echnical
ou comes o he de elopmen eams, as well as he deploymen o he in eg a ed
e sions o hei alida ion.
• Secondly, his documen is also a ge ed o people ha wan o unde s and how he
CaaS F amewo k was de eloped. Fo hem i will also p o ide some esou ces ha will
be use ul o ex end o cus omize he CaaS o hei needs.
This documen is a i s e sion o he De Ops me hodology and CD/CI s a egy o EMERALD.
Ano he e sion will be eleased in mon h 18, whe e he indings on i s applica ion will be
de ailed, as well as any modi ica ion applied du ing ha pe iod (M1-M18) o o he upcoming
pe iod (M19-M36).
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 8 o 26
www.eme ald-he.eu
1.2 Documen S uc u e
The documen is o ganized in wo main sec ions:
• De Ops Me hodology
• CI/CD S a egy
The De Ops Me hodology sec ion, Sec ion 2, explains he ounda ions o he app oach ha will
be used o coo dina e he de elopmen and ope a ion in o he o con inuously in eg a e,
alida e and manage eedback o imp o e he CaaS F amewo k, conside ing he needs o he
EMERALD pilo s and he con ibu ions o he de elopmen eams.
The CI/CD S a egy sec ion, Sec ion 3, is spli in wo sec ions: he CI S a egy and he CD S a egy.
The CI S a egy desc ibes he p inciples ha will guide he in eg a ion o he di e en
componen s o he CaaS F amewo k p io o i s disposal o he pilo s. The CD S a egy desc ibes
he app oach o p o ide he in eg a ed e sions o he CaaS F amewo k o he pilo s o hei
alida ion, as well as he mechanisms o collec ha alida ion eedback o he con inuous
imp o emen o he upcoming CaaS F amewo k e sions.
Finally, Sec ion 4 p esen s he main conclusions o he documen .
In addi ion, he documen includes wo annexes (APPENDIX A: P ojec Risks and impac in he
De Ops me hodology and APPENDIX B: P ojec Miles ones om DoA) ha will suppo he
unde s anding o he documen pu pose and s uc u e, as well as he echnical implemen a ion
de ails o some speci ic asse s o he De Ops in as uc u e used.
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 9 o 26
www.eme ald-he.eu
2 De Ops Me hodology
This sec ion desc ibes he p ocess and he li ecycle ha will be applied in EMERALD o
coo dina e he de elopmen and ope a ion eams du ing he p ojec , o help in he achie emen
o he p ojec objec i es.
The sec ion also p esen s he challenges and isks aced by he EMERALD De Ops Me hodology.
F om hese challenges, we will de ine some op-le el goals o he De Ops Me hodology o be
applied. Then, we p esen he p ocess o be applied, whose main asks a e speci ied. Finally, he
so wa e li ecycle is p esen ed, ha desc ibes how he p ocess is applied o e ime.
2.1 Con ex
EMERALD p esen s some challenges and isk ha should be managed du ing he CaaS
F amewo k de elopmen . The Desc ip ion o Ac ion (DoA) o EMERALD [2] includes some isks
(see APPENDIX A: P ojec Risks and impac in he De Ops me hodology o mo e de ails and an
ex ended lis ) ha a e ele an o he de ini ion o he De Ops Me hodology:
• Use s expe ience low usabili y.
• EMERALD componen s a e no able o be ully in eg a ed.
• The implemen a ion does no co e all he use cases.
• Unde es ima ion o e o needed o comple e ac i i ies.
• Technology changes equi e signi ican edesign o he EMERALD a chi ec u e.
• A pa ne ails o mee he obliga ions and becomes non-pe o ming o e en de aul ing.
Apa om hese isks, enume a ed in he DoA, he e a e o he challenges o be conside ed
du ing he De Ops me hodology elabo a ion:
• We a e aiming a TRL7 [3] Sys em/p ocess p o o ype demons a ion in an ope a ional
en i onmen (in eg a ed pilo sys em le el).
• We ha e di e en componen s wi h di e en equi emen se s, di e en eams, and
di e en agendas.
• We ha e ixed miles ones (APPENDIX B: P ojec Miles ones om DoA) a p ojec le el
ha should be achie ed.
• The CaaS F amewo k will be deployed as a Se ice. Tha implies o in eg a e and es all
he componen s in a p oduc ion g ade se ice en i onmen .
• Some pilo s, due o in e nal policies, may equi e deploying he amewo k o
alida ion in e nally.
2.2 Goals
Based on he isk and challenges es ablished, he De Ops Me hodology we a e aiming o should
ha e he ollowing cha ac e is ics.
• Release based: We need a elease-based me hodology because he DoA has s a ed an
i e a i e app oach o he CaaS F amewo k, whe e a leas h ee eleases a e going o
be p o ided. The e o e, a minimum o h ee e sions a e expec ed, wi h some
in e media e e sions ha can be mo i a ed by o he miles ones o he p ojec .
• Manage he eedback: The p ojec aims a TRL7 ou come. Tha implies ha a he end
o he p ojec , apa o being inished, he sys em mus be alida ed in eal li e
en i onmen s. The p ojec has se e al alida ion cycles planned, and he me hodology
should keep ack o he issues aised du ing hese ac i i ies o make su e hey a e
managed.
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 16 o 26
www.eme ald-he.eu
o Example o a docke compose ile.
o Readme ile wi h indica ions on how o in eg a e he componen .
• These examples will include guides on how o in eg a e i on he componen s ha a e
s o ed in he Gi lab amewo k used in he EMERALD p ojec .
• I necessa y, WP1 will p o ide suppo in he in eg a ion o he gi lab-ci, and in he
de elopmen o Docke and Docke compose. This will be managed h ough a me ge
eques om he in e es ed pa y, ha will be documen ed in an issue ela ed o a
p ojec equi emen .
3.1.2 En i onmen s wi h IaC
The en i onmen s ha suppo he CaaS F amewo k in eg a ion and alida ion will be
de eloped ollowing an IaC app oach wi h s a e o he p ac ice open-sou ce ools.
The in eg a ion en i onmen has been de eloped ollowing his app oach. Fo ha , a p ojec
has been c ea ed in he p i a e Gi Lab o EMERALD (/de ops/open o u-k8s ). This p ojec
c ea es a ou -node Kube ne es clus e o e Sphe e pla o m. The p ojec includes ins uc ions
o eplica e he deploymen on ano he Sphe e pla o m i necessa y. In addi ion, i uses a
eusable se o Ansible playbooks o con igu e EMERALD Kube ne es ha ha e been applied in
his case, bu could be applied on o he nodes wi h li le o no cus omiza ion.
The IaC is con igu able h ough he modi ica ion o wo empla ed yaml iles:
• Base OpenTo u hos s: (/blob/mas e /base_open o u_hos s.yaml.e b), his con ols he
ini ial c ea ion o he i ual machines and hei con igu a ion by Ansible.
• Ansible hos : (/blob/mas e /Ansible_hos s.yaml.e b), his con igu es he machines
using some Ansible-playbooks.
The same app oach will be ollowed o he ins an ia ion o o he en i onmen and esou ces,
so ha we can eplica e hem in case we need o do so in la e s ages o he p ojec .
In he same way ha any o he ac i i y in he De Ops eam, he IaC de elopmen will be
documen ed in an issue ela ed o an EMERALD p ojec equi emen and implemen ed h ough
a me ge eques .
3.1.3 P og essi e Ve i ica ion
The e i ica ion o he added and upda ed componen s o he CaaS F amewo k is an impo an
aspec o ensu e he secu e e olu ion o he pla o m du ing he p ojec . The e i ica ion will be
co e ed by a se o in eg a ion es s ha will be au oma ed.
The e i ica ion ac i i ies will ha e wo main ocusses:
• Es ablish he means o check he heal h o he componen s.
• De ine mo e complex in eg a ion es s based on de elope eques s and alida ion
eedback.
In he i s s age o he p ojec , as componen s a e added, p ocedu es should be implemen ed
o check he heal h o he componen s. These mechanisms will be used du ing he in eg a ion
es s pe o med a e he upda e o each componen , as well as du ing con inuous moni o ing.
As he p ojec ad ances, and based on eques s om he de elope s and eedback om he
pilo s, addi ional in eg a ion es s will be added.
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 17 o 26
www.eme ald-he.eu
The s a egy in EMERALD will be o documen e i ica ion- ocussed ac i i ies as issues linked o
equi emen s. Implemen ing means o check he heal h o a componen may equi e
implemen ing pa s in he cho eog aphy and pa s in he componen i sel . Mo e complex
in eg a ion may equi e implemen ing speci ic componen s o gene a e he ac i i y equi ed o
e i y such complex in eg a ion scena ios.
3.1.4 Au oma ion
De Ops ac i i ies will ocus on he au oma ion o all he ac i i ies ela ed o he e alua ion o
componen s as hey a e upda ed by he de elope s. The main ocuses o au oma ion will be:
• Upda e he in eg a ion pla o m as he de elope s upda e he componen s.
• Run he in eg a ion es as he pla o m is upda ed.
• Upda e he moni o ing mechanism o measu e he heal h o he CaaS F amewo k in
he long e m.
The s a egy will be o use Gi Lab Agen o Kube ne es, implemen ed in he de ops eposi o y
(de ops/gi lab-agen -k8s ). I moni o s he CaaS F amewo k eposi o y, and e e y change
de ec ed he e will be ansla ed in o he aimed en i onmen s. I will allow us o deploy new
componen e sions di ec ly, wi hou in eg a ion es ing. This is done o speed up he eedback
o he de elopmen eam. In eg a ion es s will be s a ed a a la e s age, using a Gi lab unne .
The moni o ing mechanism will be upda ed ollowing he same app oach as he CaaS
F amewo k. Tha is, we will use he Gi lab Agen o Kube ne es o his pu pose as well.
3.2 CD S a egy
Fo he deploymen o he CaaS F amewo k o be e alua ed by he p ojec and he pilo s, he
ollowing echnological app oaches will be applied:
• Releases
• Documen a ion
• En i onmen de ined wi h IaC
• Deploymen au oma ion
3.2.1 Releases
The p ojec will ollow a e sioning sys em wi h h ee mayo eleases:
• 1.0.0 - Fi s elease o he EMERALD componen s in mon h 18
• 2.0.0 - Second elease o EMERALD componen s in mon h 30
• 3.0.0 - Final elease o EMERALD in eg a ed audi sui e in mon h 34
Addi ional eleases a e expec ed be ween hose mayo eleases, as he p ojec ad ances and
he CaaS F amewo k is alida ed. Ve sions 0.x.x will be c ea ed du ing he i s i e a ions o he
p ojec be o e he mon h 12. Ve sions 3.x.x a e also expec ed based on he eedback o he las
alida ion ac i i ies.
The s a egy o he eleases will s a wi h a pe i ion om an EMERALD pa ne . Basically, he
elease consis s o mo ing he con en in he in eg a ion b anch o he p oduc ion b anch. To
pe o m his p ocess an issue will be c ea ed desc ibing he eques and he pu pose. F om ha
issue a new d a me ge eques will be c ea ed o e he p oduc ion b anch. Tha will c ea e a
new wo king b anch, whe e we will mo e he in eg a ion e sion ha we wan o mo e in o
p oduc ion. The in eg a ion e sion o be deployed should ha e been success ully e i ied wi h
he in eg a ion es s, o he wise we will no i y he isk be o e p oceeding. A e ha , we change
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 18 o 26
www.eme ald-he.eu
emo e he d a s a us on he me ge eques , ha will enable he me ge ac ion o e he
p oduc ion b anch. We pe o m he Me ging ha will upda e he p oduc ion e sion. Finally, we
communica e he change o he EMERALD p ojec .
Figu e 4. A Me ge Reques mechanism o p oduce a new elease in EMERALD
3.2.2 Documen a ion
The documen a ion ega ding he CaaS F amewo k will be gene a ed as pa o he deploymen
o p oduc ion. The ocus o he documen a ion will be in he deploymen and con igu a ion o
he pilo s.
The s a egy o he documen a ion will be ela ed wi h he changes in he IaC ela ed wi h he
en i onmen and he CaaS F amewo k i sel .
3.2.3 En i onmen s wi h IaC
The p oduc ion en i onmen will be deployed using IaC, wi h he same app oach used o he
in eg a ion en i onmen . Besides, he De Ops eam will suppo he gene a ion o addi ional
en i onmen s, i needed. Fo example, en i onmen s on pilo ’s p emises due o p i acy o legal
es ic ions.
The s a egy o he p oduc ion en i onmen IaC will be simila o he s a egy wi h he
in eg a ion IaC, i.e., as any o he ac i i y in he De Ops eam, i will be documen ed in an issue
ela ed o an EMERALD p ojec equi emen , and implemen ed h ough a me ge eques .
3.2.4 Au oma ion
The De Ops s a egy will wo k owa ds he au oma ion o all ac i i ies ela ed o he c ea ion o
eleases and hei deploymen in he p oduc ion en i onmen . The main ocuses o au oma ion
will be:
• Deploying speci ic eleases o speci ic en i onmen s.
• Upda ing he moni o ing mechanism o measu e he long- e m heal h o he CaaS
F amewo k.
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 19 o 26
www.eme ald-he.eu
The au oma ion s a egy du ing deploymen will be simila o ha o he in eg a ion. We will
use Gi Lab Agen o Kube ne es o ansla e new eleases on he p oduc ion en i onmen . Fo
he pilo en i onmen s, we will lea e i up o he pilo owne s o decide he p ocedu e o
upda ing hei espec i e en i onmen s.
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 20 o 26
www.eme ald-he.eu
4 Conclusions
This documen p esen s he De Ops me hodology and he CI/CD s a egy o be applied o in he
EMERALD p ojec .
The me hodology used cus omizes he commonly used De Ops li ecycle o he cha ac e is ics
and cons ains o he EMERALD p ojec . This li ecycle consis s o he ollowing s eps: Plan, Code,
Build, Tes , Release, Deploy, Ope a e, and Moni o . The goals o he de ined me hodology a e:
o be elease-based; manage eedback; manage componen s; keep aceabili y; manage he
en i onmen s; and in eg a e as soon as possible. In his line, we ha e p esen ed he main
cus omised p ocesses, as well as a ailo ed app oach o i e a e, so ha we p io i ise speed o
in eg a ion o e o he elemen s.
In he s a egy pa we ha e desc ibed he echnical app oaches ha we will implemen o
suppo he EMERALD p ojec needs. In his sense, we will le e age some echnologies and s a e
o he p ac ice De Ops esou ces, such as:
• Con igu a ion managemen wi h IaC
• Gi lab ea u es wi h espec o:
o Issues
o Gi wo k lows (b anches and me ge eques s)
o Au oma ion wi h Gi Lab ci
o Documen a ion
• Releases wi h con aine s
• Con aine o ches a ion echnologies
This documen is he i s e sion o he De Ops app oach o EMERALD, whe e we ha e
es ablished he baselines o he De Ops wo k. In a yea ’s ime, we will p o ide an upda ed
e sion wi h an in-dep h desc ip ion o he lessons lea n , possible modi ica ions o he p ocess
and de ails o he IaC de eloped.
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 21 o 26
www.eme ald-he.eu
5 Re e ences
[1]
EMERALD Conso ium, “Home page,” [Online]. A ailable: h ps://www.eme ald-he.eu/.
[Accessed Ap il 2014].
[2]
EMERALD Conso ium, “EMERALD - Annex 1 - Desc ip ion o Ac ion - GA 101120688,”
2022.
[3]
ISO, “ISO 16290:2013, Space sys ems — De ini ion o he Technology Readiness Le els
(TRLs) and hei c i e ia o assessmen ,” 2013.
[4]
CMMI De , “CMMI o De elopmen , Ve sion 1.3,” So wa e Enginee ing Ins i u e (SEI),
Ed., 2010.
[5]
In e na ional O ganisa ion o S anda diza ion (ISO/IEC), “ISO/IEC 15504-1:2004
In o ma ion Technology – P ocess Assessmen – Pa 1: Concep s and Vocabula y,” 2004.
[6]
AXELOS, “ITIL Founda ion,” S a ione y O ice Books, No wich, England, 2019.
[7]
J. A. V. M. K. Jayakody and a. W. M. J. I. Wijayanayake, “P ocess Imp o emen F amewo k
o De Ops Adop ion in So wa e De elopmen ,” in 2023 In e na ional Resea ch
Con e ence on Sma Compu ing and Sys ems Enginee ing (SCSE), IEEE, Jun. 2023. doi:
10.1109/scse59836.2023.10214992, 2023.
[8]
I. Bucena and M. Ki iko a, “Simpli ying he De Ops Adop ion P ocess,” in BIR Wo kshops,
pp. 1–15, 2017.
[9]
R. d. Feij e , “Towa ds he adop ion o De Ops in so wa e p oduc o ganiza ions: A
Ma u i y Model App oach,” Mas e ’s Thesis, 2017.
[10]
S. Badshah, A. A. Khan and B. Khan, “Towa ds P ocess Imp o emen in De Ops: A
Sys ema ic Li e a u e Re iew’,” in P oceedings o he E alua ion and Assessmen in
So wa e Enginee ing, EASE ’20. ACM, Ap . 2020. doi: 10.1145/3383219.3383280.
[11]
R. Ama o, R. Pe ei a and M. M. da Sil a, “Capabili ies and P ac ices in De Ops: A Mul i ocal
Li e a u e Re iew,” in IEEE T ans. So w. Eng., ol. 49, no. 2, pp. 883–901, Feb. 2023, doi:
10.1109/ se.2022.3166626.
[12]
M. Gaspa ai ė and S. Ragaišis, “Compa ison o de ops ma u i y models,” in IVUS 2019.
P oceedings o he In e na ional Con e ence on In o ma ion Technologies Kaunas,
Li huania, Ap il 25, 2019, CEUR-WS. o g, 2019, pp. 65–69.
[13]
R. T. Ya lagadda, “De Ops and i s p ac ices,” in In . J. C ea . Res. Though s IJCRT ISSN, pp.
2320–2882, 2021.
[14]
A. Colan oni, L. Be a dinelli and M. Wimme , “De opsML: Towa ds modeling de ops
p ocesses and pla o ms,” in P oceedings o he 23 d ACM/IEEE In e na ional Con e ence
on Model D i en Enginee ing Languages and Sys ems: Companion P oceedings, pp. 1–1,
2020.
[15]
R. Ama o, R. Pe ei a and M. M. da Sil a, “De Ops Me ics and KPIs: A Mul i ocal Li e a u e
Re iew,” in ACM Compu . Su ., Ma . 2024, doi: 10.1145/3652508.
[16]
A. V. Jha e al., “F om heo y o p ac ice: Unde s anding De Ops cul u e and mindse ,” in
Cogen Eng., ol. 10, no. 1, p. 2251758, 2023.
[17]
H. R. Kadaska , “Unleashing he Powe o De ops in So wa e De elopmen ,” in In . J. Sci.
Res. Mod. Sci. Technol., ol. 3, no. 3, pp. 01–07, 2024.
[18]
Wikipedia, “De Ops oolchain,” 20 Jan 2024. [Online]. A ailable:
h ps://en.wikipedia.o g/w/index.php? i le=De Ops_ oolchain&oldid=1197449470.
[Accessed Ap 2024].
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 22 o 26
www.eme ald-he.eu
[19]
A. M. Da is, E. H. Be so and a. E. R. Come , “A s a egy o compa ing al e na i e so wa e
de elopmen li e cycle models,” in IEEE T ans. So w. Eng., ol. 14, no. 10, pp. 1453–1461,
doi: 10.1109/32.6190, 1988.
[20]
A. Mish a and D. Dubey, “A compa a i e s udy o di e en so wa e de elopmen li e cycle
models in di e en scena ios,” in In . J. Ad . Res. Compu . Sci. Manag. S ud., ol. 1, no. 5,
2013.
[21]
“P oduc ion-G ade Con aine O ches a ion,” [Online]. A ailable: h ps://kube ne es.io/.
[Accessed Ap il 2024].
[22]
“Swa m mode o e iew, Docke Documen a ion,” [Online]. A ailable:
h ps://docs.docke .com/engine/swa m/. [Accessed Ap il 2024].
[23]
M. Kalske and o he s, “T ans o ming monoli hic a chi ec u e owa ds mic ose ice
a chi ec u e,” Uni . Hels., 2017.
[24]
J.-P. Gouigoux and D. Tamzali , “F om Monoli h o Mic ose ices: Lessons Lea ned on an
Indus ial Mig a ion o a Web O ien ed A chi ec u e,” in 2017 IEEE In e na ional
Con e ence on So wa e A chi ec u e Wo kshops (ICSAW), Go henbu g, F ance: IEEE, Ap .
2.
[25]
“Docke ile e e ence | Docke Docs,” [Online]. A ailable:
h ps://docs.docke .com/ e e ence/docke ile/. [Accessed Ap il 2024].
[26]
“Use Docke o build Docke images | Gi Lab,” [Online]. A ailable:
h ps://docs.gi lab.com/ee/ci/docke /using_docke _build.h ml. [Accessed Ap il 2024].
[27]
“OpenTo u,” [Online]. A ailable: h ps://open o u.o g/. [Accessed Ap il 2024].
[28]
“Homepage | Ansible Collabo a i e,” [Online]. A ailable: h ps://www.Ansible.com/.
[Accessed Ap il 2024].
[29]
“OpenAPI Speci ica ion - Ve sion 3.1.0 | Swagge ,” [Online]. A ailable:
h ps://swagge .io/speci ica ion/. [Accessed Ap il 2024].
[30]
EMERALD Conso ium, “D7.1 P ojec Manual and Quali y Plan,” 2024.
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 23 o 26
www.eme ald-he.eu
APPENDIX A: P ojec Risks and impac in he De Ops me hodology
This sec ion makes an analysis o some o he isks de ined in he p ojec – ini ially om
Desc ip ion o Ac ion [2] and hen ex ended in D7.1 [30]] - and he impac ha he De Ops
Me hodology can ha e o mi iga e hem. I is impo an o no e ha hese can e ol e as pa o
he EMERALD Task 7.2 Quali y Assu ance & Risk Managemen .
Risk n.
Desc ip ion
P oposed Mi iga ion Measu es
1
EUCS is no eady un il 2026.
No ele an .
2
Incompa ibili y be ween OSCAL and
EMERALD (da a impo /expo ,
modelling o secu i y schemes).
No ele an .
3
Use s expe ience low usabili y.
WP4 will wo k in he UI/UX concep . The
me hodology con ains ac i i ies o manage
eedback om pilo s.
4
EMERALD componen s a e no able
o be ully in eg a ed.
The me hodology should con ol which
componen s a e in eg a ed and which
componen s a e no in eg a ed.
5
Da a se no su icien o eaching
TRL7 on he e idence collec o
componen s.
No ele an . I should be con olled by he
alida ion ac i i ies as pa o o he wo k
packages.
6
The implemen a ion does no co e
all he use cases.
The me hodology deploymen ac i i ies
should keep ack o he use cases
in ol ed.
7
Unde es ima ion o e o needed o
comple e ac i i ies.
The me hodological app oach p omo es
sho cycles ha will help o iden i y hose
si ua ions as e . Besides, sho cycles will
ocus on ha ing unning e sions, and
clea e iew o wha is missing. .
8
Technology changes equi e
signi ican edesign o he EMERALD
a chi ec u e.
In eg a ion es s will help o e i y he
edesigned elemen s. This will speed up
he e i ica ion o e ac o ed componen s
as hey a e changed o he new
a chi ec u e.
9
A pa ne ails o mee he
obliga ions and becomes non-
pe o ming o e en de aul ing.
The me hodological app oach should
p omo e mul iple e sions o ha e pa ial
e sions (ins ead o no e sions) in ha
case.
10
Pa ne he e ogenei y:
The di e en o ganiza ional and
na ional cul u es cause collabo a ion
p oblems o con lic s in he p ojec
conso ium
The me hodology has been de ined a he
beginning o he p ojec , and he cla i y o
he p ocess pa es he way o an easie
collabo a ion.
13
P ojec execu ion isks:
a) key miles ones a e delayed
b) c i ical deli e ables a e delayed
The De Ops me hodology, b inging
oge he he wo k o de elope s,
in eg a o s and inal use s, helps o
mi iga e he possible delays.
14
P ojec key echnologies,
de elopmen isks:
a) Key echnologies o componen s
a e no a ailable a he expec ed
ime
The De Ops me hodology can be easily
adap ed o co e o he de elopmen
languages o echnologies.
The De Ops me hodology au oma es he
in eg a ion o he sou ce code, and hus
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 24 o 26
www.eme ald-he.eu
b) de elopmen akes longe han
expec ed
c) w ong echnology base is
selec ed
d) lacking consensus on he
echnological app oach be ween
scien i ic pa ne s
can speed up he deploymen o delayed
eleases o make hem a ailable o he
Use Cases.
25
Use case implemen a ion is poo
The De Ops me hodology will p oduce
h ee eleases, as de ined in he p ojec
plan, and he successi e eedbacks can
help making a be e inal implemen a ion.
Also, he IaC app oach o he De Ops
me hodology is a mi iga ion measu e.
D1.5 – De Ops me hodology
and CI/CD s a egy o EMERALD- 1 Ve sion 1.0 – Final. Da e: 30.04.2024
© EMERALD Conso ium Con ac No. GA 101120688 Page 25 o 26
www.eme ald-he.eu
APPENDIX B: P ojec Miles ones om DoA
This sec ion includes he p ojec miles one aken om he Desc ip ion o Ac ion (DoA) o
EMERALD [2].
#
Ti le
Valida ion
Mon h
1
P ojec baselines and
de ini ion. Pilo se -up.
Ce i ica ion G aph
Schema c ea ed.
• P ojec manual, public websi e. De ined he
dissemina ion, communica ion and ne wo king
s a egy.
• Ma ke analysis o EMERALD de eloped.
• Da a modelling o EMERALD componen s and
ini ial design and equi emen s o he
componen s.
• CD/CI me hodology o EMERALD de ined.
• Pilo s’ de ini ion and e alua ion s a egy se up.
9
2
Fi s elease o he
EMERALD componen s.
• EMERALD o e all design speci ica ion and
a chi ec u e
• Ini ial p o o ypes o he main componen s o
EMERALD.
12
3
Fi s elease o EMERALD
in eg a ed audi sui e. Fi s
e sion o he EMERALD
business models and plans,
communica ion and
dissemina ion epo .
• Ini ial p o o ype o he EMERALD in eg a ed
solu ion wi h he unc ionali ies implemen ed a
M12.
• Fi s e sions o he EMERALD business models
dissemina ion and communica ion epo s.
• Second e sion o EMERALD CD/CI
me hodology.
18
4
Fi s implemen a ion and
e alua ion o he i s
elease o he EMERALD
solu ion in he pilo s.
• Fi s implemen a ion o he i s elease o he
EMERALD ools in he use cases
20
5
Second elease o
EMERALD componen s.
• Second e sion o he EMERALD a chi ec u e.
• Second eleases o he main componen s o
EMERALD.
24
6
Second elease o
EMERALD in eg a ed audi
sui e.
• Second p o o ype o he EMERALD in eg a ed
solu ion wi h he unc ionali ies implemen ed a
M24.
30
7
Second implemen a ion
and e alua ion o he
second elease o he
EMERALD solu ion in he
pilo s.
• Second implemen a ion o he second elease o
he EMERALD ools in he use cases.
32
8
Final elease o EMERALD
in eg a ed audi sui e.
• Final p o o ype o he EMERALD in eg a ed
solu ion wi h eedback om he second
e alua ion o he pilo s.
34
9
Final e alua ion epo and
impac analysis. Final
e sion o he EMERALD
business models and plans,
• Final e alua ion and impac analysis om he
pilo s.
• Final e sions o he EMERALD business models
dissemina ion and communica ion epo s.
36
