In as uc u e Manage :
TOSCA-based cloud o ches a ion and
deploymen
Miguel Caballe - [email p o ec ed]
In oduc ion (I)
"A long ime ago, in a da a cen e a , a away, an ancien g oup o
powe ul beings known as sysadmins used o deploy in as uc u e
manually. E e y se e , e e y ou e able en y, e e y da abase
configu a ion, and e e y load balance was c ea ed and managed by hand.
I was a da k and ea ul age: ea o down ime, ea o acciden al
misconfigu a ion, ea o slow and agile deploymen s, and ea o wha
would happen i he sysadmins ell o he da k side (i.e. ook a aca ion).
The good news is ha hanks o he De Ops Rebel Alliance, we now ha e
a be e way o do hings: In as uc u e-as-Code (IAC)."
Sou ce h ps://blog.g un wo k.io/
In oduc ion (II)
In as uc u e as code (IaC) is he p ocess o managing and p o isioning compu e da a cen e s
h ough machine- eadable defini ion files, a he han physical ha dwa e configu a ion o in e ac i e
configu a ion ools. Benefi s:
●You can au oma e you en i e p o isioning and deploymen p ocess, which makes i much as e and mo e
eliable han any manual p ocess.
●You can s o e hose sou ce files in e sion con ol, which means he en i e his o y o you in as uc u e is now
cap u ed in he commi log, which you can use o debug p oblems, and i necessa y, oll back o olde e sions.
●You can alida e each in as uc u e change h ough code e iews and au oma ed es s.
●You can c ea e a lib a y o eusable, documen ed, ba le- es ed in as uc u e code ha makes i easie o scale
and e ol e you in as uc u e.
The e a e se e al ools o manage in as uc u e-as-code, bu he mos well-known ones a e
Ansible, Puppe , Che , Sal s ack, Te a o m and CloudFo ma ion.
In oduc ion (III)
In as uc u e Manage (IM) ollows his p inciple, i allows use s o au oma e he
deploymen and configu a ion p ocess o i ual in as uc u es on op o cloud esou ces.
Wi h his ool:
●You can au oma e you en i e p o isioning and deploymen p ocess, which makes i
much as e and mo e eliable han any manual p ocess.
●You can use he same defini ion empla es o p o ision he e y same i ual
in as uc u e in di e en Cloud p o ide s.
●You can use he OASIS TOSCA Simple P ofile in YAML s anda d o desc ibe you cloud
opologies.
●You can s o e hose sou ce files in e sion con ol, which means he en i e his o y o you
in as uc u e is now cap u ed in he commi log, which you can use o debug p oblems,
and i necessa y, oll back o olde e sions.
●IM is a se ice ha deploys i ual in as uc u es on op o Cloud esou ces.
●I uses RADL o TOSCA files o desc ibe he in as uc u e.
○In as uc u e as code (IaC)
●The IM au oma es he deploymen , configu a ion, so wa e ins alla ion,
moni o ing and upda e o i ual in as uc u es.
●I suppo s a wide a ie y o back-ends, hus
making use applica ions Cloud agnos ic.
IM In oduc ion
Gene al View
●Gene al pla o m o deploy on demand cus omizable i ual compu ing
in as uc u es.
○Wi h he p ecise so wa e configu a ion equi ed.
○Allow o deploy any kind o complex in as uc u e.
○Sha e In as uc u e desc ip ions.
○No need o p e-packaged VMIs.
■Enable e-using o VMIs.
○The same complex in as uc u e can be deployed
bo h on-p emise and in a public Cloud.
IM ea u es
●I ea u es De Ops capabili ies.
○Based on Ansible.
○P o ides ecipes o common deploymen s.
○Also suppo ing cloud-ini sc ip s.
●IM wo ks as a se ice ha o e s se e al in e aces:
○XML-RPC and REST APIs.
○Command-line applica ion.
○Web-based GUI.
●I is dis ibu ed unde a GNU GPL 3.0 open sou ce license
and i s sou ce code is a ailable on Gi Hub.
h ps://gi hub.com/g ycap/im
Cloud P o ide s
●I suppo s a wide ange o cloud p o ide s and o he compu ing
back-ends:
○Public: Amazon Web Se ices (AWS), Google
Cloud Pla o m (GCP), Mic oso Azu e, Linode,
T-Sys ems OTC, Exoscale, Cloud&Hea , O ange
Cloud.
○On-p emises: OpenNebula, OpenS ack,
CloudS ack, VMWa e.
○Fede a ed: EGI Cloud Compu e, FogBow.
○Con aine s: Docke , Kube ne es
○The lis abo e can be easily ex ended by
plugins.
IM - Wo king Scheme
●The use can p o ide an RADL o TOSCA documen s as inpu o he IM, desc ibing
he in as uc u e:
○RADL: Resou ce and Applica ion Desc ip ion Language.
■High le el Language o define i ual in as uc u es and Speci y VM equi emen s.
○TOSCA: OASIS S anda d
■Open s anda d language o model applica ion a chi ec u es o be deployed on a
Cloud.
●Publicly-a ailable web in e ace (also open-sou ced).
○h ps://im.egi.eu
■Login wi h EGI Checkin.
■In eg a ed wi h AppDB.
○Easily deploy in as uc u es om a web b owse
■Se o cu a ed TOSCA empla es.
■Wiza d-like composi ion o empla es.
●Pa o he EGI Ca alog o Se ices o Resea ch.
GUI: IM Dashboa d
●Easy in e ace
○Fo non ad anced use s
○Easily deploy in as uc u es om a web b owse
■Selec i om a lis o configu able lis o empla es.
GUI: IM Dashboa d
APIs o be consumed by Clien s
●XML-RPC API
○API ha ollows he XML-RPC specifica ion.
●REST API
○IM Se ice can be accessed
h ough a REST( ul) API
○Follows OpenAPI Specifica ion
Mo e in o:
●h ps://app.swagge hub.com/apis/g ycap/In as uc u eManage /
●h p://www.g ycap.up .es/im/documen a ion.php
IM A chi ec u e
●CLUES o au oma ed elas ici y.
○T igge s he addi ion/ emo al o nodes in a
i ual clus e .
●Vaul o secu ely s o e c eden ials.
○Cloud c eden ials a e e ie ed di ec ly om
he Vaul ins ance.
●Ansible o con ex ualiza ion.
●AppDB o ge EGI si es in o ma ion.
●Cloud con inuum suppo .
○Enable o manage edge de ices:
■OSCAR
■Kube ne es
Demo: He e ogenous Jupy e Hub clus e on K8s
●Deploy a Jupy e Hub
se ice on op o a
Kube ne es
he e ogeneous
clus e wi h GPU
suppo .
A Decade o E olu ion in he IM
●IM deploys he i ualized in as uc u e
equi ed o execu ing AI models along he
compu ing con inuum
○Kube ne es clus e s, InfluxDB, OSCAR clus e s, e c.
Usage Examples o IM in Eu opean P ojec s (I)
h ps://www.ai-sp in -p ojec .eu/
h ps://d geo.eu
●IM deploys cus omized SLURM-based clus e s
ha a e used o scien is s o ain he
compu ing skills equi ed be o e execu ing on a
supe compu e (e.g. Ma enos um)
●IM deploys he i ualized in as uc u e equi ed o
pe o ming eal- ime da a inges ion and deploy he
engines equi ed o Digi al Twins.
○Ka ka, Ai Flow, MLFlow, yP o , Ho o od, Galaxy, e c.
Usage Examples o IM in Eu opean P ojec s (II)
h ps://in e win.eu
h ps://ai4eosc.eu
●IM deploys p e- ained AI models om he
AI4EOSC Ma ke place in mul iple Cloud pla o ms
in a consis en and ep oducible manne .
IM In o Web:
h ps://g ycap.up .es/im/
Video demos in YouTube:
h ps://you ube.com/playlis ?lis =PLgPH186Qwh_37AMhE uhVKZS oYpHk Up
IM images in Docke Hub and Gi Hub Con aine Regis y:
h ps://gi hub.com/g ycap/im/pkgs/con aine /im
h ps://gi hub.com/g ycap/im-dashboa d/pkgs/con aine /im-dashboa d
Sou ce Code in Gi Hub:
h ps://gi hub.com/g ycap/im
h ps://gi hub.com/g ycap/im-dashboa d
Mo e In o ma ion
Con ac
Miguel Caballe
mica e 1@up .es
Ins i u o de Ins umen ación pa a la Imagen Molecula (I3M)
Uni e si a Poli ècnica de València
Ge mán Mol ó
gmol [email p o ec ed].es
