Desc ip ion o ARLiD Da a Files (Ve sion 1)
Da a con ac : B andon Ke ns (bke [email protected])
P ojec PI: Shuyi S. Chen ([email protected])
The e a e ou se s o da a files, as b iefly desc ibed in he able below. TIMES is in o ma
YYYYMMDDHH_YYYYMMDDHH whe e he fi s (second) da e is he beginning (end) o he
acking pe iod. The acking pe iods a e in 5-yea inc emen s excep o 2020 – 2024,
which is 4 yea s.
File Name
Desc ip ion o Da a
a YYYYMMDDHH.nc
Ne CDF iles con aining he opical mois u e ex en ,
TPW blobs, IVT blobs, and po en ial AR objec s a each
ime.
lp _sys ems_a _{TIMES}. x
Human eadable AR sys ems in o ma ion. Fo each AR
sys em, a able is p o ided wi h he a ea, cen oid la i ude,
cen oid longi ude, and numbe o AR objec s a each
ime.
lp _sys ems_a _{TIMES}.nc
De ailed AR sys ems in o ma ion in a s uc u ed Ne CDF
o ma . In addi ion o he a iables in he . x ile, he
bounding box o he AR sys ems a each ime is gi en. A
lis o he g id poin s co esponding o each indi idual AR
sys em is also p o ided.
lp _composi e_mask_{TIMES}.nc
Spa io- empo al mask o all AR sys ems combined.
Bina y da a: 0 = no AR, 1 = AR.
Fo each se o files, he e is a a a chi e. The a a chi e con ains a file o each acking
yea . Fo he a _blob_da a, he files o each yea will be a .gz a chi es, which need o be
ex ac ed o see he indi idual files o each hou . Fo he h ee o he s, all he da a o he
acking yea a e in one file. Below is a desc ip ion o he da a in each file.
Example Jupy e no ebooks o using he da a a e p o ided in he Gi hub eposi o y:
h ps://gi hub.com/uwincm/a lid
LPT Sys ems Tex Files
Con ains some basic in o ma ion abou each AR sys em, in a human eadable o ma .
Each AR objec is p esen ed in a sepa a e able, wi h a heading o each able. He e is an
example o he op o he fi s able.
$ head -10 lp _sys ems_a _2020060100_2021063023. x
[16:53:07]
LPT nnnnn.nnnn
YYYYMMDDHH _A_[km2] cen_la .__ cen_lon.__ Nobj
LPT 0.1000
2020060100 1167505 45.41 303.81 1
2020060101 1185830 45.55 304.11 1
2020060102 1289723 44.83 303.40 1
2020060103 1462365 43.97 304.04 1
2020060104 1494749 44.04 304.25 1
2020060105 1544858 43.98 304.26 1
2020060106 1579681 43.93 304.22 1
cen_lon: cen oid longi ude
cen_la : cen oid la i ude
nobj: Numbe o objec s. (Should always be 1 wi h spli ing and me ging allowed).
AR Blob Da a (Includes Deep T opics Mask)
He e is he Ne CDF da a desc ip o , along wi h no es abou he ele an a iables in blue.
$ ncdump -h mask_da a/2020/01/a 2020010100.nc
[16:43:04]
ne cd a 2020010100 {
dimensions:
ime = 1 ;
la = 721 ;
lon = 1440 ;
a iables:
by e mask( ime, la , lon) ; The AR objec mask. 1 = Inside o AR
Objec .
mask:uni s = "1" ;
by e mask_i ( ime, la , lon) ; The IVT blobs mask. 1 = Inside o he
IVT blob.
mask_i :uni s = "1" ;
by e mask_ pw( ime, la , lon) ; The TPW blobs mask. 1 = Inside o he
TPW blob.
mask_ pw:uni s = "1" ;
by e opical_mois u e_ex en ( ime, la , lon) ; T opical mois u e
ex en . 1 = Inside, 0 = ou side.
deep_ opics_mask:uni s = "1" ;
double ime( ime) ; The e is one ime pe ile. This is he e in case
o agg ega ion o mul iple imes.
ime:_FillValue = NaN ;
ime:uni s = "seconds since 1970-1-1" ;
double lon(lon) ;
lon:_FillValue = NaN ;
lon:uni s = "deg ees_Eas " ;
double la (la ) ;
la :_FillValue = NaN ;
la :uni s = "deg ees_No h" ;
}
Spa io-Tempo al Mask Files (All ARs combined, o each ime s ep)
The file o ma is he same as o MJO LPT, bu he MJO specific a iables do no apply,
since he MJO e en de ec ion s ep is no ca ied ou (see h ps://gi hub.com/uwincm/lp -
py hon-public). No e ha he spa ial fil e and ime accumula ion ea u es o LPT we e no
used, so he masks ep esen ins an aneous a mosphe ic i e s. He e is he Ne CDF da a
desc ip o , along wi h no es abou he ele an a iables in blue.
Possible issues o be awa e o a e in ed.
$ ncdump -h lp _composi e_mask_2020060100_2021063023.nc
[17:04:32]
ne cd lp _composi e_mask_2020060100_2021063023 {
dimensions:
ime = UNLIMITED ; // (9480 cu en ly)
la = 721 ;
lon = 1440 ;
n = 1 ;
a iables:
loa g id_a ea(la , lon) ;
g id_a ea:_FillValue = NaN ;
g id_a ea:uni s = "km2" ;
g id_a ea:desc ip ion = "A ea o each g id cell." ;
in n(n) ; This dimension is no used.
in ime( ime) ;
ime:uni s = "hou s since 2020-06-01 00:00:00.000000" ;
ime:calenda = "s anda d" ;
loa lon(lon) ;
lon:_FillValue = NaN ;
lon:uni s = "deg ees_eas " ;
loa la (la ) ;
la :_FillValue = NaN ;
la :uni s = "deg ees_no h" ;
by e mask( ime, la , lon) ; Spa io- empo al mask o all ARs p esen
a each ime. 1 = inside an AR sys em. 0 = ou side.
mask:uni s = "1" ;
}
LPT Sys ems Ne CDF files (Cen oids, bulk in o, AR sys em g id poin s)
The file o ma is he same as o MJO LPT, bu he MJO specific a iables do no apply,
since he MJO e en de ec ion s ep is no ca ied ou (see h ps://gi hub.com/uwincm/lp -
py hon-public). He e is he Ne CDF da a desc ip o , along wi h no es abou he ele an
a iables in blue.
Possible issues o be awa e o a e in ed.
In his file, he da a o he indi idual AR Objec s a e s i ched oge he along he dimension
“ns i ch,” wi h missing/NaN alues in-be ween each sys em. Below i is indica ed which
a iables a e o he sys ems as a whole, e sus s i ched a iables gi ing da a h oughou
he li e cycles.
A common use case is ha you wan o ge he in o ma ion o he li e cycle o an indi idual
AR sys em, which you know he ID o . In his case, he s eps would be:
- Ge he a ay indices co esponding o he AR ID you wan (e.g., his_lp =
lp id_s i ched == his a _id)
- Ex ac he da a o he AR sys em (e.g., his_cen oid_lon =
cen oid_lon_s i ched[ his_lp ]).
Ano he use case is ha you wan o ga he o plo he da a o mul iple, o all, o he AR
sys ems. In his case, i you wan o plo all o hem, ake ad an age o he NaN alues
inbe ween each AR sys em, o example, o a quick ime-longi ude plo :
pl .plo (cen oid_lon_s i ched, imes amp_s i ched).
I you wan some bu no all o he ARs, you migh loop o e he “lp id” a iable.
Fo mo e examples, see he Jupy e no ebooks in he Gi hub eposi o y.
$ ncdump -h lp _sys ems_a _2020060100_2021063023.nc
[16:53:20]
ne cd lp _sys ems_a _2020060100_2021063023 {
dimensions:
nlp = 1416 ;
ns i ch = 158207 ; LPT sys ems s i ched oge he wi h missing/NaN
inbe ween hem.
nobj = 509 ;
npoin s = 13771 ; Dimension: Max poin s o any o he AR sys ems.
a iables:
These i s ew a iables apply o he AR sys ems as a whole.
double lp id(nlp ) ;
lp id:_FillValue = NaN ;
lp id:uni s = "1.0" ;
lp id:long_name = "LPT Sys em id" ;
in 64 lp _begin_index(nlp ) ;
lp _begin_index:uni s = "1" ;
lp _begin_index:long_name = "LPT Sys em beginning index (ze o-
based, Py hon con en ion)" ;
in 64 lp _end_index(nlp ) ;
lp _end_index:uni s = "1" ;
lp _end_index:long_name = "LPT Sys em ending index (ze o-based,
Py hon con en ion)" ;
double cen oid_lon_s a (nlp ) ;
cen oid_lon_s a :_FillValue = NaN ;
cen oid_lon_s a :uni s = "deg ees_eas " ;
cen oid_lon_s a :long_name = "s a ing longi ude (0-360)" ;
cen oid_lon_s a :s anda d_name = "longi ude" ;
double cen oid_la _s a (nlp ) ;
cen oid_la _s a :_FillValue = NaN ;
cen oid_la _s a :uni s = "deg ees_no h" ;
cen oid_la _s a :long_name = "s a ing la i ude (-90-90)" ;
cen oid_la _s a :s anda d_name = "longi ude" ;
double cen oid_lon_end(nlp ) ;
cen oid_lon_end:_FillValue = NaN ;
cen oid_lon_end:uni s = "deg ees_eas " ;
cen oid_lon_end:long_name = "ending longi ude (0-360)" ;
cen oid_lon_end:s anda d_name = "longi ude" ;
double cen oid_la _end(nlp ) ;
cen oid_la _end:_FillValue = NaN ;
cen oid_la _end:uni s = "deg ees_no h" ;
cen oid_la _end:long_name = "ending la i ude (-90-90)" ;
cen oid_la _end:s anda d_name = "longi ude" ;
double du a ion(nlp ) ;
du a ion:_FillValue = NaN ;
du a ion:uni s = "hou s" ;
du a ion:long_name = "LPT Sys em Du a ion" ;
double maxa ea(nlp ) ;
maxa ea:_FillValue = NaN ;
maxa ea:uni s = "km2" ;
maxa ea:long_name = "LPT Sys em a ea a ime o la ges ex en " ;
double zonal_p opaga ion_speed(nlp ) ; Unphysical alues o sys ems
ha c oss he p ime me idian!
zonal_p opaga ion_speed:_FillValue = NaN ;
zonal_p opaga ion_speed:uni s = "m s-1" ;
zonal_p opaga ion_speed:long_name = "Cen oid Zonal P opaga ion
Speed om leas squa es eg ession." ;
double me idional_p opaga ion_speed(nlp ) ;
me idional_p opaga ion_speed:_FillValue = NaN ;
me idional_p opaga ion_speed:uni s = "m s-1" ;
me idional_p opaga ion_speed:long_name = "Cen oid Me idional
P opaga ion Speed om leas squa es eg ession." ;
This nex sec ion is o each ime s ep o each AR sys em, s i ched oge he
wi h missing/NaN alues inbe ween he sys ems.
in 64 imes amp_s i ched(ns i ch) ; Time s amps o each en y in he
s i ched da a.
imes amp_s i ched:long_name = "LPT Sys em ime s amp --
s i ched" ;
imes amp_s i ched:uni s = "hou s since 2020-06-01
00:00:00.000000" ;
imes amp_s i ched:calenda = "s anda d" ;
double lp id_s i ched(ns i ch) ; AR sys em id co esponding o each
en y in he s i ched da a. This can be used o selec he ime se ies da a
o a speci ic sys em.
lp id_s i ched:_FillValue = NaN ;
lp id_s i ched:uni s = "1.0" ;
lp id_s i ched:long_name = "LPT Sys em id -- s i ched" ;
in nobj_s i ched(ns i ch) ;
double n_poin s_s i ched(ns i ch) ;
n_poin s_s i ched:_FillValue = NaN ;
double cen oid_lon_s i ched(ns i ch) ; Time se ies o cen oid lon
o each sys em.
cen oid_lon_s i ched:_FillValue = NaN ;
cen oid_lon_s i ched:uni s = "deg ees_eas " ;
cen oid_lon_s i ched:long_name = "cen oid longi ude, may be
inbe ween objec s (0-360) -- s i ched" ;
cen oid_lon_s i ched:s anda d_name = "longi ude" ;
double cen oid_la _s i ched(ns i ch) ; Time se ies o cen oid la
o each sys em.
cen oid_la _s i ched:_FillValue = NaN ;
cen oid_la _s i ched:uni s = "deg ees_no h" ;
cen oid_la _s i ched:long_name = "cen oid la i ude, may be
inbe ween objec s (-90-90) -- s i ched" ;
cen oid_la _s i ched:s anda d_name = "la i ude" ;
double la ges _objec _cen oid_lon_s i ched(ns i ch) ;
la ges _objec _cen oid_lon_s i ched:_FillValue = NaN ;
la ges _objec _cen oid_lon_s i ched:uni s = "deg ees_eas " ;
la ges _objec _cen oid_lon_s i ched:long_name = "cen oid
longi ude o he la ges con iguous objec (0-360) -- s i ched" ;
la ges _objec _cen oid_lon_s i ched:s anda d_name = "longi ude"
;
double la ges _objec _cen oid_la _s i ched(ns i ch) ;
la ges _objec _cen oid_la _s i ched:_FillValue = NaN ;
la ges _objec _cen oid_la _s i ched:uni s = "deg ees_no h" ;
la ges _objec _cen oid_la _s i ched:long_name = "cen oid
la i ude o he la ges con iguous objec (-90-90) -- s i ched" ;
la ges _objec _cen oid_la _s i ched:s anda d_name = "la i ude" ;
double a ea_s i ched(ns i ch) ; A ea o he AR sys ems a each ime.
a ea_s i ched:_FillValue = NaN ;
a ea_s i ched:uni s = "km2" ;
a ea_s i ched:long_name = "LPT Sys em enclosed a ea -- s i ched"
;
double max_lon_s i ched(ns i ch) ; Bounding box o he AR sys ems.
max_lon_s i ched:_FillValue = NaN ;
max_lon_s i ched:uni s = "deg ees_eas " ;
max_lon_s i ched:long_name = "max (eas mos ) longi ude (0-360) --
s i ched" ;
max_lon_s i ched:s anda d_name = "longi ude" ;
double max_la _s i ched(ns i ch) ; Bounding box o he AR sys ems.
max_la _s i ched:_FillValue = NaN ;
max_la _s i ched:uni s = "deg ees_no h" ;
max_la _s i ched:long_name = "max (no hmos ) la i ude (-90-90) -
- s i ched" ;
max_la _s i ched:s anda d_name = "longi ude" ;
double min_lon_s i ched(ns i ch) ; Bounding box o he AR sys ems.
min_lon_s i ched:_FillValue = NaN ;
min_lon_s i ched:uni s = "deg ees_eas " ;
min_lon_s i ched:long_name = "min (wes mos ) longi ude (0-360) --
s i ched" ;
min_lon_s i ched:s anda d_name = "longi ude" ;
double min_la _s i ched(ns i ch) ; Bounding box o he AR sys ems.
min_la _s i ched:_FillValue = NaN ;
min_la _s i ched:uni s = "deg ees_no h" ;
min_la _s i ched:long_name = "min (sou hmos ) la i ude (-90-90) -
- s i ched" ;
min_la _s i ched:s anda d_name = "longi ude" ;
double wes mos _la _s i ched(ns i ch) ; La i ude o he wes mos
bounding box o he AR sys ems.
wes mos _la _s i ched:_FillValue = NaN ;
wes mos _la _s i ched:uni s = "deg ees_no h" ;
wes mos _la _s i ched:long_name = "La i ude a min (wes mos )
longi ude (-90-90) -- s i ched" ;
wes mos _la _s i ched:s anda d_name = "longi ude" ;
double eas mos _la _s i ched(ns i ch) ; La i ude o he eas mos
bounding box poin .
eas mos _la _s i ched:_FillValue = NaN ;
eas mos _la _s i ched:uni s = "deg ees_no h" ;
eas mos _la _s i ched:long_name = "La i ude a max (eas mos )
longi ude (-90-90) -- s i ched" ;
eas mos _la _s i ched:s anda d_name = "longi ude" ;
double sou hmos _lon_s i ched(ns i ch) ; Longi ude o he sou hmos
bounding box poin .
sou hmos _lon_s i ched:_FillValue = NaN ;
sou hmos _lon_s i ched:uni s = "deg ees_eas " ;
sou hmos _lon_s i ched:long_name = "Longi ude a min (sou hmos )
longi ude (0-360) -- s i ched" ;
sou hmos _lon_s i ched:s anda d_name = "la i ude" ;
double no hmos _lon_s i ched(ns i ch) ; Longi ude o he no hmos
bounding box poin .
no hmos _lon_s i ched:_FillValue = NaN ;
no hmos _lon_s i ched:uni s = "deg ees_eas " ;
no hmos _lon_s i ched:long_name = "Longi ude a max (no hmos )
longi ude (0-360) -- s i ched" ;
no hmos _lon_s i ched:s anda d_name = "la i ude" ;
These a iables below a e no use ul, because he “inpu ield” was a mask
0/1 ins ead o a physical a iable like p ecipi a ion.
double amean_ins _ ield(ns i ch) ;
amean_ins _ ield:_FillValue = NaN ;
amean_ins _ ield:uni s = "mm h-1" ;
amean_ins _ ield:long_name = "LP objec mean ins an aneous ain
a e (a end o unning ime)." ;
double amean_ unning_ ield(ns i ch) ;
amean_ unning_ ield:_FillValue = NaN ;
amean_ unning_ ield:uni s = "mm day-1" ;
amean_ unning_ ield:long_name = "LP objec unning mean, mean
ain a e (a end o unning ime)." ;
double amean_ il e ed_ unning_ ield(ns i ch) ;
amean_ il e ed_ unning_ ield:_FillValue = NaN ;
amean_ il e ed_ unning_ ield:uni s = "mm day-1" ;
amean_ il e ed_ unning_ ield:long_name = "LP objec il e ed
unning mean, mean ain a e (a end o unning ime)." ;
double min_ins _ ield(ns i ch) ;
min_ins _ ield:_FillValue = NaN ;
min_ins _ ield:uni s = "mm h-1" ;
min_ins _ ield:long_name = "LP objec min ins an aneous ain a e
(a end o unning ime)." ;
double min_ unning_ ield(ns i ch) ;
min_ unning_ ield:_FillValue = NaN ;
min_ unning_ ield:uni s = "mm day-1" ;
min_ unning_ ield:long_name = "LP objec unning mean, min ain
a e (a end o unning ime)." ;
double min_ il e ed_ unning_ ield(ns i ch) ;
min_ il e ed_ unning_ ield:_FillValue = NaN ;
