Me hods as da a - In es iga ing
how epo ing in me hods
sec ions a ec s pe cei ed
eplicabili y o models
D . Anna Ko zeniowskaaand D . Louise Saulb,c
a. eLi e Sciences Publica ions L d, Camb idge CB2 1AW ; b. Uni e si y o Sou hamp on,
Sou hamp on, SO17 1BJ; c. Ca ee s and Skills o Da a-d i en Resea ch (CaSDaR)
O e iew
Backg ound and
in oduc ion
Scoping e iew Su ey Fu u e wo k
Backg ound
P ojec De elopmen
•Ini ially ocused on Alzheime s (Po en ial Fab ica ion in
Resea ch Images Th ea ens Key Theo y o Alzheime ’s
Disease, 2022); high ep esen a ion o ansgenic mouse
lines.
•B oadened sea ch o include Expe imen al Au oimmune
Encephali is (Hun emann e al., 2022; Ransoho , 2012;
Bake & Amo , 2014)
•Swi ched ocus by iden i ying esea ch a eas ha in ol ed
he highes numbe o p ocedu es unde ASPA; looking a
maximum impac / each
In oduc ion
•Acknowledgemen ha cu en p eclinical solid umou
models a e cu en ly no epo ed wi h su icien de ail
(Gengenbache e al., 2017)
•E ing on e al., 2021 desc ibed ba ie s encoun e ed when
assessing eplicabili y o p eclinical cance models
•The e ha e been issues in ansla ion o p eclinical ials o
clinical se ings (Wa ha e al., 2014), howe e hese ha e
ocused on ‘human aspec ’ (Llo e a & Liesz, 2016)
•We we e in e es ed in he eplicabili y o me hods as
opposed o ep oducibili y o claims –we el his was an
e hical conce n
In oduc ion
•The po en ial o eplicabili y and ep oducibili y o an
expe imen is i al o us wo hy esea ch and o e i y claims
made when publishing he esea ch
•De ailed me hods sec ions a e essen ial o eplicabili y
•I esul s o a s udy canno eplica ed - he esul s a e pu in o
ques ion
•No es ablished me hod o assessing eplicabili y du ing pee
e iew
In oduc ion
In oduc ion
•Mo al impe a i e o conside eplicabili y o animal s udies
•Unsuccess ul eplica ions = was e o animals, unnecessa y
su e ing
•P o ocols lacking in o ma ion = doub s a ound e inemen and
educ ion
•Inabili y o ollow p e iously es ed p o ocols - unnecessa y
pilo ing/ s a ing om sc a ch
•Con e sely, ensu ing good animal wel a e linked o be e
eplicabili y (Smi h and Lilley, 2019)
In oduc ion
P e ious wo k in his a ea
•The e has been wo k o add ess s eps ha could be aken o
p omo e ep oducibili y in p e-clinical expe imen s:
•Iden i ica ion o ac o s o include/mi iga e in p e-clinical
expe imen s (Wilson e al, 2023)
•The publishing o he Gold S anda d Publica ion Checklis
(Hooijmans e al., 2010), o suppo sys ema ic e iews o p e-
clinical wo k
•Gene a ion o he MDAR amewo k o p omo e epo ing o p e-
clinical models (Macleod e al., 2021)
•ARRIVE epo ing guidelines (du Se e al., 2020) help ensu e
anspa ency and make me hods sec ions mo e eplicable.
Ou Objec i es
●Use a scoping e iew o iden i y expe imen al ac o s/de ails
cu en ly included in me hods sec ions o manusc ip s desc ibing
B eas o P os a e mouse models
●Combine wi h expe imen al ac o s/de ails iden i ied om
p e iously men ioned sou ces
●Su ey esea che s o assess how inclusion o ac o s a ec s
pe cei ed eplicabili y o me hods
●Apply weigh ing ac o s based upon esul s
●Sys ema ic e iew o li e a u e o de e mine p opo ion o
manusc ip s ha could be eplica ed based upon he da a in he
me hods sec ion
Dis ibu ion o he Su ey - P elimina y Resul s
Demog aphic da a o esponden s:
A e age numbe o yea s wo king wi h expe imen al animals: 14 yea s
(one non- esponden )
2 esponden s had p e iously wo ked wi h b eas o p os a e models o
cance
5 esponden s had conside ed a emp ing o eplica e ano he
esea che ’s wo k
3 esponden s we e ea ly ca ee s esea che s, 1 was a senio ca ee
esea che , ano he a mid ca ee esea che
4 esponden s wo ked a a Highe Educa ion Ins i u ion, 1 esponden
wo ked a a p i a e company
Sys ema ic e iew
To answe he ques ion: "Wha is he dis ibu ion o pe cei ed
eplica ion in pee - e iewed s udies in ol ing b eas o p os a e
cance animal models published in he las i e yea s?"
Inclusion c i e ia:
●Pee - e iewed
●Non- ansgenic mice
●Only using in o ma ion in he ma e ials/me hods sec ion
●Use o a easonable le el o sc u iny
Use o Sys ema ic Re iew Facili y o manage he p ocess
Ba ie s o assessing pe cei ed eplicabili y in
li e a u e
Me hod
Desc ip ion
Ba ie s
E
-u ili ies
En ez p og amming
u ili ies, (E-u ili ies)
which allow sea ch and e ie al o
in o ma ion om he PubMed da abase
wi h he use o a public API o e ie e
numbe s o manusc ip s om he
da abase which use speci ic keywo ds
iden i ied om he su ey.
The da a in he PubMed da abase is uns uc u ed,
meaning ha i is di icul o de e mine i he
en ies e u ned ha e he keywo ds p esen in he
me hods o elsewhe e in he ex . This p esen s
an issue as we a e ocusing solely on he
me hods sec ions.
Manual
sea ch
A sys ema ic e iew o he li e a u e by
c ea ing an exclusion c i e ia o speci ic
li e a u e, sea ching he PubMed
da abase, and manually collec ing da a
om he me hods sec ions o he
e u ned manusc ip s.
This will need o be comple ed by mo e han 2
named esea che s; bias minimisa ion s eps will
be equi ed h oughou he p ocess and
independen and andom e i ica ion equi ed
(n=158, h ps://doi.o g/10.7554/eLi e.71601)
Fu u e wo k
●Analysis o manusc ip s o assess p opo ion o
manusc ip s suppo ing eplicabili y
●Wo ks o be done by 2 independen esea che s,
wi h he hi d indi idual e i ying he wo k by
andom alloca ion
●Quali a i e esea ch - discussion abou anking o
ac o s and decide i he e a e addi ional ac o s o
include and ba ie s o eplicabili y
Q&A/Feedback
