scieee Science in your language
[en] (orig)

What is published in impact journals on school effectiveness? A systematic review of research results and methods

Abstract

A systematic review of 45 articles on school effectiveness (SE) indexed in SJR and JCR (2014–2018) has been conducted. The results obtained show that the quantitative methodology catalyses the greatest number of researches. The articles are mainly published in Q1-Q2 journals with impact factor. The content of the articles reviewed found that, although exist contextual factors that affect the SE, the variables at the school level also have an impact.

Read accessible full text

What is published in impact journals on school effectiveness? A systematic review of research results and methods

Author: García Jiménez, Jesús; Torres Gordillo, Juan Jesús; Rodríguez Santero, Javier
Publisher: Lithuanian University of Educational Sciences
Year: 2020
DOI: 10.15823/p.2020.138.1
Source: https://idus.us.es/bitstreams/627d6f05-f56f-49c3-90af-36ea1c014e03/download
5
Pedagogika / 2020, . 138, N . 2
Wha is Published in Impac Jou nals on
School E ec i eness? A Sys ema ic Re iew o
Resea ch Resul s and Me hods
Jesús Ga cía-Jiménez1, Juan Jesús To es-Go dillo2, Ja ie Rod íguez-San e o3
1 Uni e si y o Se ille, Depa men o Educa ional Resea ch Me hods and Diagnos ics. C/Pi o ecnia, s/n, ES-41013,
Se ille, Spain, jga [email protected]
2 Uni e si y o Se ille, Depa men o Educa ional Resea ch Me hods and Diagnos ics. C/Pi o ecnia, s/n, ES-41013,
Se ille, Spain, [email protected]
3 Uni e si y o Se ille, Depa men o Educa ional Resea ch Me hods and Diagnos ics. C/Pi o ecnia, s/n, ES-41013,
Se ille, Spain, ja [email protected]
Abs ac . A sys ema ic e iew o 45 a icles on school e ec i eness (SE) indexed in SJR and
JCR (2014–2018) has been conduc ed. The esul s ob ained show ha he quan i a i e me hodology
ca alyses he g ea es numbe o esea ches. The a icles a e mainly published in Q1-Q2 jou nals
wi h impac ac o . The con en o he a icles e iewed ound ha , al hough exis con ex ual
ac o s ha a ec he SE, he a iables a he school le el also ha e an impac .
Keywo ds: educa ional e iciency, educa ional quali y, educa ional ou pu , school s uden
ela ionship.
In oduc ion
The s udy o school e ec i eness is a popula heme in educa ional science. In he
scien i ic pano ama, o ums ha analyse school e ec i eness ha e been c ea ed, such
as he In e na ional Cong ess o School E ec i eness and Imp o emen (ICSEI) and
jou nals ha ocus on his subjec , such as he School E ec i eness and School Imp o e-
men (SESI) (Reynolds e al., 2014). School e ec i eness is a concep ha has e ol ed
h oughou his o y. The Coleman Repo (Coleman e al., 1967) opens he doo o he
s udy o school e ec i eness and la ge-scale esea ch. I concludes ha he socioeconomic
cha ac e is ics o he s uden body explain he g ea e a iance in he esul s. Howe e ,
ISSN 1392-0340 (P in )
ISSN 2029-0551 (Online)
h ps://doi.o g/10.15823/p.2020.138.1
Pedagogika / Pedagogy
2020, . 138, N . 2, p. 5–24 / Vol. 138, No. 2, pp. 5–24, 2020
6
Pedagogika / 2020, . 138, N . 2
he cha ac e is ics o schools also a ec academic achie emen (Azpillaga, In xaus i &
Joa is i, 2014; Cohodes, 2016; Fulle & Hollingwo h, 2014; Ho man, Ho man & G ay,
2015; Ka akolidis, Pi sia & Em alo is, 2016; Ma ínez-Abad, Lizasoain, Cas o-Mo e a
& Joa is i, 2017; Mu illo, 2007; Page, Ma ín, O ellana & González, 2016; Ranjan, 2014;
Schmid , Bu oughs, Zoido & Houang, 2015; Tichno -Wagne , Ha ison & Cohen-Vogel,
2016; Webe , 1971), al hough he a iance explained a ies om coun y o coun y (Cos a
& A aújo, 2018; OECD, 2019; Schmid e al., 2015). Fo his eason, school e ec i eness
is cu en ly de ined as he impac ha he school has on he academic pe o mance and
social de elopmen o he s uden s (Fulle & Hollingwo h, 2014; Mu illo, 2007; Reynolds
e al., 2014; Schee ens, 2000). On he o he hand, e ec i e schools a e hose ha de elop
s uden s in a comp ehensi e manne , bo h in basic ins umen al skills and in emo ional
skills, beyond wha would be expec ed in ligh o hei con ex , pe sonal cha ac e is ics
and p e ious esul s (Mu illo, 2005; S oll & Fink, 1996).
Educa ion sys ems mus gua an ee he e ec i eness o hei schools, because he ben-
e i s go beyond aining in basic skills (OECD, 2017a). Howe e , no all schools gua an ee
quali y educa ion (OECD, 2017b). Some coun ies ha e ansla ed he conce n o op imise
hei coun y’s educa ion in o ins i u ions ha seek o imp o e school e iciency (Childs
& Russell, 2017). In he Spanish and La in-Ame ican con ex s, la ge-scale educa ional
pe o mance assessmen s such as he P og amme o In e na ional S uden Assessmen
(PISA) ha e had an impac on educa ional policies (Kauko, Cen eno, Candido, Shi oma
& Klu as, 2016; LOMCE, 2013).
S anda dised es s ha e no been exemp om c i icism. Limi a ions o assessmen s,
economic ocus o loss o humanism a e a gumen s de imen al o s anda dised assess-
men s (Deng & Gopina han, 2016; Méndez, 2014; Pa a, 2018). Ne e heless, e alua ions
o educa ion sys ems allow o hei p og ess (Fe ão, 2014). The a ailabili y o s and-
a dised es esul s and ques ionnai es on he socio- amilia con ex allow o es ablish
ad anced s a is ical models (Co de o & Manchón, 2014; Feldho , Radisch & Bischo ,
2016; Gamazo, Ma ínez-Abad, Olmos-Migueláñez & Rod íguez-Conde, 2017; Jennings,
Deming, Jencks, Lopuch & Schuele , 2015; Reynolds e al., 2014). Value-added s a is ical
models make i possible o ind schools wi h a high esidual alue (Gamazo, e al., 2017;
Iye & Moo e, 2017). The esidual gain consis s o he di e ence in sco e expec ed o
i s socioeconomic con ex and ha ac ually ob ained. This pa ame e makes i possible
o loca e bo h high o low-e iciency schools, when exceeding he expec ed sco e, and
low e iciency schools (Ma ínez-Abad e al., 2017). The OECD (2017b) ecommends
helping disad an aged schools by op imizing hei pe sonal and inancial esou ces.
Schools can be op imised by knowing he a iables a he school le el ha di e en ia e
e ec i e schools (Ma ínez-Abad e al., 2017; Ru ledge, Cohen-Vogel, Osbo ne-Lampkin
& Robe s, 2015). To de ec he educa ional pa e ns ha cha ac e ise high and low e -
iciency schools, some au ho s s a om diagnos ic e alua ions o iden i y high o low
esidue cen es (Azpillaga e al., 2014; In xaus i, E xebe ia & Ba au, 2017; In xaus i,
7
Pedagogika / 2020, . 138, N . 2
Joa is i & Lizasoain, 2016; Joa is i, Lizasoain & Azpillaga; 2014; Lizasoain, Be ezia ua
& Ba au; 2016). In a i s phase, by means o mul ile el hie a chical models and aking
as a e e ence he esidual gain o he g ow h o sco es, a classi ica ion o he cen es
acco ding o he le el o school e iciency achie ed o e he yea s is ca ied ou . In o he
wo ds, a longi udinal pe spec i e (Ped oza-Zúñiga, Ce zal, Su ema & Lizasoain, 2018)
is aken in o accoun . This diagnos ic phase is ollowed by a second phase in which he
cen es wi h he highes and lowes esidual gain a e s udied quali a i ely. As a esul o
his s udy, he educa ional guidelines ha explain he e ec i eness (o ine ec i eness)
o he schools a e es ablished. This ype o me hodological design is close o he eali y
and complexi y o educa ion sys ems (Feldho e al., 2016) because hey conside bo h
he pe sonal and con ex ual cha ac e is ics o he s uden s and he schools, as well as
he p ocesses ha ake place in he schools (Schee ens, Luy en & an Ra ens, 2011) ha
could explain hei added alue (Ma ínez-Abad e al., 2017).
The e o e, he ollowing esea ch ques ions a e posed: 1) Wha esea ch me hodolo-
gies do jou nals ca alyse o school e ec i eness? 2) Wha a e he a iables ha explain
school e ec i eness? In o de o answe he i s ques ion, he aim was o ind ou he
me hodological ends o a icles published on school e ec i eness in jou nals indexed in
JCR (WoS) and SJR (Scopus), in he pe iod be ween 2014 and 2018. Fu he mo e, in o de
o answe he second ques ion, he objec i e o desc ibing he esul s ha explain school
e ec i eness in hese a icles was p oposed. This objec i e is add essed as a esponse o
he demand aised in ecen esea ch on school e ec i eness (Hajiso e iou, Ka ousiou
& Angelides, 2018; Schee ens, 2014; 2015).
Ma e ials and me hods
The me hod used in he esea ch was he sys ema ic e iew, which allows deepening
he s udy o a subjec h ough ga he ing, sys ema izing and ela ing he esul s o esea ch
conduc ed (Higgins & Wells, 2011; Man e ola, As udillo, A ias, Cla os & Minci , 2013;
Ma imbianco e al., 2020; P endes-Espinosa, Ga cía-Tudela & Solano-Fe nández, 2020).
The me hodology was adap ed o he p esen in es iga ion using he ollowing echniques:
hema ic analysis (B aun & Cla ke, 2006), sys ema ic concep ual e iew (Feldho e al.,
2016; Hallinge , 2014) and na a i e syn hesis (Kau man, 2015). The c i e ia used o he
selec ion o a icles ha o m pa o he sys ema ic e iew we e:
• The wo k should ocus on school e ec i eness.
• High-impac a icles: high-impac a icles we e de ined as hose published in
jou nals indexed in he JCR (WoS) and SJR (Scopus) da abases. This equi emen was o
ensu e he scien i ic quali y o he a icles.
• The pe iod s udied was limi ed o 2014–2018.
• The key sea ch wo ds we e School E ec i eness, School Imp o emen , Educa-
ional Mul ile el Analysis, PISA and School Value-added.
8
Pedagogika / 2020, . 138, N . 2
The sys ema ic e iew p ocess began wi h a sea ch o ERIC, WoS and Scopus as he
main sou ces o wo k collec ion. High-impac a icles we e si ua ed in he pe iod 2014–
2018. The ini ial esul was 67 selec ed a icles. A e a i s explo a o y analysis, hose ha
did no mee all he es ablished selec ion c i e ia we e disca ded. An induc i e hema ic
analysis o he s udies was used wi h he selec ed a icles (B aun & Cla ke, 2006). Two
hemes ha in luence school e ec i eness we e iden i ied: bo h con ex ual and school
a iables. Again, hose ha did no espond o he selec ed opics we e disca ded. The inal
esul o he a icles o be analysed was 45 (dx.doi.o g/10.17504/p o ocols.io.b 34jqqw).
A e his il e , a sys emic concep ual e iew (Feldho e al., 2016; Hallinge , 2014)
ha allowed us o ca y ou a desc ip i e analysis o he esea ch was pe o med. The
a iables s udied we e he app oach (quali a i e, quan i a i e o mixed), he impac
qua ile o which hey belong and he da a analysis echniques used in his esea ch.
In addi ion, a na a i e syn hesis (Kau man, 2015) o he esea ch esul s was ca ied
ou . These we e syn hesised and pooled in o de o d aw new conclusions and expose he
li e a u e e iew. In o de o gua an ee he quali y o he sys ema ic e iew, he indica ions
on he PRISMA checklis we e conside ed (Mohe , Libe a i, Te zla & Al man, 2009).
Resul s
Sys ema ic concep ual e iew o a icles on school e ec i eness
Figu e 1 shows he pe cen ages o e he o al numbe o a icles, o ganised by me ho-
dological app oach acco ding o impac qua ile. The impac qua ile was di ided in o
Q1-Q2 and Q3-Q4 o his analysis.
Figu e 1. Resul s (F) o a icles acco ding o me hodological app oach and impac
qua ile
9
Pedagogika / 2020, . 138, N . 2
The o al esul s in Figu e 1 should be in e p e ed aking in o accoun ha he a icles
indexed in JCR also belong o SJR. These esul s e ealed ha quan i a i e esea ch was
mo e p esen in impac jou nals wi h a p e alence g ea e han ou imes. Easy access
o he esul s o la ge-scale e alua ions may ha e been one o he easons (Co de o &
Manchón, 2014; Feldho e al., 2016; Gamazo e al., 2017; Jennings e al., 2015; Reynolds
e al., 2014; Schee ens, 2014).
On he o he hand, in bo h JCR (25) and SJR (36), he impac ac o o he jou nals was
mainly dis ibu ed in Q1-Q2, wi h a p e alence o h ee and ou imes espec i ely, as
opposed o Q3-Q4. F om his, i could be in e ed ha he subjec o school e ec i eness
was o in e es and impac in educa ional esea ch in he pe iod s udied.
Table 1 dis inguishes da a analysis echniques in he case o quan i a i e me hodologies
and da a collec ion in quali a i e designs. Quan i a i e analysis echniques we e di ided
in o mul ile el design (when conside ing he nes ed s uc u e o he da a), alue-added
designs (wi hou conside ing he nes ed s uc u e o he da a), desc ip i e designs and
hypo hesis con as , s uc u al equa ions, eg ession analysis and o he s.
Table 1
Resul s (F) o he Da a Analysis Techniques Used in Each Me hodological Design
Me hod Da a analysis
Indexed da abase To al
echniques
JCR SJR
Q1-Q2 Q3-Q4 Q1-Q2 Q3-Q4
Quan i a-
i e
Mul ile el design 12 3 17 7 24 44
VA Design 3 0 3 0 3
Desc ip i e-con as
o hypo heses
1 0 1 2 3
S uc u al equa ions 1 1 2 0 2
Reg ession 6 1 7 0 7
O he 5 0 5 0 5
Quali a i e Con en analysis 2 0 2 0 2 14
Ca ego y analysis 1 2 3 2 5
Me a-analysis 2 2 5 0 5
O he s-no speci ied 2 0 2 0 2
The mos commonly used quan i a i e da a analysis echnique was a mul ile el design.
Mul ile el designs espec he nes ed s uc u e o he da a. In educa ion, s uden esul s
a e nes ed in class ooms, schools and coun ies. Mul ile el designs make i possible o
e alua e he added alue o schools by aking in o accoun he nes ed s uc u e o he
educa ion sys em (Gamazo e al., 2017). Depending on he esea ch objec i e, i was

10
Pedagogika / 2020, . 138, N . 2
used wi h di e en nuances. Mo e adi ional alue-added models unde es ima e he
e ec o he cen e on school e ec i eness (T oncoso, Pampaka & Olsen, 2016). Desc ip-
i e-con as o hypo heses was conside ed when i was he main ool o he a icle, no
as a complemen o o he echniques, inding he use o ANOVA (Gae ne , Wu s e &
Pan , 2014) o he “ ” alue (Ranjan, 2014). In he eg essions, speci ici ies such as qua ile
eg ession (Li & Kons an opoulos, 2017) o o dina y squa es eg ession (Hobbs, 2016;
Schmid e al., 2015) could be highligh ed as examples. In o he quan i a i e analysis
echniques, he e we e decision ees, quan ile alue-added case, and he ee model
acco ding o Page (2017), CLASS-S (an obse a ional ins umen ), agen -based model
and econome ic analysis echniques (index o school pe o mance).
In quali a i e echniques, me a-analysis, and ca ego y analysis we e he mos used.
The speci ic analysis echnique used was no always men ioned. Only a ew o he au-
ho s ci ed i : a sys ema ic concep ual e iew (Feldho e al., 2016) and ealis ic syn hesis
(Eh en, Eddy-Spice , Bangpan & Reid, 2017). In o he echniques, al hough he p ocess
is e y de ailed by Ru ledge e al. (2015), he does no speci y he name o he echnique
al hough i could be ca alogued as con en analysis. On he o he hand, mapping was
used in combina ion wi h he c i ical inciden echnique (Day, Gu & Sammons, 2016).
Na a i e syn hesis o esea ch esul s on school e ec i eness
The esul s o he na a i e syn hesis o he 45 pape s analysed a e p esen ed below.
The esul s we e o ganised in o inpu s and p ocesses (Schee ens e al., 2011). The inpu s
desc ibe he esul s ha could explain he e ec i eness o he pe sonal and con ex ual
cha ac e is ics associa ed wi h he s uden s. The p ocesses de elop he esul s ha he
di e en au ho s indica ed imp o ed he e ec i eness o he schools.
Con ex ual ac o s associa ed wi h school e ec i eness
The economy, social and cul u al s a us (ESCS) o he amily in luenced academic
esul s (Ka akolidis e al., 2016). Academic pe o mance was un a o able in amilies wi h
a low socioeconomic le el (Gamazo e al., 2017; Ka akolidis e al., 2016; Ma ínez e al.,
2017; Ma inez-Abad & Chapa o-Caso, 2017; Mu illo, Ma ínez-Ga ido & Hidalgo,
2014; Özdemi , 2016; Pe y, 2017; Salgado, Ma chione & Gilbe , 2014; Sulis & Po cu,
2014; T oncoso e al., 2016; Tsai, Smi h & Hause , 2017; Van Hek, K aaykamp & Pelze ,
2018; Valenzuela, Bellei & Allende, 2016). The in luence may a y depending on cul u al
mechanisms gi en he g ea e in luence o he numbe o books in some Wes e n coun-
ies han in o he s in he Eas (Tsai e al., 2017).
The loca ion o he school was a p edic o o educa ional pe o mance (Co de o &
Manchón, 2014; Kelcey & Shen, 2016; Sulis & Po cu 2014) and o he p obabili ies o
en e ing uni e si y (Jennings e al., 2015). This was p obably no mo e han a spu ious
co ela ion de e mined by socioeconomic le el (Gamazo e al., 2017; Ka akolidis e al.,
2016; Özdemi , 2016; T oncoso e al., 2016). Fo he same eason, he social ne wo ks o
11
Pedagogika / 2020, . 138, N . 2
s uden s and school e iciency we e ela ed (Hobbs, 2016; Salgado e al., 2014). Likewise,
he g ea e e iciency o p i a e schools would be explained by he socioeconomic le el o
he s uden s who a end hese schools (Hobbs, 2016; Ho man e al., 2015; Joa is i e al.,
2014; T oncoso e al., 2016). Families wi h a high ESCS will be o e ed g ea e lea ning
oppo uni ies o hei child en (Hobbs, 2016; Schmid e al., 2015), which would explain
ha g ea e book owne ship has a posi i e in luence on pe o mance (E ans, Kelley &
Siko a, 2014). This could be in e p e ed as eally being he cul u al le el o he amily,
a he han he economic le el, which would explain a highe pe cen age o a iance
wi h espec o educa ional pe o mance.
Gende was con o e sial. The e we e s udies ha a gued ha i does no in luence
pe o mance (Salgado e al., 2014) and o he s ha do. The emale gende nega i ely a ec ed
pe o mance in ma hema ics in adolescence (Gamazo e al., 2017; Ho man e al., 2015;
Ka akolidis e al., 2016; Özdemi , 2016; T oncoso e al., 2016) and posi i ely in luenced,
al hough wi h less in ensi y, eading (Gamazo e al., 2017). Female s uden s bene i ed
mo e om a ending schools wi h a high socioeconomic le el (Van Hek e al., 2018).
Again, he socioeconomic con ex could explain he di e ences be ween educa ional
oppo uni ies among bo h gende s.
The epe i ion condi ion o he s uden body, o i he s uden has changed schools
many imes, impai ed educa ional pe o mance (Gamazo e al., 2017). Likewise, o he s
pe sonal cha ac e is ics o he s uden , such as sel -es eem, lea ning s a egies o pe cep-
ion o d ug use, we e ano he ac o o conside (Ma inez-Abad & Chapa o-Caso, 2017).
Al hough con ex ual and pe sonal ac o s associa ed wi h he pupils in luenced pe -
o mance, he e a e school cha ac e is ics ha in luenced academic ou comes (Azpillaga
e al., 2014; In xaus i e al., 2016, 2017; Joa is i e al., 2014; Lizasoain e al., 2016). In
addi ion, lea ning oppo uni ies would explain 37% o he inequali ies associa ed wi h
ESCS (Schmid e al., 2015) so hose schools ha a e mo e e ec i e will be able o educe
he inequali y gap in he s uden s (Valenzuela e al., 2016).
School ac o s associa ed wi h school e ec i eness
The a iables associa ed wi h he school i sel and he p ocesses ha ake place in
i signi ican ly a ec he achie emen s o he lea ne s (Ho man e al., 2015; Schmid
e al., 2015). The school in luences he pe o mance o i s s uden s om he i s yea s o
schooling (Fe ão, 2014). The e a e cen es ha ha e a high added alue, ega dless o he
socioeconomic con ex in which hey a e inse ed (Azpillaga e al., 2014; Cohodes, 2014;
Fe ão, 2014; Gamazo e al., 2017; In xaus i e al., 2016, 2017; Jennings e al., 2015; Joa is i
e al., 2014; Lizasoain e al., 2016; Ma ínez e al., 2017; Ru ledge e al., 2015). The e o e,
educa ional esea ch should ocus i s e o s on s udying he school a iables ha a ec
educa ional pe o mance (Fe ão, 2014; Joa is i e al., 2014) which canno always be done
in a quan i a i e way (Fulle & Hollingwo h, 2014). The in luence o he school could
explain 20% o he a iance in educa ional pe o mance (Ho man e al., 2015; Kelcey
12
Pedagogika / 2020, . 138, N . 2
& Shen, 2016); he e o e, he con ol o hese a iables would make i possible o op i-
mise he eaching-lea ning p ocesses and mo e owa ds mo e equi able educa ion. The
cha ac e is ics a e p esen ed in 4 ca ego ies: educa ional app oach, educa ional p ac ice,
managemen eam and lea ning cul u e.
Educa ional p ac ice
In e ms o educa ional p ac ice, eache s in e ec i e schools had a g ea e social and
emo ional in ol emen wi h s uden s and hei amilies. Teache s ex e nalised i as high
expec a ions o s uden s and g ea e in ol emen in ex acu icula ac i i ies (Ru ledge
e al., 2015). Teache s op imised he use o esou ces, whe he ex e nal o in e nal and
sys ema ically help s uden s h ough ex acu icula suppo o olun ee sys ems o
imp o e educa ion (In xaus i e al., 2017). The e was also g ea e in ol emen wi h s u-
den assessmen s (Ranjan, 2014). These we e mo e equen and egula in he e iew
o homewo k and asks, which was ela ed o be e esul s (Mu illo e al., 2014). The
highly e icien schools showed a mo e holis ic pe spec i e, a ending o he academic
and emo ional de elopmen o he s uden s (Ru ledge e al., 2015). In addi ion, eache s
showed mo e planning and closeness skills (Ranjan, 2014).
The in ol emen o amilies in he school seemed o be a de ining cha ac e is ic o
cen es wi h high e iciency (Azpillaga e al., 2014; Hajiso e iou e al., 2018), wi h mo he s
ha ing a g ea leading ole in educa ion (Co de o & Manchón, 2014). In cen es wi h high
e iciency, g ea e sensi i i y was obse ed owa ds he amilies o he s uden s, as well
as g ea e connec ion wi h hem (Ru ledge e al., 2015).
The e was a disc epancy in he numbe o s uden s pe class, as he e was esea ch
s a ing ha i did no in luence esul s (Li & Kons an opoulos, 2017). In con as , Egali e
and Kisida (2016) s a ed ha he esul s wo sen as he a io and educa ional le el inc eased.
Howe e , high-pe o ming schools may be mo e esponsi e o challenges because hey
ha e be e esou ce planning (In xaus i e al., 2017).
Managemen eam
The school inspec ions did no appea o iden i y p ocesses o imp o ing he e ec-
i eness o schools (Gae ne e al., 2014). Howe e , managemen , in de e mining di -
e en p ocesses, has an in luence on school ac i i y (P ase cha oensuk & Tang, 2017).
The managemen o high-e iciency schools was sensi i e o he needs o he s uden s,
lexible o change, open o inno a ion, and exe cises democ a ic leade ship (Day e al.,
2016; In xaus i e al., 2016). P incipals did no educe school e ec i eness o pe o mance
on s anda dised es s. Managemen used hese es s o school imp o emen (In xaus i
e al., 2016). In addi ion, he managemen eam was in ol ed wi h he alues o he school
communi y, encou aged he desi e o he en i e educa ional communi y o lea n and,
when hey belonged o schools in disad an aged con ex s, ca ied ou g ea e in ol emen
and saw di icul ies as a challenge o be o e come (Day e al., 2016).
13
Pedagogika / 2020, . 138, N . 2
Lea ning cul u e
The cul u e o lea ning in high-e iciency schools had i s pa icula i ies: he e we e
mo e oppo uni ies o pa icipa ion, o mal communica ion s uc u es, collabo a i e
decision-making p ocesses, sha ed leade ship and high expec a ions among s uden s
and eache s (In xaus i e al., 2016; Ma ou khani, Nou ani & Boe hannoeddin, 2015;
Tichno -Wagne e al., 2016). In hem, beyond he desi e o aise sco es on s anda dised
assessmen es s, he e was an in insic mo i a ion o imp o ing educa ion in gene al.
The le els o e o and in ol emen in achie ing his pu pose we e signi ican ly highe
in his ype o school (In xaus i e al., 2016).
The pe manen aining o eache s was op imal in high e iciency schools (Lizasoain
e al., 2016). On he o he hand, low e iciency cen es jus i ied low esul s by poin ing
o ex e nal ac o s and ine ec i e p ocesses o aining and inno a ion (Lizasoain e al.,
2016). Pe manen aining in high e iciency schools was cha ac e ised by (Lizasoain
e al., 2016) sys ema ic implemen a ion, a high deg ee o in ol emen loca ed in he school
i sel (e.g. cascade aining) and ans e o p ac ice, which was acili a ed by he school
and always e alua ed. On he o he hand, esea ch aining o eache s and ecu en
e lec ion on hei own p ac ice bene i ed schools (Mincu, 2015). These skills could make
eache s he d i e s o change in educa ional ins i u ions.
Educa ional app oach
The comp ehensi e educa ion o he human being was he commi men o he each-
ing s a and was a key elemen in he imp o emen o schools wi h cul u al di e si y
(Hajiso e iou e al., 2018). The e we e no disc imina o y p ac ices in high-e iciency
schools. Awa eness among s uden s wi h special educa ional needs was highe . Any
s uden who needs suppo in his o he educa ion was conside ed o ha e special edu-
ca ional needs. P imi i e de ini ions o his aspec , which ocus mo e on disabili y, we e
no con empla ed. Fu he mo e, he eaching s a had deeply oo ed alues, based on
s ong eligious o social belie s (In xaus i e al., 2017). I was clea ha eache s in highly
e ec i e schools had a p oac i e a i ude owa ds educa ion, wi h empa hy owa ds o he
educa ional agen s and a ision o knowledge ha was lexible and unde cons an e iew
(Hajiso e iou e al., 2018; In xaus i e al., 2017).
The composi ion o he school’s pupils also a ec ed school e iciency. The di e si y o
gende s is posi i e o e ec i eness, pe haps because hey had be e beha iou (Ning,
Van Damme, Van Den Noo ga e, Yang & Pan , 2015; Van Hek e al., 2018). The class-
oom clima e was one o he ac o s a ec ing pe o mance when pe cei ed posi i ely,
along wi h au onomy in he use o echnologies o he adap a ion o eaching (Gamazo
e al., 2017). Class oom discipline would explain 11% o he a iance be ween schools
in eading achie emen (Ning e al., 2015). Mo e discipline was associa ed wi h be e
ou comes, al hough hese le els a ied om coun y o coun y. This could be explained,
20
Pedagogika / 2020, . 138, N . 2
Kelcey, B., & Shen, Z. (2016). Mul ile el design o school e ec i eness s udies in Sub-Saha an
A ica.School E ec i eness and School Imp o emen ,27(4), 492–510. h p://dx.doi.o g/10.10
80/09243453.2016.1168855
Ley o gánica 8/2013, 9 de diciemb e, pa a la mejo a de la calidad educa i a [O ganic Law 8/2013,
Decembe 9, o he imp o emen o educa ional quali y] (LOMCE). Bole ín O icial del Es ado,
295, de 10 de diciemb e de 2013, 97858 a 97921. Re ie ed om: h p://www.boe.es/boe/
dias/2013/12/10/pd s/BOE-A-2013-12886.pd
Li, W., & Kons an opoulos, S. (2017). Does class-size educ ion close he achie emen gap?
E idence om TIMSS 2011.School E ec i eness and School Imp o emen ,28(2), 292–313.
h p://dx.doi.o g/10.1080/09243453.2017.1280062
Lizasoain, L. & Angulo, A. (2014). Buenas p ác icas de escuelas e icaces del País Vasco.
Me odología y p ime os esul ados. [Bes p ac ices o highly e ec i e schools in he Basque
Coun y. Me hodology and i s esul s]. Pa icipación Educa i a, 3(4), 17–27. h ps://doi.
o g/10.4438/1886-5097-PE
Lizasoain, L. L., Be ezia ua, J., & Ba au, I. (2016). La o mación pe manen e del p o eso ado
en cen os educa i os de al a e icacia [The pe manen aining o eache s in highly e icien
educa ional cen e s] Bo dón. Re is a de pedagogía, 68(2), 199–218. h ps://doi.o g/10.13042/
Bo don.2016.68213
Man e ola, C., As udillo, P., A ias, E., Cla os, N., & MINCIR, G. (2013). Sys ema ic e iews o
he li e a u e: wha should be known abou hem.Ci ugía Española,91(3), 149–155. h ps://
doi.o g/10.1016/j.ci esp.2011.07.009
Ma ou khani, P., Nou ani, M., & Boe hannoeddin, A. B. (2015). High-pe o mance wo k sys ems
and school e ec i eness: he case o Malaysian seconda y schools.Asia Paci ic Educa ion
Re iew,16(3), 461–475. h p://dx.doi.o g/10.1007/s12564-015-9389-2
Ma imbianco, A. L. C., Fe ei a, R. E. S., La o aca, C. de O. C., Bussado i, S. K., Pacheco, R. L.,
& Rie a, R. (2020). Pho obiomodula ion wi h low-le el lase he apy o ea ing Achilles
endinopa hy: a sys ema ic e iew and me a-analysis.Clinical Rehabili a ion, 34(6), 713–
722.h ps://doi.o g/10.1177/0269215520912820
Ma inez-Abad, F., & Chapa o-Caso, A. A. (2017). Da a-mining echniques in de ec ing ac o s
linked o academic achie emen .School E ec i eness and School Imp o emen ,28(1), 39–55.
h p://dx.doi.o g/10.1080/09243453.2016.1235591
Ma ínez-Abad, F., Lizasoain, L., Cas o-Mo e a, M., & Joa is i, L. M. (2017). Selección de escuelas
de al a y baja e icacia en Baja Cali o nia (México). [Selec ion o High and Low-E ec i eness
Schools in Baja Cali o nia (Mexico)]. Re is a elec ónica de in es igación educa i a, 19(2),
38–53. h ps://doi.o g/10.24320/ edie.2017.19.2.960
Maxwell, J. A. (2019). The Value o Quali a i e Inqui y o Public Policy. Quali a i e Inqui y,
26(2), 177–186. h ps://doi.o g/10.1177/1077800419857093
Méndez, J. M. Á. (2014). Ins i u ional assessmen : be ween poli ical p essing needs and school
imp o emen needs.Policy Fu u es in Educa ion,12(3), 445–454. h p://dx.doi.o g/10.2304/
p ie.2014.12.3.445

21
Pedagogika / 2020, . 138, N . 2
Mincu, M. E. (2015). Teache quali y and school imp o emen : wha is he ole o esea ch?Ox o d
Re iew o Educa ion,41(2), 253–269. h p://dx.doi.o g/10.1080/03054985.2015.1023013
Mohe , D., Libe a i, A., Te zla , J., & Al man, D. G. (2009). P e e ed epo ing i ems o sys ema ic
e iews and me a-analyses: The PRISMA s a emen . PLOS Medicine 6(7): e1000097. h p://
dx.doi.o g/10.1371/jou nal.pmed.1000097
Mu illo, F. J. (2005). La in es igación sob e e icacia escola . [Resea ch on school e ec i eness].
Ba celona: Oc aed o.
Mu illo, F. J., Ma ínez-Ga ido, C., & Hidalgo, N. (2014). Incidencia de la o ma de e alua los
docen es de Educación P ima ia en el endimien o de los es udian es en España. [The impac
o he e alua ion me hodology o he P ima y Educa ion eache s on he pe o mance o he
s uden in Spain]. Es udios sob e Educación, 27, 91–113. h p://dx.doi.o g/10.15581/004.27.91-113
Mu illo, F. J. (Coo d.) (2007). In es igación Ibe oame icana sob e E icacia Escola . [Ibe o-Ame ican
esea ch on School E ec i eness]. Bogo á: Con enio And és Bello.
Ning, B., Van Damme, J., Van Den Noo ga e, W., Yang, X., & Gielen, S. (2015). The in luence o
class oom disciplina y clima e o schools on eading achie emen : a c oss-coun y compa a i e
s udy. School E ec i eness and School Imp o emen , 26(4), 586–611. h ps://doi.o g/10.1080/
09243453.2015.1025796
OECD (2017a). Educa ion a a Glance 2017: OECD Indica o s. Pa is: OECD Publishing. h p://
dx.doi.o g/10.1787/eag-2017-en
OECD (2017b). Educa ional Oppo uni y o All: O e coming Inequali y h oughou he Li e Cou se.
Pa is: OECD publishing. h p://dx.doi.o g/10.1787/9789264287457-en
OECD (2019).Balancing school choice and equi y:An in e na ional pe spec i e based on Pisa.
Pa is: OECD Publishing. h ps://doi.o g/10.1787/2592c974-en
Özdemi , C. (2016). Equi y in he Tu kish educa ion sys em: A mul ile el analysis o social
backg ound in luences on he ma hema ics pe o mance o 15-yea -old s uden s. Eu opean
Educa ional Resea ch Jou nal, 15(2), 193–217. h ps://doi.o g/10.1177/1474904115627159
Page, G. L., Ma ín, E. S., O ellana, J., & González, J. (2017). Explo ing comple e school
e ec i eness ia quan ile alue added. Jou nal o he Royal S a is ical Socie y: Se ies A (S a is ics
in Socie y), 180(1), 315–340. h ps://doi.o g/10.1111/ ssa.12195
Pa a, J. D. (2018). C i ical ealism and school e ec i eness esea ch in Colombia: The di e ence
i should make. B i ish Jou nal o Sociology o Educa ion, 39(1), 107–125. h ps://doi.o g/10.1
080/01425692.2017.1330681
Ped oza-Zúñiga, L. H., Ce zal, P., Su ema, R., & Lizasoain, L. (2018). C i e ios pa a la iden i icación
y selección de escuelas e icaces de ni el medio supe io . [C i e ia o he iden i ica ion and
selec ion o e ec i e high schools].Re is a elec ónica de in es igación educa i a,20(1), 14–25.
h p://dx.doi.o g/10.24320/ edie.2018.20.1.2170
Pe y, T. (2017). In e -me hod eliabili y o school e ec i eness measu es: a compa ison
o alue-added and eg ession discon inui y es ima es.School E ec i eness and School
Imp o emen ,28(1), 22–38. h p://dx.doi.o g/10.1080/09243453.2016.1203799
22
Pedagogika / 2020, . 138, N . 2
P ase cha oensuk, T., & Tang, K. N. (2017). The e ec o s a egic leade ship ac o s o
adminis a o s on school e ec i eness unde he o ice o Maha Sa akham p ima y educa ional
se ice a ea 3.Kase sa Jou nal o Social Sciences,38(3), 316–323. h p://dx.doi.o g/10.1016/j.
kjss.2016.09.001
P endes-Espinosa, M., Ga cía-Tudela, P., & Solano-Fe nández, I. (2020). Gende equali y and
ICT in he con ex o o mal educa ion: A sys ema ic e iew. Comunica , 63, 9–20. h ps://
doi.o g/10.3916/C63-2020-01
Ranjan, M. (2014). School E ec i eness a P ima y Le el o Educa ion in Rela ion o Class oom
Teaching. In e na ional Jou nal o Ins uc ion, 7(2), 51–64.
Reynolds, D., Sammons, P., De F aine, B., Van Damme, J., Townsend, T., Teddlie, C., & S ing ield, S.
(2014). Educa ional e ec i eness esea ch (EER): A s a e-o - he-a e iew.School E ec i eness
and School Imp o emen ,25(2), 197–230. h p://dx.doi.o g/10.1080/09243453.2014.885450
Ru ledge, S. A., Cohen-Vogel, L., Osbo ne-Lampkin, L. T., & Robe s, R. L. (2015).
Unde s anding e ec i e high schools: E idence o pe sonaliza ion o academic and social
emo ional lea ning. Ame ican Educa ional Resea ch Jou nal, 52(6), 1060–1092. h ps://doi.
o g/10.3102/0002831215602328
Salgado, M., Ma chione, E., & Gilbe , N. (2014). Analysing di e en ial school e ec i eness
h ough mul ile el and agen -based modelling.Jou nal o A i icial Socie ies and Social
Simula ion,17(4), 3. h p://dx.doi.o g/10.18564/jasss.2534
Schee ens, J. (2000).Imp o ing school e ec i eness. Fundamen als o Educa ional Planning, 16.
Pa is: UNESCO, In e na ional Ins i u e o educa ional planning.
Schee ens, J. (2014). School, eaching, and sys em e ec i eness: some commen s on h ee s a e-
o - he-a e iews. School E ec i eness and School Imp o emen , 25(2), 282–290. h p://dx.doi.
o g/10.1080/09243453.2014.885453
Schee ens, J. (2015). Theo ies on educa ional e ec i eness and ine ec i eness. School E ec i eness
and School Imp o emen , 26(1). 259–289. h ps://doi.o g/10.1080/09243453.2013.858754
Schee ens, J., Luy en, H., & an Ra ens, J. (2011). Measu ing educa ional quali y by means o
indica o s. In Schee ens J., Luy en H., & an Ra ens J. (Eds.),Pe spec i es on educa ional
quali y (pp. 35–50). Do d ech : Sp inge . h p://dx.doi.o g/10.1007/978-94-007-0926-3_2
Schmid , W. H., Bu oughs, N. A., Zoido, P., & Houang, R. T. (2015). The ole o schooling in
pe pe ua ing educa ional inequali y: An in e na ional pe spec i e. Educa ional Resea che ,
44(7), 371–386. h ps://doi.o g/10.3102/0013189X15603982
S oll, L., & Fink, D. (1996).Changing ou schools: Linking school e ec i eness and school
imp o emen . Chicago: Open Uni e si y P ess.
Sulis, I., & Po cu, M. (2015). Assessing di e gences in ma hema ics and eading achie emen
in I alian p ima y schools: A p oposal o adjus ed indica o s o school e ec i eness. Social
Indica o s Resea ch, 122(2), 607–634. h ps://doi.o g/10.1007/s11205-014-0701-z
Thessin, R. A. (2015). Iden i y he bes e idence o school and s uden imp o emen .Phi Del a
Kappan,97(4), 69–73. h p://dx.doi.o g/10.1177/0031721715619923
23
Pedagogika / 2020, . 138, N . 2
Tichno -Wagne , A., Ha ison, C., & Cohen-Vogel, L. (2016). Cul u es o lea ning in
e ec i e high schools. Educa ional Adminis a ion Qua e ly, 52(4), 602–642. h ps://doi.
o g/10.1177/0013161X16644957
Tobin, M., Nug oho, D., & Lie z, P. (2016). La ge-scale assessmen s o s uden s’ lea ning and
educa ion policy: syn hesising e idence ac oss wo ld egions. Resea ch Pape s in Educa ion,
31(5), 578–594. h ps://doi.o g/10.1080/02671522.2016.1225353
T oncoso, P., Pampaka, M., & Olsen, W. (2016). Beyond adi ional school alue-added models:
a mul ile el analysis o complex school e ec s in Chile. School E ec i eness and School
Imp o emen , 27(3), 293–314. h ps://doi.o g/10.1080/09243453.2015.1084010
Tsai, S. L., Smi h, M. L., & Hause , R. M. (2017). Families, schools, and s uden achie emen
inequali y: A mul ile el MIMIC model app oach.Sociology o Educa ion,90(1), 64–88. h ps://
doi.o g/10.1080/09243453.2014.885450
Valenzuela, J. P., Bellei, C., & Allende, C. (2016). Measu ing sys ema ic long- e m ajec o ies
o school e ec i eness imp o emen .School E ec i eness and School Imp o emen ,27(4),
473–491. h ps://doi.o g/10.1080/09243453.2016.1150861
Van Hek, M., K aaykamp, G., & Pelze , B. (2018). Do schools a ec gi ls’ and boys’ eading
pe o mance di e en ly? A mul ile el s udy on he gende ed e ec s o school esou ces and
school p ac ices. School E ec i eness and School Imp o emen , 29(1), 1–21. h ps://doi.o g/
10.1080/09243453.2017.1382540
Webe , G. (1971). Inne ci y child en can be augh o ead: ou success ul schools. Occasional
pape , 18. Washing on, DC: Council o Basic Educa ion.
Kas publikuojama ci uojamo indekso žu naluose apie
mokyklos e ek y umą? Sis eminė y imo ezul a ų i
me odų apž alga
Jesús Ga cía-Jiménez1, Juan Jesús To es-Go dillo2, Ja ie Rod íguez-San e o3
1 Se ilijos uni e si e as, Edukacinių y imų me odų i diagnos ikos ka ed a, C/Pi o ecnia, s/n, ES-41013, Se ilija,
Ispanija, jga [email protected]
2 Se ilijos uni e si e as, Edukacinių y imų me odų i diagnos ikos ka ed a. C/Pi o ecnia, s/n, ES-41013, Se ilija,
Ispanija, [email protected]
3 Se ilijos uni e si e as, Edukacinių y imų me odų i diagnos ikos ka ed a, C/Pi o ecnia, s/n, ES-41013, Se ilija,
Ispanija, ja [email protected]
San auka
Š ie imo e ek y umas mokslo i socialiniu lygmeniu y a iena iš dominuojančių emų,
nag inėjamų daugelyje mokslinio po eikio s aipsnių su aukš u ci a imo indeksu (angl. Impac
24
Pedagogika / 2020, . 138, N . 2
Fac o ). S aipsniai publikuojami e e uojamose duomenų bazėse, okiose kaip WoS i Scopus. Šiuo
y imu siekiama a skleis i me odologines š ie imo e ek y umo mokykloje endencijas, ap ašomas
s aipsniuose, išspausdin uose e e uojamose JCR (WoS) i SJR (Scopus) duomenų bazėse (2014–
2018 m.), i ap ašy i jų ezul a us. Bu o išanalizuo i šešiasdešim sep yni s aipsniai. Remian is
ke u iasdešim penkiais a ink ais i nus a y us k i e ijus a i ikusiais s aipsniais, a lik a sis eminė
šių s aipsnių apž alga. Ty imo ezul a ai a skleidžia, kad s aipsniuose dažniausiai emiamasi
kiekybine y imo me odologija, o jos pag indu a lik us y imus analizuojan ys s aipsniai y a
publikuojami žu naluose, ei inguojamuose pi mojo a an ojo k a ilio lygmeniu pagal ci a imo
indeksą. Apibend in i mokyklos, kaip š ie imo o ganizacijos, e ek y umo ypa umai, ku ie bu o
suski s y i į ke u ias ka ego ijas, apima š ie imo požiū į, š ie imo p ak iką, š ie imo adybą bei
mokymosi kul ū ą. Taip pa a siž elgiama į indi idualius i kon eks inius š ie imo e ek y umo
ak o ius bei į aką akademinių pasiekimų ezul a ams. Remian is y ime apž elg ais s aipsniais
nus a y a, kad, no s i egzis uoja esminiai eiksniai, da an ys į aką š ie imo e ek y umui, ki i
kin amieji mokyklos lygmeniu aip pa u i į akos, pa yzdžiui: mokymosi kul ū a, ado ų
komanda, edukacinė p ieiga i š ie imo p ak ika.
Esminiai žodžiai: š ie imo e ek y umas, š ie imo kokybė, š ie imo ezul a ai, mokyklos
mokinių san ykiai.
Gau a 2020 05 21 / Recei ed 21 05 2020
P iim a 2020 07 03 / Accep ed 03 07 2020