Full text
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 1 TYPE Technology and Code PUBLISHED 20 September 2022 DOI 10.3389/fpsyg.2022.980902 OPEN ACCESS EDITED BY Nicola Pitchford, University of Nottingham, United Kingdom REVIEWED BY Sarah Bardack, Imagine Worldwide, United States Joaquín Parra Martínez, University of Murcia, Spain *CORRESPONDENCE Mahia Saracostti [email protected]; [email protected] Ximena de Toro [email protected] SPECIALTY SECTION This article was submitted to Educational Psychology, a section of the journal Frontiers in Psychology RECEIVED 29 June 2022 ACCEPTED 18 August 2022 PUBLISHED 20 September 2022 CITATION Saracostti M, de Toro X, Rossi A, Lara L and Sotomayor MB (2022) Implementation of a web-based system to measure, monitor, and promote school engagement strategies. A Chilean experience. Front. Psychol. 13:980902. doi: 10.3389/fpsyg.2022.980902 COPYRIGHT © 2022 Saracostti, de Toro, Rossi, Lara and Sotomayor. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. Implementation of a web-based system to measure, monitor, and promote school engagement strategies. A Chilean experience Mahia Saracostti1,2*, Ximena de Toro3*, Andrea Rossi1, Laura Lara4,5 and María Belen Sotomayor2 1Cátedra UNESCO Bienestar de la Niñez y Juventud, Educación y Sociedad, Escuela de Trabajo Social, Universidad de Valparaíso, Valparaíso, Chile, 2Núcleo Científico Tecnológico en Ciencias Sociales y Humanidades, Universidad de la Frontera, Temuco, Chile, 3Departamento de Trabajo Social, Pontificia Universidad Católica de Chile, Santiago, Chile, 4Departamento de Psicología, Universidad Autónoma de Chile, Santiago, Chile, 5Departamento de Psicología Evolutiva y de la Educación, Universidad de Sevilla, Seville, Spain This paper presents the implementation and usability of a technologybased web system and the available evidence on educational engagement’s predictive capacity to influence students’ educational trajectories in Chilean schools. The web-based system was developed through collaborative work between universities, the information technology team, school communities, and stakeholders (government institutions). It is an online system composed of six steps whose axis is centered on a decision-making space between teachers-students-parents (School Engagement Board) tasked with applying online and scientifically validated school engagement and contextual factors measurement instruments, checking specific report results for each actor involved in the system (teacher, School Engagement Board coordinator, school) as well as reviewing promotion strategies relevant to the school context and managing the implementation of strategies supported by the management datasheets that the model offers to schools. The objective of this paper is to present the usability of the system through a case study of the implementation in Chilean public schools. In order to discuss about what elements should be incorporated to adjust and improve the usability of the system and to guarantee its effective implementation, the paper describes those aspects that have favored and/or hindered the use of this educational technological platform in the Chilean case. The results show that there have been more difficulties related to management aspects than IT aspects, which indicates that these conditions are critical for implementation, even when system for evaluation, monitoring and strategies for the promotion of student engagement and contextual factors (SIESE) is designed for standalone use. Although there are aspects to be improved, such as extending its use to other browsers, improving the intervention guidelines and other systems functionalities, this web-based system has been considered by the Frontiers in Psychology 01 frontiersin.org
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 2 Saracostti et al. 10.3389/fpsyg.2022.980902 educational communities as a simple, useful, and intuitive platform. The paper concludes on the importance of having this type of platform in Chile and other Latin American countries, for its contribution to school management -being helpful for day-to-day educational practicedue to the different technical facilitators. KEYWORDS web-based system, platform evaluation, school engagement, evaluation and strategies, school web system implementation Introduction Monitoring systems for the promotion of successful educational trajectories Quality education is a fundamental right and is part of the Sustainable Development Goals (SDGs). To achieve this goal, it is vital to promote school retention and prevent dropout. Monitoring systems are one of the recommended measures (Fredricks et al.,2019;Hofkens and Rozek,2019;de Toro et al., 2021). They are referred to as educational trajectory protection systems or early warning and intervention systems. Regardless of their denomination, prevention and promotion only occur if detection is accompanied by a set of measures. UNESCO (2021) highlights how these systems can become effective tools for reducing dropout, and the importance of linking them with other educational management systems. Monitoring systems are an essential element to evaluate program and processes, to identify strengths or weaknesses in schools, to contribute to decision-making and carry out educational management processes at different levels, for example at the school, local or government level (Komar et al., 2019). The Chilean Ministry of Education in its Framework for Good School Management and Leadership establishes a specific dimension for the monitoring process, indicating that management teams should monitor the comprehensive implementation of the curriculum and learning achievements in all areas of student training for the improvement of teaching and pedagogical management processes (Leiva-Guerrero et al., 2022). Likewise, Local Educational Services, also by law, must have follow-up, information and monitoring systems that address the evaluation of the processes and results of educational institutions, as part of the continuous improvement of the quality of education. Abbreviations: SIESE, System for Evaluation, Monitoring and Strategies for the Promotion of Student Engagement and Contextual Factors; SE, School Engagement; CF, Contextual Factors. UNESCO (2021) notes that there are two monitoring systems. The first is a model based on expert knowledge or indicators that identify the most at-risk students. A second model is based on data analysis using machine learning techniques that process large amounts of data to identify trends in the aggregate behavior of indicators by schools or geographic areas. This second model is used when student-level data is not available. While in the models based on expert knowledge there are successful experiences using a few indicators, the other models require a large amount of information, including quality historical data, to produce good results. Moreover, as the latter models use a large amount of data, the information obtained may not be easily understandable. For this reason, the first models are more recommendable. Indicators with scientific evidence A fundamental component of monitoring systems is to have scientifically validated indicators that provide schools with clues about what decisions to make to improve the educational trajectories of students. School engagement (SE) is one of the key indicators since abandonment is not usually a sudden act, but rather the final stage of a cumulative process of a loss of commitment to studies (Miranda-Zapata et al.,2018,2021; Fredricks et al.,2019). School engagement is considered a primary concept to promote school retention and protect educational trajectories. SE can be defined as the active participation of the students in the educational process, while they are motivated and consider their learning as meaningful. SE is a multidimensional construct with an affective, a behavioral and a cognitive dimension. Affective dimension refers to the level of emotional response of the child toward the educational institution and their learning process, characterized by a feeling of involvement with the school and a consideration of it as a place worth being part of. Behavioral dimension includes student interactions and responses within the classroom, school, and extracurricular settings. Finally, cognitive dimension is Frontiers in Psychology 02 frontiersin.org
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 3 Saracostti et al. 10.3389/fpsyg.2022.980902 the conscious investment of energy to build complex learning that goes beyond the minimum requirements (Shernoff,2013; Fredricks et al.,2016,2019;Christenson et al.,2018;Lara et al., 2018;Miranda-Zapata et al.,2018;Saracostti et al.,2019,2021). This concept has become even more relevant in times of pandemic and post-pandemic, as remote classes were installed as an alternative modality in the face of the uncertainty of the behavior of COVID-19, with attendance losing strength as an indicator of educational processes (Zhao and Watterston,2021). On the one hand, SE is a variable highly influenced by Contextual Factors (CF), mainly by (i) family support; (ii) peer support and (iii) teacher support (). Family factor refers to the fact that students perceive family support in the learning process, in case of problems, with homework, in motivational terms, together with conversations about what happens at school. Pers support has been defined as the perception that students have about interpersonal relationships between classmates, that is, the concern, trust and support that is given between peers. Finally, teacher support refers to the fact that students perceive receiving support and motivation from teachers to learn or in case of any inconvenience (Saracostti et al.,2019;Navarro et al.,2021). On the other hand, the literature, together with international and national organizations, agree that having systems capable of evaluating, monitoring and promoting the school engagement contribute to prevent school dropout and promote positive trajectories in a much timelier manner than those initiatives that focus exclusively on the classic risk factors such as absenteeism or falling behind in school. The relevance of focusing on school engagement lies in the fact that it is a highly moldable variable and on which schools can intervene, unlike more structural factors such as poverty. Schools and local entities can be benefited from an integrated and articulated system for promoting SE and FC, since it could identify common needs among students and courses that require additional support, while governments Local authorities can focus resources on those schools or areas that need to reinforce their SE, together with evaluating the effectiveness of the available interventions. It is also suggested that these systems be based on robust technical components that do not increase the teaching load (Bruce et al., 2011;de Toro et al.,2021). Robust technical components Collecting data on indicators associated with the risk of dropping out is not enough to prevent school dropout. It is necessary a methodology for this purpose (UNESCO,2021), to have robust technical components and to be connected to a network of interventions (de Toro et al.,2021). Regarding the use of data for the improvement of educational processes, Parra and Matus (2018) recommend having digital registration systems that systematize information and deliver indicators over time, so that strengths and alerts can be quickly and timely identified; and on the other hand, to follow up in the different educational periods. The web-based school system software automates school operations and helps to reduce management burden. Based on an incremental scientific-technological development, the Web-Based System to Measure, Monitor, and Promote School Engagement Strategies (SIESE), easily and quickly accessible at https://compromisoescolar.com/ allows measuring, monitoring and intervening on the basis of automated reporting in favor of School Engagement (SE) and the Contextual Factors (CF) which influence it of students in educational transition from 5th grade (or 5th grade of primary school, 10−11 years old) to 12th grade (secondary school or 2nd year of high school, 17−18 years old) (de Toro et al.,2021). System for evaluation, monitoring and strategies for the promotion of student engagement and contextual factors has been perfected and adjusted to the reality of diverse educational community contexts to integrate on-site the requirements for its proper use. For this reason, throughout the incremental scientific-technological development, based on different R + D + i projects, which resulted in the SIESE, platform operation was evaluated and adjusted according to the suggestions and observations for improvement of the participating educational communities of the country (de Toro et al.,2021). In addition, SIESE contains scientific validations of (i) measurement tools of SE and FC (Lara et al.,2018,2021, Navarro et al.,2021;Sotomayor et al.,2021), (ii) predictive model of the Effect of School Engagement on Attendance to Classes and School Performance that is at SIESE base of operation (Miranda-Zapata et al.,2018), and (iii) strategies proposed (Leyton et al.,2021). System for evaluation, monitoring and strategies for the promotion of student engagement and contextual factors was developed using SCRUM methodology (de Toro et al.,2021), which is a lightweight software development methodology that relies on incremental development and focuses on delivering several iterations of a product. It was developed through collaborative work between the university team (researchers), information technology team, school communities, and stakeholders (government institutions). Technical details of the software and hardware that supports the different components of the technological platform, which should be considered at the time of installation and transfer, are detailed as follows: •User Layer: The client application for accessing the measurement instruments, intervention strategy record cards, and downloading reports are executed through a Web browser installed on the accessing computer, preferably Chrome or Firefox. Mobile accessibility stands out in this layer so that participants can access the surveys and reports using mobile devices such as Frontiers in Psychology 03 frontiersin.org
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 4 Saracostti et al. 10.3389/fpsyg.2022.980902 tablets or smartphones to facilitate the application and distributed follow-up. •Applications Layer: Consisting of the server where the modules for authentication, measurement instruments, reports and longitudinal monitoring, and strategies and record datasheets for the actions implemented in the respective classes and schools are installed. The measurement instruments in an online format were developed based on LimeSurvey technology that uses the Yii (PHP) development framework as a base. In the case of the results report visualization module, these were developed using HTML, JavaScript, CSS, and PHP development environments. •Data: Consisting of the database in which the information of each participant in the measurement process is stored, as well as the profiles associated with the management of the platform and the educational resources available (audios, videos, documents, etc.). The database implemented the MySQL engine, running on a centralized, high-performance server (24/7) and available in the cloud (Internet) under Linux operating system and Apache Web server. Background: Use of system for evaluation, monitoring and strategies for the promotion of student engagement and contextual factors through its 6 steps System for evaluation, monitoring and strategies for the promotion of student engagement and contextual factors, which is based on the Early Warning System developed by the National High School Center of the American Institute for Research (AIR, 2020), proposes the sequential execution of 6 steps: composed of 6 steps: (i) Step 1: Formation of the SE Board; (ii) Step 2: Measurement of SE; Step 3: Review and analysis of the information; Step 4: Selection and implementation of strategies; Step 5: Monitoring of students and strategies; Step 6: Evaluation and adjustment of the implementation of the System (de Toro et al.,2021). Each step is briefly described below, as well as some guidelines for their execution (Tables 1–7): Those who are participants in the SE Board, as well as any other member of the educational community who so desires, can be trained through the same platform in the Complementary Material module by means of seven short videos, publications on conceptual and methodological aspects, technical documents, seminar and/or webinar records, frequently asked questions, among other resources. The SIESE also has a User’s Manual, a guiding document to optimize its use. TABLE 1 Implementation of step 1: System for evaluation, monitoring and strategies for the promotion of student engagement and contextual factors (SE) board formation. Description step 1: SE board formation Guiding questions Participative constitution of a decision-making space within the school to carry out the implementation. The SE Board can be by class, educational level or school and it is desirable that it be made up of students, teachers, psychosocial professional teams, families and management teams. The participation of students and families is fundamental and representatives of other projects that work in the school to promote positive educational trajectories can also be involved. 1. Who will be part of the Board? 2. Does the Board include the participation of students and families? 3. What other representatives that support the students within the school could join? 4. Who will be the coordinator responsible for convening the meetings and completing the registration forms included in the system? 5. Does the Board have sufficient authority to implement changes, and what will it take to get it to do so? 6. What resources or strategies does the school have to promote SE? Specific resources Expected results -Training (Complementary Material module with educational resources, hosted in the same web system). -Activity Calendar (annual schedule of 10 meetings). -1st Meeting of the School Engagement Board to choose a School Engagement Board coordinator and plan the annual meetings. -Training of the participants of the Board through the Complementary Material module. Source: own elaboration based on https://compromisoescolar.com/. Once the SE Board is constituted, the schools can lead the second step, which is related to the process of applying the measurement instruments (Table 2). Once the students have answered the SE and CF questionnaires, the SE Board can analyze the data recorded in the platform and establish a diagnosis (Table 3). System for evaluation, monitoring and strategies for the promotion of student engagement and contextual factors provides annual (annual measurement) and follow-up (or longitudinal) reports for cases where more than one measurement has been made, at the school, grade and student level. The following is a description of how the data are presented in each of these reports, considering the graphs to support their interpretation. Annual reports: At student level The analysis of results per student can be based on two readings: through the scatter graph (Figure 1) considering four possible profiles (high SE and low CF; high SE and high CF; low Frontiers in Psychology 04 frontiersin.org
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 5 Saracostti et al. 10.3389/fpsyg.2022.980902 TABLE 2 Step 2: SE measurement. Description step 2: CF and SE measurement Guiding questions It is expected that in this step a strategy will be organized to communicate the objective of the SIESE to the rest of the school community. Subsequently, the idea is that students can answer the SE and CF measurement instruments. The system allows to apply the measurement instruments once a year, in a classroom context (computer room) or remotely (zoom or similar). The SE Board coordinator has to activate the code so that students can respond. It is suggested that responses can be collected within 1 week. 1. How do we sensitize the entire educational community on the importance of SE? 2. How will we promote the application of the SE and CF instrument among the students, considering whether we are in a face-to-face, hybrid or non-face-to-face context? 3. Who will be responsible for the promotion? 4. Who will explain to the students how to answer the SE and CF instrument in this platform? 5. Where will the application take place? 6. What strategies will be implemented to ensure that those who have not completed the SE and CF instrument will be able to do so? Specific resources Expected results -User manual of the platform. -SE (29 items) and CF (18 items) measurement instruments, created and validated with good levels of fit for Chile and later for other Ibero-American countries (Lara et al.,2021) with 5-point Likert-type response scales (1 = Never or almost never, 2 = Sometimes; 3 = Often, 4 = Many times and 5 = Always or almost always). - 2nd Meeting of the Board to coordinate a strategy to promote SE among students, along with the meaning of measuring SE. - Measurement of School Engagement. - Review of the percentage of instruments answered. - 3rd Meeting of the SE Board to coordinate additional strategy and assign responsibilities to ensure that students who have not completed the instrument are able to do so. - Review of the percentage of final responses. Source: own elaboration based on https://compromisoescolar.com/. SE and low CF; low SE and high CF) and through the SE and CF graphs (Figure 2), which allow identifying signs of strengths and alerts, without showing scores in order to avoid stigmatizing boys, girls and adolescents [BGA] (Saracostti et al.,2021). Once teachers and/or education professionals and the SE Board Coordinator review both types of graphs, it is suggested to take note of the most relevant aspects for later discussion at the SE Board. The interpretation of student reports is of vital importance for targeted and/or individual interventions. Annual reports: At grade level In addition to the scatter graphs that place each grade on axes of intersection of high and low levels of SE and CF, the reports by grade also contemplate pie charts that represent the percentage of students in each dimension of SE TABLE 3 Step 3: Review and analysis of the information. Description step 3: Information review and analysis Guiding questions This step involves downloading and reviewing the results reports by grade that this platform produces in an automated manner based on algorithms (Saracostti et al.,2021), which are protected by intellectual property confidentiality. There are reports according to the different SIESE access profiles The individual reports are reserved for the exclusive use of teachers and/or psychosocial team and not for the work of the SE Board. Then, it is expected that all the members of the SE Board actively participate in the analysis and interpretation of the data by grade, complementing the quantitative information provided by this platform with background information provided by families, students and teachers, which will allow a better understanding of the results. This diagnosis is of vital importance as an initial baseline for decision making regarding the selection of strategies to be applied. 1. Who will download the reports from the platform for the SE Board? 2. What other indicators can be analyzed to complement the information (e.g., performance, behavior, attendance)? 3. What information does the platform provide? 4. What needs emerge from the analysis of the results? 5. What school or classroom practices can be linked to the results shown on the SE platform? Specific resources Expected results -Platform User Manual. -Reports of SE and CF measurement results at student, grade and school level. -Coordinator downloads the results reports. -4th SE Board meeting to analyze reports and identify causes and needs associated with the results. Source: own elaboration based on https://compromisoescolar.com/. and CF at four levels of SE development (emerging, developing, satisfactory, highly developed) and four levels of CF (low, medium, high and very high) (Saracostti et al.,2021). The report by grade also allows visualizing the concentration of students per item of each SE dimension (e.g., “When I am studying, I write down new words, doubts or important ideas,” “I feel that I am important to the school,” or “I behave in class”) and CF (e.g., “I talk to my family about what I do at school,” “My classmates support me and care about me,” or “Teachers care about me not only as a student but also as a person”), according Frontiers in Psychology 05 frontiersin.org
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 6 Saracostti et al. 10.3389/fpsyg.2022.980902 FIGURE 1 Example of results by system for evaluation, monitoring and strategies for the promotion of student engagement and contextual factors (SE) and contextual factors (CF) dimensions of the Student Web Report (scatter graph). Source: https://compromisoescolar.com/. Reproduced with permission. FIGURE 2 Sample of SE and CF Alerts and Strengths results from the Student Web Report. Source: https://compromisoescolar.com/. Reproduced with permission. to each response level (Never or Almost Never, Sometimes, Often, Many Times, Always or Almost Always). Annual reports: At school level Each educational institution can have scatter graphs of four profiles similar to Figure 1, which allow locating the levels of SE and CF, considering all the grades that participated in the measurement (Saracostti et al.,2021). Monitoring or longitudinal reports: For multiple schools (for educational administrators), by school, grade level and student Longitudinal reports make it possible to analyze over time, establish trends and follow up on the grouped or individual behavior of students in order to identify changes in advance and intervene in a timely manner (Figure 3). Considering also that the SE and CF measurement instruments were created Frontiers in Psychology 06 frontiersin.org
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 7 Saracostti et al. 10.3389/fpsyg.2022.980902 FIGURE 3 Examples of follow -up reports: “Administrator” Profile [A]. “Educational Institution” [B] Profile follow-up report. Source: https://compromisoescolar.com/. Reproduced with permission. Frontiers in Psychology 07 frontiersin.org
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 8 Saracostti et al. 10.3389/fpsyg.2022.980902 and validated for students from 5th to 12th grade, it would be possible to monitor and follow up during an important period of the students’ school career (Saracostti et al.,2021). At the student and grade level, it is possible to access results reports similar to those shown in Figure 3. Once the data has been analyzed through the different accesses to results that SIESE allows the SE Board must socialize this information to develop a collaborative decision-making process in order to promote SE and CFs of its students. To support the educational communities in this process, the platform offers guides to the actors involved in the selection and implementation of strategies that are relevant to their school context (Table 4). Once the search for strategies relevant to the results reflected in the reports provided by the SIESE has been carried out, it is possible to access explanatory sheets of the SE and CF promotion strategies, in web and downloadable versions, in order to select the most appropriate ones for the school context and student needs (Leyton et al.,2021). In addition, if you prefer to know all the strategies at once, it is possible to access a downloadable compendium (Table 5). Each strategy indicates the sub-dimension of the SE and/or the CF it seeks to enhance. Each strategy sheet also indicates whether or not it is applicable in a non-face-to-face context, and whether its implementation is individualized (with one student), targeted (with a group of students) or universal (with the entire class or school) (Table 6). Once the strategies have been selected, the SE Board can fill in the “Action Plan” sheet (Figure 4) with the interventions identified as relevant to be implemented in their school context. Although SIESE is based on the comprehensive perspective of education as a universal right, it also allows, in a complementary manner, the registration of targeted interventions in cases that merit it. In relation to this last level, the use of the Individual SIESE Form supports decision making for specific student situations that require a more personalized intervention. In the same way, confidentiality and ethical management of the data entered in the Individual SIESE Form must be ensured (Figure 5). This Individual SIESE Form records that the intervention actions should be oriented to the promotion of CF. Complementarily, it is possible to evaluate joint actions associated with other management systems present within each school. The last step of the implementation of the SIESE system includes the final evaluation and adjustment, as seen in Table 7 and Figure 6 Materials and methods Design This paper shows the results of a qualitative and descriptive multiple case study. A case study allows to explore different TABLE 4 Step 4: Selection and implementation of the SE promotion strategies. Description step 4: SE promotion strategy selection and implementation Guiding questions In this step, the SE Board has to identify the most relevant intervention strategies for the grade and the school, as well as for the individual students. This analysis will be recorded in the first datasheet called “Action Plan.” To do so, you can enter the SIESE strategy search engine where you will find a set of datasheets with guidelines for the promotion of SE and CF. These strategies are based on international evidence, reviewed by teachers and school coexistence teams in Chile and adapted to the national context The Board will have to select those strategies that are most relevant to promote the different types of SE (affective, cognitive or behavioral) and CF (family, teachers or peers). Other interventions already identified or implemented in the school or in other schools can also be enhanced. It should be addressed how the strategies will be implemented and which other actors should be incorporated in their application (e.g., other teachers and/or professionals). 1. What existing strategies in our school are relevant to foster SE and what could be enhanced to address the needs reported by this platform? 2. What strategies described in this platform could be implemented in our school? 3. What steps do we need to follow to manage the implementation of the strategy? 4. What additional actors to the SE Board need to be involved in the implementation of the strategies? 5. How to engage their participation? Specific resources Expected results -Strategy search engine -SIESE datasheets: Grade action plan (Figure 4). -SIESE datasheets: Individual datasheet. -Review the intervention strategies available on the platform (23) and select the one or ones most relevant to the school context (Table 5). -Fourth meeting of the SE Board to complete the Action Plan Worksheet (Figure 4). - Planning strategy management. Source: own elaboration based on https://compromisoescolar.com/. parts of a phenomenon, and the way in which events, actors and structures converge in the same space (Yin,2018). Each case is understood as a school in which the SIESE was applied throughout the school year. Being a case study, in-depth contact with singular realities was privileged over a large number of individuals as a source of information. Sample The study considered six public schools with a high level of school vulnerability (about 90%) in two regions of Chile (V and VI Regions) belonging to the country’s Frontiers in Psychology 08 frontiersin.org
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 9 Saracostti et al. 10.3389/fpsyg.2022.980902 TABLE 5 Summary of the strategies proposed in the SIESE, according to SE dimension and Contextual Factors. SE dimension Universal Targeted Individual Affective - Parental counseling - Connecting learning with real life - Regular contact with fathers, mothers and guardians - Joint goal setting - Peer-to-peer collaborative learning strategies - Encouraging family involvement - Improving school climate - Promoting restorative practices - Promoting empathy - Acknowledging student voice - Rethinking extracurricular activities - Strengthening social-emotional skills to reduce bullying - Strengthening student participation in classes - Identifying learning needs in a collaborative context - Pedagogical tutoring - Regular contact with parents and guardians - Identifying learning needs in a collaborative context Behavioral - Parental counseling - Promoting restorative practices - Promoting empathy - Student-led family interview - Problem-solving technique Cognitive - Parental counseling - Connecting to the future of work - Connecting learning to real life - Promoting growth mindset - Informed feedback - Learning on a project basis - Identifying learning needs in a collaborative context - Pedagogical tutoring - Identifying learning needs in a collaborative context CF dimension Universal Targeted Individual Family •Parental counseling •Regular contact with parents and guardians •Encouraging family involvement •Promoting restorative practices •Regular contact with parents and guardians •Student-led family interview •Problem-solving techniques Teachers •Connecting learning to real life •Emotional connection •Strengthening student participation in class •Improving school climate •Promoting a growth mindset •Acknowledging student voice •Emotional connection •Strengthening student investment in learning •Identifying learning needs in a collaborative context •Pedagogical tutoring •Identifying learning needs in a collaborative context Peers •Emotional connection •Joint goal setting •Peer-to-peer collaborative learning strategies •Improving school climate •Promoting restorative practices •Rethinking extracurricular activities •Emotional Connection •Strengthening social-emotional skills to reduce bullying •Problem-solving techniques Source: https://compromisoescolar.com/estrategias. Reproduced with permission. central macrozone. The V Region of Valparaíso is the third most populated region in Chile, mainly urban and 19% of its population is in multidimensional poverty. The VI Region of Libertador Bernardo O‘Higgins represents 5.2% of the national population (sixth most populated in Chile), with a 25.6% rural population. The poverty rate (7.9%) is higher than the national rate (6.3), although multidimensional poverty is lower (18.5%) than the Chilean average (20.7%). In Chile, public school students come from families with lower incomes and lower socio-cultural capital, which represents the segregation of the Chilean educational system. A high level of school vulnerability is equivalent to <85%. School Vulnerability Index (IVE, in Spanish) calculated annually by the National School Aid and Scholarship Board (JUNAEB,2005), which ranges from 0% to100%, where the higher the percentage, the higher the vulnerability index. This percentage indicates the proportion of students defined as priority students (JUNAEB,2005; Brunner,2006). This index is measured according to poverty conditions and risk of school failure, including variables such as family socioeconomic context, access to the health system, housing quality, and parents’ educational level, among others. For school recruitment, this index is Frontiers in Psychology 09 frontiersin.org
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 16 Saracostti et al. 10.3389/fpsyg.2022.980902 Follow-up of the action plan A risk observed in the experience of Step 5 has been the nonimplementation of the strategies planned to be applied in the “Action Plan.” To this end, we insist on the recommendation to ensure the implementation of the follow-up meetings suggested in the SIESE to review the planning and adjust, if necessary, according to the real needs and possibilities of the schools, making effective use of the monitoring sheets hosted on the platform. It was also suggested that the Action Plan Worksheet should allow “Adding evidence, uploading supporting documents, attendance data, audiovisual files” (interview, school 4). Continuity over time Given that the changes in SE and CF after the implementation of the strategies cannot necessarily be visualized in the short term, it is important that the implementation of the SIESE covers more than one semester, ideally the whole academic year, to ensure all instances of follow-up and to glimpse certain effects and/or impacts after the intervention. In this sense, it is observed, and interviews reaffirm that to the extent that the strategy or strategies tested (at the grade level) are complemented with changes at the school level and individualized strategies, it is likely that more changes will be perceived between one implementation and another (data sheets, school 3 and 6). Reinforce roles for system for evaluation, monitoring and strategies for the promotion of student engagement and contextual factors implementation Other suggestions resulting from participant observations are in line with what has already been pointed out in the SIESE, such as encouraging the participation of students and parents, together with “reinforcing the role of school administrators and management teams for the socialization of the SIESE, motivating the rest of the members of the educational community and providing resources, mainly in terms of the time required, for example, by the Coordinator of the SE Board, and for the management of the interventions” (data sheet, school 2). With this, favoring and/or ensuring the distribution of tasks so that responsibilities are shared among the members of the Board and not only charged by the Coordinator. This is key when completing the “Action Plan” worksheet. Discussion System for evaluation, monitoring and strategies for the promotion of student engagement and contextual factors implementation of educational software faces challenges that require consideration to ensure effectiveness in its use. Based on the experiences described in this article, four challenges related to effective SIESE implementation in schools stand out. Each of these challenges is briefly discussed below. Requirements for technological installation and articulation with other educational management software The school engagement platform corresponds to a Web solution consisting of six stages, allowing the application of surveys, deployment of reports, intervention record cards, and storage of pedagogical resources. Considering this background, a central requirement for system installation is access to connectivity and use of the Internet. Regarding this, we highlight that in the case of Chile, the progression in Internet access has been dramatic: from 16% of the population in 2000 to 82% in 2018. Considering household access, it has gone from 32% in 2009 to 87% in 2017. The access gap between urban and rural areas has also decreased, from a difference of 27% in 2009 to 12% in Brújula Investigación y Estrategia (2017). Despite these advances, these studies also find that there are still differences in access by socioeconomic level, geographic areas, and age. The school engagement web system has been developed and validated for autonomous management by schools; however, some improvements are still required. On the one hand, it is necessary to consider that to make modifications or improvements to the web system, in terms of the production environment, support from a computer expert is required. Some of the system’s challenges arise from the fact that some of an engineering team’s current actions could be conducted by education professionals. For example, to facilitate editing of measurement instruments or reporting format to make it easier and unnecessary to involve a technical engineering team. Another central challenge for the installation is the articulation and communication between the school commitment software and the hardware technological infrastructure where the software works, as well as the articulation with other educational management platforms available in the public institutions and the schools. In this last aspect, for some users, data integration with other databases available in the schools, such as attendance or school performance databases, became relevant. Usability of the platform and support for school management in decision making As stated by Hu (2022), a good application of educational information systems can contribute to the efficiency of Frontiers in Psychology 16 frontiersin.org
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 17 Saracostti et al. 10.3389/fpsyg.2022.980902 educational management, to which Luan (2014) adds by guaranteeing the secure recording of information. In this context, SIESE stands out for its ability to provide school management with the possibility of articulating in the same information management system, measurement (quickly and massively), monitoring, and intervention at diverse levels: universally (establishment), targeted (course) and personalized (student). In this context, the challenge of any technological system is presented, and it is related to the ability to be used simultaneously by an important number of entities or people (multiple users). Luan (2014) defines this as concurrency. In this sense, SIESE’s usability −highlighted by the experiences in the 6 Chilean public schools that participated in its implementation −favors school management since it can be used massively and quickly, we must not lose sight of aspects such as those indicated by the IDB (2021) about the Educational Information and Management Systems [SIGED] for Latin America and the Caribbean, for example, having a long-term strategic vision and responding to the needs of the educational system, ensuring interoperability between platforms and applications, and the availability of both economic and human resources for their development and implementation. Now, most of the systems of this type available in the region aim at providing information for the central level. Not many platforms are helpful for day-to-day school practice, like monitoring students and/or teachers (IDB,2021). In this case, the SIESE represents an added value since it provides relevant information for school decision-making (Schildkamp,2019; Soncin and Cannistrà,2022), either at the circumstantial or longitudinal level. Likewise, the internal generation of data and the collaborative analysis on which SIESE is based constitute a benefit concerning other current measurements that commonly respond to isolated indicators or data, generated from external evaluations often perceived by Chilean educational communities as belonging to a system focused on accountability (accountability or accountability for results) (UNESCO, 2017;Riquelme et al.,2018). On the contrary, the SIESE approach highlights the importance of a non-standardized, non-prescriptive, and formative logic that encourages collective practices in data use through reflective rather than instrumental cycles. In this sense, the functionality of SIESE could approach a technological approach more pedagogical than administrative, or of internal utility from the data generated (UNESCO,2017) and thus, make more sense to the educational community members and favor its appropriation. However, agreeing with Selfridge (2018), another challenge lies in using and interpreting the data provided by educational software such as SIESE. It calls for the importance of having training processes that ensure the installation of capacities of the teams in schools in this area, for example, to understand quantitative data, know how to interpret diverse types of graphics, link them together, and how they can be used in favor of pedagogical processes. As Schildkamp (2019) states, data becomes helpful when it is transformed into information that can be applied through actions that benefit the context. By Parra and Matus (2018), Soncin and Cannistrà (2022), reflective use of data in educational entities is highly desirable not only to favor decision making but also to encourage continuous improvement of pedagogical practices in favor of students’ learning and their educational trajectories. This is what the SIESE proposes conceptually and methodologically at its base. Technical-pedagogical support: Socialization and training Although the platform incorporates training modules of diverse types to support the implementation process autonomously, from the case studies, the support provided is in the form of technical-pedagogical accompaniment (OEI,2018) to conduct the different steps of SIESE is generally and positively recognized (OEI,2018). From the results, the need for this support given the complexities of resources, for example, the time and excessive workload for teachers, can also be confirmed. The results also make it clear that there have been more difficulties related to management aspects than IT, indicating that these conditions are critical for implementation even when SIESE is designed for stand-alone use. In addition, given the stated need to incorporate more support resources or guidance on the use of the SIESE sheets, Schildkamp (2019) also emphasizes the relevance of socialization processes, whether external and/or internal, from the management teams and training that can provide an induction to encourage the efficient use of the platform. Educational community participation is a transversal axis of implementation The platform proposes an interdisciplinary team approach (eco systemic perspective) with the involvement of various stakeholders from the educational community (Saracostti et al., 2020); however, in the case studies, the community was not always fully represented. In addition, the analysis and decision-making process involved adults, mainly members of the schools. In particularly vulnerable contexts, parents’ lack of experience in being part of school decision-making or sitting next Frontiers in Psychology 17 frontiersin.org
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 18 Saracostti et al. 10.3389/fpsyg.2022.980902 to principals and teachers is a complexity endemic to the Chilean education system. In general, decisions are delegated to the school. Added to this is the adultcenteredness of our society, a framework that the SIESE encourages to model. Therefore, the composition of the CE Board constitutes a challenge regarding the configuration of a new cultural paradigm in the educational community. This requires the generation of mechanisms to promote the effective participation of students and parents in the CE Board. Given this context, it is imperative to raise awareness about these instances as nonbureaucratic but democratic spaces with clear goals and clear roles within the Board. An emphasis should be placed on the role that children and adolescents play as protagonists and decisionmakers in their processes (Collins et al.,2021). Along the lines analyzed by Petrone et al. (2020), in this type of instance, there is an opportunity to overcome adult centrism (UNICEF, 2013). Given that SIESE presents proper usability from the schools’ experience, for it to be effectively implemented and contribute -as proposed- to educational management, it is necessary to consolidate participation and collaborative decision-making between teachers-students-families. In this sense, management aspects re-emerge as key conditioning factors and challenges adjacent to the technological aspects. Final conclusion One of the biggest educational challenges in Latin America is to develop systems that protect educational trajectories (IADB Blog,2020). In this context, having integrated systems for measuring, monitoring, and promoting school engagement strategies, such as SIESE (Saracostti et al.,2019;de Toro et al., 2021), becomes a relevant and timely tool for the region’s challenges, which have been reinforced by the impact of the COVID’s socio-health crisis. The most recent published literature (Fredricks et al., 2019;Hofkens and Rozek,2019;AIR,2020) agrees on the appropriateness of generating systemic proposals that promote measurement, monitoring, and intervention strategies in a not only targeted but uniquely universal manner, through promotional and preventive strategies for groups of students (not exclusively aimed at those with alerts). System for evaluation, monitoring and strategies for the promotion of student engagement and contextual factors responds to this paradigm and the current needs at the country and regional level (IDB,2021). The school engagement and contextual factors assessment instruments have been assessed on a small scale in other Latin American countries, and progress has been made in their validation and adjustments. Work was conducted in four Ibero-American countries: Spain, Peru, Colombia, and Uruguay (Lara et al.,2021). This allows us to point out future challenges to the internationalization of the system, posing the challenge and the opportunity to conduct consultancies and support the validation of the evaluation platform and the implementation of a system of evaluation, follow-up, and strategies for the promotion of school commitment in Spanish-speaking countries. A central challenge would be the technological debugging, consisting of an exhaustive review and adjustments to the technological architecture (servers and services) to adjust the web system to other countries and avoid collapses in the face of a massive use by schools geographically distributed in distinct parts of Chile and other Latin American countries. However, based on the technological advantages of SIESE (resources provided and usability), it is necessary to ensure that certain essential conditions are in place for it to be used effectively in its implementation, as described in this article. The results and conclusions of this article point to the importance of continuing research on how information is organized, managed and used in educational centers (Soncin and Cannistrà,2022) in the context of the progressive development of data systems for educational management (IDB, 2021). Much has been published in Anglo-Saxon journals on psychosocial or psychoeducational interventions within schools and their impacts on a wide range of areas, including student behavior, school climate, school engagement and school retention, among others. These studies are still scarce in Latin America. One of the main challenges for future research in Chile and Latin America is the need to conduct studies with probability samples. Therefore, we suggest the need for quasiexperimental designs to study the effects of SIESE usability and implementation on educational trajectories and other outcomes. On the other hand, the time factor may have possible effects of achieving more decisive results considering that establishing trusting professional relationships between schools, families, and students (School Engagement Boards) take time and is key in these types of integrated interventions. Data availability statement Publicly available datasets were analyzed in this study. This data can be found here: https://compromisoescolar.com/. Ethics statement The studies involving human participants were reviewed and approved by the Comité de Ética Científico de la Universidad Autónoma de Chile. The patients/participants provided their written informed consent to participate in this study. Frontiers in Psychology 18 frontiersin.org
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 19 Saracostti et al. 10.3389/fpsyg.2022.980902 Author contributions MS, XT, and AR drafted the manuscript. MS and XT developed the study concept and the study design. MBS and AR performed the data collection. MS, XT, AR, and LL contributed to the interpretation of the data and provided important critical revision. All authors approved the final revision and also agreed to be accountable for all aspects of the work. Funding This work was supported by ANID/FONDECYT 1210172 and ANID/FONDEF IT19I0012. Conflict of interest The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. Publisher’s note All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher. References AIR (2020). Early warning intervention and monitoring system implementation guide 2020. Available online at: https://www.air.org/sites/default/files/EWIMS- Implementation-Guide-FINAL-July-2020.pdf (accessed February 01, 2022). Braun, V., and Clarke, V. (2006). Using thematic analysis in psychology. Qual. Res. Psychol. 3, 77–101. doi: 10.1191/1478088706qp 063oa Brunner, J. (2006). “Concepto de calidad en educación,” in Paper presented at the Fundación Chile, La Serena. Bruce, M., Bridgeland, J., Hornig, J., and Balfanz, R. (2011). On track for success. The use of early warning indicator and intervention systems to build a grad nation. Washington, DC: Civic Enterprises, Everyone Graduates Center. Brújula Investigación y Estrategia (2017). IX encuesta de acceso y usos de internet. informe final preparado para la subsecretaría de telecomunicaciones de Chile. Available online at: https://www.subtel.gob.cl/wp-content/uploads/2018/ 07/Informe_Final_IX_Encuesta_Acceso_y_Usos_Internet_2017.pdf (accessed May 23, 2022). Christenson, S. L., Reschly, A. L., Appleton, J. J., Berman, S., Spangers, D., and Varro, P. (2018). “Best practices in fostering student engagement,” in Best practices in school psychology V, eds A. Thomas and J. Grimes (Washington, DC: National Association of School Psychologists), 1099–1120. Collins, T., Rizzini, I., and Mayhew, A. (2021). Fostering global dialogue: Conceptualisations of children’s rights to participation and protection. Child. Soc. 35, 295–310. doi: 10.1111/chso.12437 De Toro, X., Sotomayor, B., Saracostti, M., Rossi, A., and Lara, L. (2021). Plataforma online de evaluación de compromiso escolar, Versión 3.0: Avance hacia un sistema de protección de las trayectorias educativas. Eur. J. Educ. Psychol. 14, 1–29. doi: 10.32457/ejep.v14i2.1739 Fredricks, J., Filsecker, M., and Lawson, M. A. (2016). Student engagement, context, and adjustment: Addressing definitional, measurement, and methodological issues. Learn. Instruct. 43, 1–4. doi: 10.1016/j.learninstruc. 2016.02.002 Fredricks, J., Reschly, A., and Christenson, S. (2019). Handbook of student engagement interventions. San Diego, CA: Elsevier Science & Technology. Hofkens, T., and Rozek, E. (2019). “Measuring student engagement to inform effective interventions in schools,” in Handbook of student engagement interventions: Working with disengaged students, Vol. 21, eds J. Fredrick, A. Reschly, and S. Christenson (Boston, MA: Academic Press), 309– 324. Hu, B. (2022). “The application of computer database system in educational information management,” in Forthcoming networks and sustainability in the IoT era. FoNeS-IoT 2021. Lecture notes on data engineering and communications technologies, eds F. Al-Turjman and J. Rasheed (Cham: Springer), 129. doi: 10. 1007/978-3-030-99616-1_19 IADB Blog (2020). COVID-19 educación: Regresaremos, pero ¿regresaremos todos?. Available online at: https://blogs.iadb.org/educacion/es/covid19regreso/#_ ftn4 (accessed February 23, 2022). IDB. (2021). Los sistemas de información y gestión educativa (SIGED) de América Latina el caribe: La ruta hacia la transformación digital de la gestión educativa. Available online at: https://publications.iadb.org/publications/spanish/ document/Los-Sistemas-de-Informacion-y-Gestion-Educativa-SIGED-de- America-Latina-y-el-Caribe-la-ruta-hacia-la-transformacion-digital-de-la- gestion-educativa.pdf (accessed June 05, 2022). JUNAEB (2005). SINAE: Sistema nacional de asignación con equidad para becas JUNAEB. Santiago: JUNAEB. Komar, O., Komar, O., Kolomiiets, N., Roienko, L., and Diachuk, P. (2019). Implementation of a monitoring system in the educational process in primary school. Int. J. Learn. Teach. Educ. Res. 18, 232–244. doi: 10.26803/ijlter.18.11.114 Lara, L., Saracostti, M., Navarro, J.-J., de-Toro, X., Miranda-Zapata, E., Trigger, J. M., et al. (2018). Compromiso escolar: Desarrollo y validación de un instrumento. Rev. Mexic. Psicol. 35, 52–62. Lara, L., Domínguez-Lara, S., Gómez-Espino, J. M., Acevedo, F., Aparicio, J., Saracostti, M., et al. (2021). Adaptación y validación del cuestionario de compromiso escolar en países iberoamericanos. Rev. Iberoam. Diagn. Eval. Psicol. 59-2, 95–108. doi: 10.21865/RIDEP5 9.2.08 Leiva-Guerrero, M. V., Sanhueza-Mansilla, J., Soto-Calderón, M. P., and Muñoz-Lameles, M. E. (2022). Monitoreo de aprendizajes en escuelas públicas chilenas en contexto COVID-19. Alteridad. Rev. Educ. 17, 89–102. doi: 10.17163/ alt.v17n1.2022.07 Leyton, C., Mella, C., Salum, S., Saracostti, M., Sotomayor, B., de Toro, X., et al. (2021). Estrategias de intervencioìn socioeducativas para promover el compromiso escolar. Rev. Iberoam. Diagn. Eval. Aval. Psicol. 59, 191–205. doi: 10.21865/RIDEP59.2.15 Luan, X. D. (2014). Computer database system in the application of information management. Appl. Mech. Mater. 599–601, 2194–2197. Miranda-Zapata, E., Lara, L., Navarro, J. J., Saracostti, M., and De-Toro, X. (2018). Modelling the effect of school engagement on attendance to classes and school performance. Rev. Psicodidáctica (English ed.). 23, 102–109. doi: 10.1016/j. psicoe.2018.03.001 Miranda-Zapata, E., Lara, L., and Saracostti, M. (2021). Modelización del efecto del compromiso escolar sobre el rendimiento escolar en cinco países de Iberoamérica. Rev. Iberoam. Diagn. Eval. Aval. Psicol. 59, 151–161. doi: 10.21865/ RIDEP59.2.12 Navarro, J., de Toro, X., Lara, L., and Saracostti, M. (2021). Validación de un instrumento de medición de factores contextuales relacionados con el compromiso escolar. Rev. Iberoam. Diagn. Eval. Aval. Psicol. 59, 109–124. doi: 10.21865/RIDEP59.2.09 Frontiers in Psychology 19 frontiersin.org
fpsyg-13-980902 September 20, 2022 Time: 7:15 # 20 Saracostti et al. 10.3389/fpsyg.2022.980902 OEI (2018). Diferentes niveles de acompañamiento pedagógico para transformar la Escuela. Available online at: https://oei.int/oficinas/republica-dominicana/ publicaciones/diferentes-niveles-del-acompanamiento-pedagogico-para- transformar-la-escuela (accessed June 10, 2022). Parra, V., and Matus, G. (2018). Usos de datos y mejora escolar: Una aproximación a los sentidos y prácticas educativas subyacentes a los procesos de toma de decisiones. Calid. Educ. 45, 207–250. doi: 10.31619/caledu. n45.25 Petrone, R., Rink, N., and Speicher, C. (2020). From talking about to talking with: Integrating native youth into teacher education via a repositioning pedagogy. Harvard Educ. Rev. 90, 243–268. Riquelme, G., López, A., and Bastías, L. (2018). La accountability educacional: Una discusión teórica. Rev. Estud. Exp. Educ. 17, 119–131. doi: 10.21703/rexe. 20181735riquelme8 Saracostti, M., Lara, L., and Miranda-Zapata, E. (2019). Technological platform for online assessment and report generation of school engagement and contextual factors: Brief technical report. Electron. J. Res. Educ. Psychol. 17, 193–212. doi: 10.25115/ejrep.v17i47.2049 Saracostti, M., Lozano-Lozano, J. A., Miranda, H., Lara, L., Martella, D., and Reininger, T. (2020). An ecological, participatory, integral and contextualized model (EPIC model) of family-school connection: A preliminary analysis. Front. Psychol. 11: 563506. doi: 10.3389/fpsyg.2020. 563506 Saracostti, M., Lara, L., and Miranda-Zapata, E. (2021). Evaluación y promoción del compromiso escolar en Iberoamérica. Rev. Iberoam. Diagn. Eval. Aval. Psicol. 59, 77–79. doi: 10.21865/RIDEP59.2.06 Selfridge, R. (2018). Databusting for schools: How to use and interpret education data, 1st Edn. London: SAGE Publications Ltd, 275. Shernoff, D. (2013). Optimal learning environments to promote student engagement. New York, NY: Springer. doi: 10.1007/978-1-4614- 7089- Schildkamp, K. (2019). Data-based decision-making for school improvement: Research insights and gaps. Educ. Res. 61, 257–273. doi: 10.1080/00131881.2019. 1625716 Soncin, M., and Cannistrà, M. (2022). Data analytics in education: Are schools on the long and winding road? Source Qual. Res. Account. Manag. 19, 286– 304. Sotomayor, B., Lara, L., and Saracostti, M. (2021). Adaptación y validación de instrumentos de medida del compromiso escolar y los factores contextuales en estudiantes de niveles iniciales de educación en Chile. Rev. Iberoam. Diagn. Eval. Aval. Psicol. 59, 177–190. doi: 10.21865/RIDEP59.2.14 Taylor, S. J., and Bogdan, R. (1984). Introducción a los métodos cualitativos de investigación, 1st Edn. Barcelona: Paidós. UNESCO (2021). Los sistemas de alerta temprana para prevenir el abandono escolar en América Latina y el Caribe. Available online at: https://unesdoc.unesco. org/ark:/48223/pf0000380354.locale=en (accessed July 19, 2022). UNESCO (2017). Accountability in education: Meeting our commitments, global education monitoring report 2017/8. Paris: UNESCO Publishing. UNICEF. (2013). Superando el adultocentrismo. Available online at: https: //docplayer.es/6810003-Superando-el-adultocentrismo.html [Accessed May 25, 2022]. Yin, R. K. (2018). Case study research and applications: Design and methods, 6th Edn. Thousand Oaks, CA: SAGE. Zhao, Y., and Watterston, J. (2021). The changes we need: Education post COVID-19. J. Educ. Change 22, 3–12. doi: 10.1007/s10833-021-09417-3 Frontiers in Psychology 20 frontiersin.org