Keys to a successful writing program: a qualitative study

Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 161 | Página ISSN: 1988-8430 Lara-de Haro, M., Plaza, J. F., y Benítez, I. (2023). Keys to a successful writing program: a qualitative study. Tejuelo, 37, 161-194. Doi: https://doi.org/10.17398/1988-8430.37.161 Keys to a successful writing program: a qualitative study * Claves para un programa de escritura de éxito: un estudio cualitativo Mayte Lara-de Haro Universidad de Sevilla [email protected] ORCID ID: https://orcid.org/0000-0002-3906-9414 Juan F. Plaza Universidad Loyola Andalucía [email protected] ORCID ID: https://orcid.org/0000-0002-7741-088X Isabel Benítez Universidad de Granada [email protected] ORCID ID: https://orcid.org/0000-0002-0141-0816 DOI: 10.17398/1988-8430.37.161 Fecha de recepción: 30/03/2022 Fecha de aceptación: 23/07/2022 * We would like to acknowledge Charles Bazerman, Distinguished Professor of Education at the Gevirtz Graduate School of Education of the University of California, Santa Barbara, who contributed through discussions with the development of the project and the revision of this paper. Esta obra está publicada bajo una licencia Creative Commons Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 162 | Página ISSN: 1988-8430 Resumen: La enseñanza de la escritura académica ha supuesto una preocupación en las universidades de Estados Unidos desde hace más de 50 años. El sistema de educación superior español, sin embargo, ha abordado esta cuestión más recientemente y todavía no existen programas de escritura institucionalizados en España. Este artículo pretende definir qué es escribir bien y describir los elementos clave para la creación de un programa que promueva la escritura en las universidades españolas. Para ello, se ha seguido una metodología cualitativa, concretamente las entrevistas cognitivas, con el objetivo de conocer las experiencias de 26 profesionales estadounidenses. Se diseñó un protocolo ad hoc para preguntar a los expertos/as por los elementos relevantes en el diseño de un programa de escritura y entender los argumentos que sustentaban sus respuestas. Las entrevistas se analizaron con Q-notes, donde se compararon y relacionaron las respuestas de los participantes. Los resultados demostraron que escribir bien es retórico y contextual. Además, los expertos/as destacaron la importancia de comprender el contexto en el diseño de un programa de escritura. Los resultados se agrupan según las diferentes fases de creación del programa y se reflejan en un diagrama. Finalmente, se abordan los retos y recursos necesarios. Palabras clave: programa de escritura; educación superior; experiencia; análisis cualitativo; entrevistas cognitivas. Abstract: Teaching academic writing has been a concern in universities all over the United States for more than 50 years. The Spanish higher education system, however, has addressed this question more recently and there are still no institutionalized writing programs in Spain. This paper aims to define good writing and to describe the key elements needed for the creation of a writing program in order to promote writing at Spanish universities. To do that, a qualitative methodology was followed, specifically the method of cognitive interviews, with the aim to learn from experiences of 26 US experts. An ad hoc protocol was designed to ask experts about all the relevant elements when designing a writing program and to understand the arguments supporting their responses. Interviews were analyzed using the Q-notes software where the participants' responses were compared and connected. Results showed that there is not a fixed definition of good writing as it is rhetorical and contextual. Moreover, experts emphasized the importance of understanding the institutional context when designing a writing program. Findings were grouped according to the different steps of the creation of the program and were reflected in a flowchart. Challenges and the main resources are discussed. Keywords: writing program; higher education; expertise; qualitative analysis; cognitive interview methodology. Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 163 | Página ISSN: 1988-8430 Introduction Academic writing (Camps & Castelló, 2013) is a relatively recent issue in Spain, where it was not until the 90’s when researchers started to address this question in the Spanish higher education system (Guzmán Simón & García Jiménez, 2015). In English-speaking countries, however, more specifically the US and the UK, teaching academic writing at university has been an issue since the 70’s. Specifically the US has shown constant concern about students’ writing skills since the end of the 19th century (Russell, 1994) and has been the origin of the movements Writing Across the Curriculum (WAC) and Writing in the Disciplines (WID), which have been very successful in providing models to improve academic writing. Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 164 | Página ISSN: 1988-8430 The importance of teaching writing at university has been widely emphasized over the last decades, as writing requires competences that are not transferrable from previous academic stages. In this sense, writing programs (WP) have promoted the integration of writing in different courses worldwide. This study embraces Thaiss’ definition of program as the way an institution “conceives of the needs of its students in regard to learning a discipline, ‘writing’, that in basic ways crosses all disciplines and aids learning in all of them” (2012, p. 6). This paper differentiates two types of WPs: WAC programs, where writing is taught throughout the curriculum in different courses and is promoted as a means to learn, and WID programs, where writing is mainly fostered within a specific discipline to learn the characteristics of the texts of that field of study. These programs are usually complementary and although they do share some key structures, they are not implemented according to a standardized model as they are designed specifically at each institution (Condon & Rutz, 2012; Russell et al., 2009). In this respect, Spain has few experiences and WPs are not integrated into the institutional curriculum (Castelló et al., 2012), although university students show patent difficulties with writing (Boillos Pereira, 2017). Burgess & Pallant (2013) point out three reasons why southern European universities have until recently provided little writing support: the belief that anyone who enters the university is a good writer; the difficulty to define good writing in the discipline; and the fact that it is possible to learn to write just by observation. Other possible reasons for this situation in Spain according to Castelló et al. (2012) are a decentralized university model in different autonomous communities; the fact that there are other co-official languages in Spain besides Spanish; and the possibility that faculty believe writing should be taught at earlier educational stages and teaching writing is not their work. This being the case, writing is still scarcely taught in Spain and although there are a number of recent interesting projects at Spanish universities, they do not constitute institutional initiatives, but isolated experiences (Castelló et al., 2016). Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 165 | Página ISSN: 1988-8430 However, some northern European countries and the UK have addressed this issue for a long time. Still, academic writing was not much fostered before the Bologna Process (Göpferich, 2016). European universities were undergoing at that time the same initial phase US universities went through in the 70’s (Kramer et al., 2003) and there were only small independent WAC projects not fully integrated into the institutions (Björk et al., 2003). In the US, in turn, writing has been taught across the curriculum at many universities for five decades now, because of the general belief that a single writing course is not enough to prepare students for the academic and professional world. There is much literature on specific WPs and some authors explain how to get started (Walvoord, 2000) or describe characteristics of successful WAC programs (Townsend, 2008). More recently, Cox et al. (2018) explained their ‘whole systems approach’ to launching WAC programs and provided excellent tips for initiators. In fact, previous literature usually focuses on experiences narrated by recognized administrators (Sheffield, 2018). However, qualitative studies do not usually gather the opinions and experiences of a group of highly relevant experts around WP design and development, based on a predefined interview protocol. In this sense, experts in the field can provide relevant information to help administrators design and implement successful WPs. This paper aims to describe the elements needed for the creation of WPs and to provide professionals in the field with a transversal tool for WP design. To do that, a qualitative study was conducted with experts who have been administering or working for WPs or writing centers (WC). Participants were recruited in the US, as the WAC and WID movements have inspired European writing initiatives (Björk et al., 2003) for the last decades. To learn from the experience of experts and to gather complementary information to the literature published on the matter, semi-structured interviews were conducted, where the researcher leads a conversation based on an open-ended and semi-structured protocol designed to extract the intended information from the informants Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 166 | Página ISSN: 1988-8430 (Corbetta, 2010). In this case, the protocol was created to collect the participants´ responses to questions regarding the keys for launching a successful WP, as well as arguments and explanations for their responses, that is, their response processes. For that reason, the interview protocol focused on the meaning of ‘good writing’ and the key elements in the implementation of WPs. Participants were asked to develop their ideas and why they answered the way they did, which provided information about the processes of their answers based on their experiences. In conclusion, the protocol was created to gather evidence for supporting a proposal for WP development. The framework designed to guide the creation of WPs is relevant in the Spanish context, where writing is not much fostered (Gavari Starkie & Tenca Sidotti, 2018). However, it also aims to be useful for any administrator or researcher in any country worldwide, as the different recommendations can be applied to different contexts. 1. Method This section shows the method used in the study and is presented in different categories: participants, instrument, procedure and type of analysis carried out. 1. 1. Participants The method used was a qualitative study based on semistructured interviews to 26 professionals all around the US. The sampling was intentional as highly relevant and experienced researchers in the field of writing studies in different universities were selected all around the country. Most participants were selected by a literature review of research papers, while others were identified through snowball sampling or convenience. Finally, 27 professionals were contacted by e-mail and were asked to participate, with a response rate of 96.3%. Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 167 | Página ISSN: 1988-8430 ‘Theoretical saturation’ and ‘theoretical relevance’ were considered in the sampling design (Miller & Willson, 2014) as interviews were conducted until the full range of problems and interpretations were defined, and participants´ roles were diversified to reach the widest diversity in terms of interpretation patterns. A total of 26 interviews were administered to fourteen women and twelve men, five of whom were retired. The universities represented in the sample and the number of participants from each institution was as follows: Auburn University (1), Clemson University (1), College of the Holy Cross (1), Colorado State University (1), Cornell University (1), Florida State University (1), Iowa State University (1), Maritime Academy (1), Miami University in Oxford (2), North Carolina State University (1), Northeastern University (1), University of California, Davis (1), University of California, Santa Barbara (9), University of Minnesota (1), University of Missouri (1), University of Oklahoma (1) and University of San Francisco (1). The study was carried out in the University of California, Santa Barbara, where the highest number of participants came from (nine, one of whom was retired). The other universities were represented by a single expert, so that the highest possible number of universities were represented, except for Miami University in Oxford, which had two representatives. A total of 10 respondents were the directors or associate directors of a WP or a WC at the time the interview took place and nine used to be in the past. Some respondents were internationally renowned researchers in the field (14) and, finally, 25 out of 26 informants taught or used to teach writing in the past. The one who did not teach writing was, however, included in the sample, as he was an administrator and had supported the implementation of the WP at his university. All interviews were conducted in the US in 2018, with a duration of 45-60 minutes. Most of them took place within an office or in a quiet public place (61.5%), whereas 38.5% were held online as participants lived all around the US. All respondents were coded as to ensure confidentiality. Correlative numbers from one to 26 were assigned according to the order the interview was conducted. Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 168 | Página ISSN: 1988-8430 1. 2. Instruments The interview protocol was designed to learn about experiences of people who are part of a WP. The protocol aimed to go through the entire process to get a comprehensive picture of the different phases involved in WP design (see Table 1). Table 1 Interview protocol Professional situation 1. What is your position at the university? 2. What university do you work for? 3. Do you teach writing? Writing 4. What is good writing? 5. How can you teach good writing? Implementation of a WP 6. Have you ever been involved in designing a new WP or writing curriculum? 7. What resources are needed to design a WP or writing curriculum? 8. How important is budget in the implementation of a WP? 9. Who is the key person in the implementation of a WP? 10. Where should writing courses be hosted? 11. How important is the cultural or institutional context in a WP? 12. Who should be the instructors in a WP? 13. How can instructors be trained? 14. How much self-governance should instructors have? WCs 15. What do you think about WCs? Are they a good model? WP at home university 16. What is the philosophy of the WP and how is it reflected in the structure? 17. What kind of writing requirements do you have at your university? 18. What have been the major challenges faced by the WP at your university? 19. How is your program assessed? 20. What is WAC and WID? How are WAC and WID developed in your WP? Final questions 21. If you were to design a WP in Spain, what would you think of? 22. Where would you start? 23. Is there anything I haven’t asked that you think might be interesting for me? Source: own elaboration Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 169 | Página ISSN: 1988-8430 1. 3. Procedure All participants were given a consent form that they all read and signed before the interview. This form explained the purpose, procedures, risks and use of the information collected, which was kept strictly confidential and was used solely for the purposes of this research. Then, the interview was recorded for transcription and analysis purposes. The files were archived privately and will be destroyed according to the Spanish Data Protection Law. All data were collected in accordance with the standards and guidelines of the human subjects review board at the author’s home institutions, as well as the UCSB Human Subjects Board, where this study was carried out. The interviews were conducted in English by one researcher. Online interviews were both video- and audio-recorded, for which all respondents gave permission. Recordings were then transcribed. 1. 4. Analysis The analysis of the interviews was carried out using Q-Notes software (https://wwwn.cdc.gov/qnotes/login.aspx), a data collection and analysis tool designed to facilitate organization and analysis of data gathered through interviews. This software was developed by the National Center for Health Statistics in the US. Different levels of analysis were carried out following the approach suggested by Miller et al. (2014): conducting the interviews, summarizing interview notes, comparing across respondents and across groups and drawing conclusions. After conducting and transcribing the interviews, the different topics the respondents referred to were identified, after which summaries were entered in the corresponding questions in Q-Notes for their analysis. All data could then be easily extracted from the software at any time for future reports. The next level of analysis enabled to compare across respondents to extract themes and subthemes for each item. Once the Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 176 | Página ISSN: 1988-8430 specialists, like E16: “The best-case scenario is to have disciplinary experts who have been trained by or work in collaboration with writing experts.” Faculty development Participants mentioned three different models for faculty development: workshop model (80.7%), consulting model (26.9%) and other models (34.6%). In this sense, most informants stated instructors can be trained through workshops (73.1%) or teaching networks (23.1%), whereas other models were also mentioned: teaching graduate students/peer tutors or the expertise-based model. This model was explained by the informant E7: The model […] is really about training faculty to understand how writing works in general, how writing works in their discipline, getting them to bring to conscious awareness what they already know… Then they can make a decision about how to teach the students. […] So we call our model an expertise-based model. Working from their expertise. Self-governance of instructors Instructors should have ownership in their class, according to 21 informants, 10 of whom agreed they should follow some kind of syllabus, guidelines or outcomes. Moreover, two participants did not believe requirements were necessary, whereas 10 agreed faculty development or some kind of assessment or supervision is imperative: I think if you’re gonna have something that’s gonna be sustainable and work across the university, you need to set up some sorts of ways to keep track of what’s going on and be sure that people are fulfilling their obligations as faculty. (E5). Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 177 | Página ISSN: 1988-8430 Challenges Informants were also asked about the challenges faced in their WP or WC. In this regard, the most common response was the lack of resources, especially staffing (46.1%) and financial issues (30.7%). The participant E24 talked about the need to pay the instructors a minimal salary in order not to lose faculty: If you develop a cohort of instructors who are dedicated to your particular institution and can make long-term plans with you, you have a very different kind of WP than one where they’re just marking a couple of years while they find something better. Other challenges mentioned were mainly getting buy-in and the lack of vision at the institution. Also, the heavy teachers’ workload; false assumptions about writing or WCs; the cultural shift at the institution; large class size; too much bureaucracy; or the diversity of students’ background were emphasized. This last point was specifically highlighted by three respondents, as more and more international students register at US universities every year. The participant E11 explained how getting buy-in was a challenge, as some faculty complained at the beginning that they were not writing teachers and integrating writing in their courses was not their job. However, after a while “we started to change the culture and I had enough of those faculty members who had already bought in to writing in their departments. […] I worked with them to be allies within the department.” 2.3. WCs As regards WCs 18 respondents believed they are a useful complement to WPs or other writing on campus and should be aligned with them. They also agreed that WCs provide student writing support, although they showed their concern about the reputation WCs have, as 10 informants believed it is more than services on demand for correctness and four stated WCs help all writers and not only ‘bad Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 178 | Página ISSN: 1988-8430 writers’. Finally, four respondents suggested going to the WC should be optional and not required. 2.4. WP at home university This section refers to the specific WP of the respondents’ home universities and focuses on writing requirements, assessment and the different writing initiatives carried out. 2.4.1. Writing requirements The most common writing requirements at the respondents’ home universities were lower-division courses, followed by upperdivision courses. Writing-intensive (WI) courses were also a requirement in six cases. Only the participant E25 confirmed her university does not have writing requirements, since the general level of writing ability of their students was very high. In addition, 10 informants explained students can test out of some lower-division courses, for example E9, who stated students can place out of first-year writing “based on standardized tests, advanced placements or the International Baccalaureate.” 2.4.2. Assessment Most respondents confirmed their WP is assessed in some way (88.4%), even though only 15.4% informants stated they are required to assess their program and 46.1% said it is regularly assessed. Regarding the type of evaluation carried out, the WP assessment at the respondents’ home institutions is in most cases only internal (46.1%), whereas in 19.2% of the cases it is both internal and external or exclusively external (19.2%). As regards the assessment approach, the most common variables assessed are students and faculty. However, among those evaluating the curriculum, the most assessed variables are guidelines/classes, followed by learning outcomes. Other options are mainly the program itself, goals, needs, etc. As an example, the participant E3 explained they Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 179 | Página ISSN: 1988-8430 assess curriculum vitaes for every faculty in the WP, goals and needs, upper-division courses and students’ writing. Regarding the procedure the informants’ home institutions implement for assessment, external consultants visiting the university is the most common answer among those whose review process is external (five respondents). For those whose review process is internal, external consultants (six), followed by surveys (five), are the most repeated procedures. Other procedures include focus groups; sample essays; and conversations with people in internal review processes. Regarding external processes, multiple people reading and scoring; conversations with people; and classroom visits were other responses. A few participants referred to the impact of the assessment (15.3%), as it results in changes to the curriculum and improves the program. However, some challenges related to the assessment also came up, such as bureaucracy or not knowing what to do with the collected data, as explained by E19: “They were collecting samples of writing throughout a student’s four years at the college. […] And the problem with that much data, of course, is how do you analyze it all?” 2.4.3. WAC and WID Respondents were asked in the first place about WAC and WID and four of them thought distinguishing between both concepts was confusing. Moreover, five different informants believed WAC and WID were complementary and interchangeable terms, as explained by the participant E9: In this country, there’s a historical distinction between the two. […] And they use the terms interchangeably quite often. So I think it’s hard to characterize certain programs as either WAC or WID… Cause I think they most have elements of both. Other informants referred to a series of characteristics of WAC and WID that helped understand the difference between them, as shown in Table 3. Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 180 | Página ISSN: 1988-8430 Table 3 Characteristics of WAC and WID Category WAC WID General description Umbrella term Type of writing Informal writing, general writing, writing embedded Formal writing Principles Writing to learn, no specific writing instruction in the class Learning to write Scope Interdisciplinary Disciplinary Writing across the university, institutional initiatives Training Faculty development Faculty development Strategies Engaging people in conversations Focus Teaching is the key Teaching/writing outside the English department Source: own elaboration The respondent E14 compared both terms as two sides of the same coin: Writing to learn versus learning to write. Learning to write is WID. That's where I am learning to write like a historian writes. That’s WID. […] So when I say writing to learn, I am referring to writing about something so that you learn it better for yourself. […] You can use both WAC and WID in the same course. WAC writing is usually shorter; it's usually not graded. […] It's writing to master an idea. […] Informal versus formal writing. WAC is informal writing; WID is formal writing. Finally, 17 respondents explained they develop WAC in some way (writing-to-learn activities across the university); 14 informants acknowledged they implement some kind of WID initiatives (learning- to-write initiatives within the disciplines); and three implemented a few mixed initiatives, where formal and informal writing is fostered. 2.5. Final advice When respondents were asked where to begin, 42.3% of them recommended to start with some kind of writing courses, whereas Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 181 | Página ISSN: 1988-8430 15.3% advised to begin with a WP and 15.3% mentioned a WC. Only 7.7% informants recommended to start with writing requirements and other 7.7% suggested faculty development. Regarding courses, 19.2% of respondents proposed general writing or first-year composition courses, whereas 23.1% of them specifically advised against implementing this type of courses. WAC/WID programs or WI courses were not recommended either by three informants each. That is the case of E22, who believed WI courses atomize writing instruction only within some courses. Among those informants who advised against them, first-year courses or WAC/WID programs, common suggestions were having a WC, designing some kind of writing courses and conducting faculty development. 3. Characteristics of a WP According to the respondents, a WP should have certain characteristics. Three flowcharts are shown in this section representing different phases: design, implementation and assessment of WPs. 3.1. WP design Informants agreed previous needs’ assessment is key in WP design, as this program will be affected by the geography of the institution. To do this, getting buy-in and support at the institution is really important, as well as engaging stakeholders in conversations, so that all groups are confident in the process and the results, as Barlow et al. (2007) indicated in their study. In this respect, respondents agreed that common aspects of nearly all WPs are institutional buy-in, staff support and funding, something confirmed by Boyle et al. (2019). Although this idea has been highlighted in previous WP literature, bibliography is connected through this study with the specific experiences and processes detailed by the respondents. In this sense, interviewing professionals made it possible to reach the reason why some activities work or do not work, and to learn about specific situations to be considered in WP design. Therefore, previous needs assessment in terms of students’ writing skills has to be carried out to make sure the WP is aligned with Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 182 | Página ISSN: 1988-8430 the institutional culture and to get institutional buy-in and support for the program. As far as resources are concerned, a budget to hire human resources as well as time for faculty to develop the program would be necessary. Figure 1 summarizes a proposal for WP design. Figure 1 WP design. Needs Assessment Source: own elaboration 3.2. Implementation of a WP Following the respondents’ advice, a proposal was developed for the implementation of a WP, summarized as a flowchart in Figure 2. Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 183 | Página ISSN: 1988-8430 Figure 2. Implementation of a WP Source: own elaboration Informants agreed that financial resources to hire staff and faculty and providing time to the lecturers involved in the program are crucial to start a WP. Moreover, human resources are key, mainly a WP administrator with special aptitudes. In this sense, McLeod (2007) supports the idea that writing at the university almost always takes place within a WP under the supervision of an administrator who will need to deal with staffing and staff development. The proposal therefore suggests hiring administrators who are able to work with the community and who act as initiators of the program. Furthermore, the flowchart shows faculty are also a necessary resource in WPs. Specifically, disciplinary faculty are the experts in writing in their field and should teach students to write in a specific discipline, since they are more concerned with disciplinary knowledge. Writing specialists, for their part, should work in collaboration with disciplinary faculty in order to train them how writing works in general (Montes & Vidal Lizama, 2017) and to help them integrate writing in Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 184 | Página ISSN: 1988-8430 their courses and have ownership in their class. In order to do this, results show that faculty development is implemented mainly through workshops, as confirmed by quite a few studies (Bazerman et al., 2005; McLeod, 2007), as well as external consulting. A budget is also necessary to invest in faculty development and infrastructure, as shown in this flowchart. Finally, the proposal also suggests providing time to the faculty involved in the program, like for example reduction in their teaching load. 3.3. Assessment of a WP The interviews have revealed that assessment is necessary to monitor WPs, even though it is not always compulsory to do so. External evaluation is necessary for state or national accreditation, whereas internal assessment aims to get the perceptions of students and faculty, promote the faculty, meet some state requirements and conduct other kinds of internal controls. In this regard, previous studies agree that assessment should be local and contextual (Barlow et al., 2007; Johnson, 2014; Lannin et al., 2017; Moore et al., 2009), as these programs must be aligned with the institutional context and must meet the needs of the community, which has been emphasized by the respondents. The proposal, summarized in Figure 3, agrees with that and specifies different procedures and variables that could be valid, even though their convenience depends on each institution. Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 185 | Página ISSN: 1988-8430 Figure 3 Assessment of a WP Source: own elaboration Moreover, since a coordinated assessment should take place at all sites where writing takes place, instead of focusing on a specific course (Wardle & Roozen, 2012), this flowchart suggests not only assessing student writing, but also evaluating the faculty and the curriculum in general. This proposal shows specific procedures and variables but should be carefully applied according to the specific context of the institution. Discussion This paper aimed to describe the key elements of WPs in order to provide a transversal tool for professionals interested in implementing this type of initiatives. Although diverse projects are conducted in universities around the world, the aim was to collect Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 192 | Página ISSN: 1988-8430 of Programme Development: From Add-on Writing Courses to Content and Literacy Integrated Teaching. Journal of Academic Writing, 1(1), 41–58. https://doi.org/10.18552/joaw.v6i1.218 Guzmán Simón, F., & García Jiménez, E. (2015). La alfabetización académica en la Universidad. Un estudio predictivo. RELIEVE - Revista Electrónica de Investigación y Evaluación Educativa, 21(1), 1–16. https://doi.org/10.7203/relieve.21.1.5018 Huck, G. J. (2015). What is good writing? Oxford University Press. International Network of WAC Programs. (2014). Statement of WAC Principles and Practices. https://wac.colostate.edu/principles/statement.pdf Johnson, K. (2014). Writing Program Assessment and the Mission-Driven Institution. WPA: Writing Program Administration, 37(2), 68–90. Kramer, F., van Kruiningen, J., & Padmos, H. (2003). Creating a Basis for a Faculty-Oriented Writing Programme - Approaches, Opportunities and Pitfalls in the Academic Writing Project in Groningen. In B. Lennart, G. Bräuer, L. Rienecker, & P. Stray Jörgensen (Eds.), Studies in Writing. Teaching Academic Writing in European Higher Education (Vol. 12, pp. 185–194). Kluwer Academic Publishers. https://doi.org/10.1007/0-306-48195-2_14 Lannin, A. A., Cisco, J., Philbrook, J., & Philbrook, M. (2017). “How Do You Know That Works?”: A Mixed Methods Approach to Writing Program Assessment. WPA: Writing Program Administration, 40(2), 52–76. http://wpacouncil.org/archives/40n2/40n2all.pdf McLeod, S. H. (2007). Writing Program Administration (S. H. McLeod (ed.)). Parlor Press / WAC Clearinghouse. https://wac.colostate.edu/docs/books/mcleod_wpa/wpa.pdf Miller, K., & Willson, S. (2014). Data collection. In K. Miller, S. Willson, V. Chepp, & J. L. Padilla (Eds.), Cognitive Interviewing Methodology (pp. 15–34). John Wiley & Sons, Inc. Miller, K., Willson, S., & Chepp, V. (2014). Analysis. In K. Miller, S. Willson, V. Chepp, & J. L. Padilla (Eds.), Cognitive Interviewing Methodology (pp. 35–50). John Wiley & Sons, Inc. Montes, S., & Vidal Lizama, M. (2017). Diseño de un programa de escritura a través del currículum: opciones teóricas y Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 193 | Página ISSN: 1988-8430 acciones estratégicas. Lenguas Modernas, 50(50), 73–90. Moore, C., O’neill, P., & Huot, B. (2009). Creating a Culture of Assessment in Writing Programs and Beyond. College Composition and Communication, 61(1), 107–132. Núñez-Román, F., & Gallardo-Saborido, E. J. (2017). Un breve recorrido por el movimiento escribir en las disciplinas. In Escribir en las disciplinas. Intervenciones para desarrollar los géneros académicos y profesionales en la Educación Superior. Romero Oliva, M. F. (2014). La escritura académica: diagnóstico y propuestas de actuación. Ediciones Octaedro, S.L. Russell, D. R. (1994). American Origins of the Writing-across- the-Curriculum Movement. In Charles Bazerman & David Russell (Eds.), Landmark Essays on Writing Across the Curriculum (pp. 3–22). Hermagoras Press. Russell, D. R. (2013). Contradictions regarding teaching and writing (or writing to learn) in the disciplines: What we have learned in the USA. Revista de Docencia Universitaria, 11(1), 161–181. Russell, D. R., Lea, M., Parker, J., Street, B., & Donahue, T. (2009). Exploring notions of genre in “academic literacies” and “writing across the curriculum”: approaches across countries and contexts. In C. Bazerman, A. Bonini, & D. Figueiredo (Eds.), Genre in a Changing World. Perspectives on Writing (pp. 459–491). WAC Clearinghouse Parlor Press. http://wac.colostate.edu/books/genre/chapter20.pdf Sheffield, J. P. (2018). More Than a Useful Myth: A Case Study of Design Thinking for Writing Across the Curriculum Program Innovation. WAC Journal, 29(c), 168–188. http://search.ebscohost.com/login.aspx?direct=true&db=eue&AN=1341 40802&lang=ko&site=ehost-live Thaiss, C. (2012). Origins, Aims, and Uses of Writing Programs Worldwide: Profiles of Academic Writing in Many Places. In C. Thaiss, G. Bräuer, P. Carlino, L. Ganobcsik-Williams, & A. Sinha (Eds.), Writing Programs Worldwide: Profiles of Academic Writing in Many Places (pp. 5–22). The WAC Clearinghouse-Parlor Press. http://wac.colostate.edu/books/wpww/chapter1.pdf Townsend, M. (2008). WAC Program Vulnerability and What To Do About It: An Update and Brief Bibliographic Essay. The WAC Tejuelo, n.º 37 (2023), págs. 161-194. Keys to a successful writing program: a qualitative study 194 | Página ISSN: 1988-8430 Journal, 19(August), 45–61. http://wac.colostate.edu/journal/vol19/vol19.pdf#page=46 Walvoord, B. E. (2000). Getting started. In Writing Across the Curriculum: A Guide to Developing Programs (pp. 9–22). Academic.Writing: Interdisciplinary Perspectives on Communication Across the Curriculum. https://wac.colostate.edu/docs/books/mcleod_soven/mcleod_soven.pdf Wardle, E. (2007). Understanding ‘Transfer’ from FYC : Preliminary Results of a Longitudinal Study. WPA: Writing Program Administration, 31(1–2), 65–85. Wardle, E., & Roozen, K. (2012). Addressing the complexity of writing development: Toward an ecological model of assessment. Assessing Writing, 17(2), 106–119. https://doi.org/10.1016/j.asw.2012.01.001 Williams, P. (2016). Teaching bad writing. New Writing, 13(3), 368–377. https://doi.org/10.1080/14790726.2016.1184682