Brain Source Correlates of Speech Perception and Reading Processes in Children With and Without Reading Difficulties
Full text
This is a self-archived version of an original article. This version may differ from the original in pagination and typographic details. Author(s): Title: Year: Version: Copyright: Rights: Rights url: Please cite the original version: CC BY 4.0 https://creativecommons.org/licenses/by/4.0/ Brain Source Correlates of Speech Perception and Reading Processes in Children With and Without Reading Difficulties © 2022 Azaiez, Loberg, Hämäläinen and Leppänen. Published version Azaiez, Najla; Loberg, Otto; Hämäläinen, Jarmo A.; Leppänen, Paavo H. T. Azaiez, N., Loberg, O., Hämäläinen, J. A., & Leppänen, P. H. T. (2022). Brain Source Correlates of Speech Perception and Reading Processes in Children With and Without Reading Difficulties. Frontiers in Neuroscience, 16, Article 921977. https://doi.org/10.3389/fnins.2022.921977 2022
ORIGINAL RESEARCH published: 19 July 2022 doi: 10.3389/fnins.2022.921977 Frontiers in Neuroscience | www.frontiersin.org 1July 2022 | Volume 16 | Article 921977 Edited by: Charles A. Perfetti, University of Pittsburgh, United States Reviewed by: Yan Wu, Northeast Normal University, China McNeel Gordon Jantzen, Western Washington University, United States *Correspondence: Najla Azaiez [email protected] orcid.org/0000-0002-7525-3745 Specialty section: This article was submitted to Neurodevelopment, a section of the journal Frontiers in Neuroscience Received: 17 April 2022 Accepted: 20 June 2022 Published: 19 July 2022 Citation: Azaiez N, Loberg O, Hämäläinen JA and Leppänen PHT (2022) Brain Source Correlates of Speech Perception and Reading Processes in Children With and Without Reading Difficulties. Front. Neurosci. 16:921977. doi: 10.3389/fnins.2022.921977 Brain Source Correlates of Speech Perception and Reading Processes in Children With and Without Reading Difficulties Najla Azaiez1*, Otto Loberg2, Jarmo A. Hämäläinen1,3 and Paavo H. T. Leppänen1,3 1Department of Psychology, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, Finland, 2Department of Psychology, Faculty of Science and Technology, Bournemouth University, Bournemouth, United Kingdom, 3Department of Psychology, Jyväskylä Center for Interdisciplinary Brain Research, University of Jyväskylä, Jyväskylä, Finland Neural correlates in reading and speech processing have been addressed extensively in the literature. While reading skills and speech perception have been shown to be associated with each other, their relationship remains debatable. In this study, we investigated reading skills, speech perception, reading, and their correlates with brain source activity in auditory and visual modalities. We used high-density event-related potentials (ERPs), fixation-related potentials (FRPs), and the source reconstruction method. The analysis was conducted on 12–13-year-old schoolchildren who had different reading levels. Brain ERP source indices were computed from frequently repeated Finnish speech stimuli presented in an auditory oddball paradigm. Brain FRP source indices were also computed for words within sentences presented in a reading task. The results showed significant correlations between speech ERP sources and reading scores at the P100 (P1) time range in the left hemisphere and the N250 time range in both hemispheres, and a weaker correlation for visual word processing N170 FRP source(s) in the posterior occipital areas, in the vicinity of the visual word form areas (VWFA). Furthermore, significant brain-to-brain correlations were found between the two modalities, where the speech brain sources of the P1 and N250 responses correlated with the reading N170 response. The results suggest that speech processes are linked to reading fluency and that brain activations to speech are linked to visual brain processes of reading. These results indicate that a relationship between language and reading systems is present even after several years of exposure to print. Keywords: reading, ERPs, FRPs, auditory P1, auditory N250, visual N170, source reconstruction, brain correlates INTRODUCTION Learning to read is a complex multi-step process that requires both visual and auditory processes (Kavale and Forness, 2000; Norton et al., 2015; Vernon, 2016; LaBerge and Samuels, 2017). The question of whether speech processing and visual processing deficits are linked to reading disorders has been extensively addressed in the literature (Breznitz and Meyler, 2003; Breznitz, 2006; Wright and Conlon, 2009; Georgiou et al., 2012; Kronschnabel et al., 2014; Francisco et al., 2017; Karipidis et al., 2017; Ye et al., 2017). However, the nature of the link between the two modalities remains
Azaiez et al. Speech and Reading Brain Correlates unclear (Gibson et al., 2006; Wright and Conlon, 2009; Blau et al., 2010; Georgiou et al., 2012; Ye et al., 2017; Rüsseler et al., 2018; Stein, 2018). Several studies have investigated this relationship using simultaneous auditory and visual stimuli in dyslexic vs. typical readers using behavioral and brain measures (Aravena et al., 2018; Karipidis et al., 2018; Fraga-González et al., 2021). In the present study, we investigated the extent to which speech processing at the brain level is associated with reading fluency and brain activity during reading. We examined these associations in a group of children with different levels of reading skills, ranging from poor to good. Reading difficulty (RD), or dyslexia, is a frequent neurodevelopmental impairment that is commonly reported among school-age children. It involves a failure to acquire a satisfactory level of reading and spelling performance, despite normal intelligence and typical linguistic performance, in the absence of any organic, psychiatric, or neurological disorders, and despite adequate pedagogical opportunities (Démonet et al., 2004; Peterson and Pennington, 2015; Snowling et al., 2020). Dyslexia has been commonly linked to deficits in speech processing (Schulte-Körne et al., 1998; Kujala et al., 2000; Bishop, 2007; Abrams et al., 2009; Hämäläinen et al., 2013; Christmann et al., 2015; Lizarazu et al., 2015; Gu and Bi, 2020) and phonological processing (Snowling, 1998; Richardson et al., 2004; Vellutino et al., 2004; Christmann et al., 2015; Smith-Spark et al., 2017; Goswami, 2019). A frequently reported problem in dyslexia is word decoding, which is mainly described as a deficit in reading speed, accuracy, or spelling difficulties (Snowling, 2001; Vellutino et al., 2004; Siegel, 2006; Hulme and Snowling, 2014). According to phonological theory, RD is caused by alterations in brain functions, such as a deficit in phonological representations, an information storing dysfunction, or information inaccessibility (Ramus and Szenkovits, 2008; Hoeft et al., 2011; Boets et al., 2013; Hornickel and Kraus, 2013; Prestes and Feitosa, 2017). Based on this theory, one of the main hypotheses underlying the mechanism of reading disability is the creation of phonemegrapheme neural connections or inadequate representations when processing speech signals. This deficit could result from an alteration of the process of decoding grapheme-phoneme correspondences when decoding single letters, letter clusters, or words while reading (Goswami, 2000; Prestes and Feitosa, 2017). Weakness in building a stable network by binding letters and sounds eventually leads to reading problems (Goswami, 2002; Noordenbos et al., 2012; Vogel et al., 2013). Several studies of brain responses in children with reading difficulties have reported deficits in speech and phonological processing (Snowling, 1998; Castles and Friedmann, 2014; Ramus, 2014; Catts et al., 2017), with atypical phonological or phonetic representations of speech sounds shown to alter normal phoneme and word identification. Alternatively, an impairment in letter-speech sound mapping has also been suggested to be the origin of reading problems (Ehri, 2005; Maurer et al., 2010; Žari´ c et al., 2014; Fraga-González et al., 2015). Several studies have shown that speech processing is tightly linked to reading processes and reading skills (Pennington and Bishop, 2009; Zhang and McBride-Chang, 2010; Price, 2012; Duncan, 2018). The early ERP response, P1/N1-P2/N2 complex, is known to reflect basic phonological processes such as sound detection and identification and complexity processing (Maurer et al., 2002; Alain and Tremblay, 2007; Durante et al., 2014; Hämäläinen et al., 2015). Another response, the N2/N250, which is also part of the early complex, has been described in the context of syllable processing and interpreted to reflect the building of neural representation with repeated auditory stimuli (Karhu et al., 1997; Ceponiene et al., 2005; Vidal et al., 2005; Hommet et al., 2009; Hämäläinen et al., 2018; Wass et al., 2019). Studies have shown that basic speech processing was a strong predictor of infants’ and young children’s reading skills development as early as 6 months of age (Leppänen et al., 2002; Meng et al., 2005; Boets et al., 2011; Hayiou-Thomas et al., 2017; Lohvansuu et al., 2018). Using the electroencephalography (EEG) technique, lettersound mapping was investigated in typical (CTR) and dyslexic readers, and the quality of letter-speech sound processing was shown to be related to reading fluency, with evidence of a relationship between the auditory and visual modalities (González et al., 2016; Moll et al., 2016; Karipidis et al., 2018). This grapheme-phoneme bind created during cross modalities network coactivation, has been described as a key step for developing fluent reading (Chyl et al., 2018; He et al., 2021) by enhancing the specialized visual areas related to print when presented with the corresponding letter-speech sound. This process typically occurs in the early learning stages of reading (Ehri, 2005; Fraga-González et al., 2021). As an example of this effect in EEG studies, it has been shown that ERP amplitudes (for the mismatch responses MMN and LDN, for example) were enhanced when speech sounds were presented to typical readers with letters—an effect that was absent in dyslexic readers (Froyen et al., 2009)—suggesting that in atypical reading development, this letter-speech bind is absent or very weak. Similar results were reported in adults. Blau et al. (2009) investigated whether phonological deficits impaired the mapping of speech sounds into equivalent letters. The authors showed reduced audiovisual integration among dyslexics compared to controls, which was linked to reduced activation of the superior temporal cortex, reflecting a deficit in auditory speech processing. The importance of the auditory cortex in the integration of letter-speech sounds has also been addressed in functional magnetic resonance imaging (fMRI) studies, both in adults (Van Atteveldt et al., 2004; Holloway et al., 2015; Yang et al., 2020) and in children. Yang et al. (2020) studied the neural basis of audiovisual integration deficits in dyslexic children via fMRI. Based on brain activation analysis, the authors reported a less developed correspondence of orthographic and phonological information matching in dyslexic children. They also reported reduced functional connectivity of important brain structures involved in integration processes, such as the left angular gyrus and the left lingual gyrus. This difference in the left superior temporal gyrus (STG) between the two groups of children was supported by previous findings in literature, whereas the angular gyrus (AG) activity was mainly related to task demand and attentional processes. Visual processing deficits in reading have also been reported for dyslexia and reading problems (Eden et al., 1996; Lobier et al., 2012, 2014; Giofrè et al., 2019; Archer et al., 2020). Visual deficits related to reading have previously been reported Frontiers in Neuroscience | www.frontiersin.org 2July 2022 | Volume 16 | Article 921977
Azaiez et al. Speech and Reading Brain Correlates at different levels, such as in the sensory, temporal, attentional, and memory processes (Farmer and Klein, 1995; Snowling, 2001; Facoetti et al., 2006; Boets et al., 2008; Wright and Conlon, 2009; Conlon et al., 2011; Goswami, 2015). For example, low-level visual processing in letter-speech sound integration was addressed using a mismatched paradigm to investigate the influence of speech sounds on letter processing. Despite previous evidence of the systematic modulation effect of speech sound processing on letter processing, the reverse effect was not found (Froyen et al., 2010). The emergence of letterspeech sound correspondence has been studied in children via different neuroimaging techniques. Brem et al. (2010) studied the establishment of a reading network via speech processing in beginning readers via ERP and fMRI. That study focused on the left occipitotemporal cortex underlying the VWFA. The authors showed that print sensitivity in this area emerged in the early phases of reading acquisition, highlighting the critical role of VWFA in sound-print mapping. The results of Brem et al.’s investigation of fMRI and EEG data clearly indicated brain activity enhancement in the occipitotemporal area after the establishment of speech-print mapping through training. The authors reported that the auditory network involved was not the only one, but that a visual network was clearly coactivated during the coding-decoding phases, which highlighted the importance of the VWFA in this learning process. Brem et al. also associated the activation of this brain area with the visual N1 response of the ERP component sensitive to print, more commonly named N170. Pleisch et al. (2019) studied differences in reading processes between typical and dyslexic first-grade children by measuring the neural activation of the N1 response to print via combined EEG–fMRI methods. A differential modulation reflecting sensitivity to print was found only in typical readers in the ventral occipitotemporal cortex. The authors concluded that functional brain alterations in the language network play a role in dysfluent reading development. The role of speech and language as the basis for reading is well established, where most dyslexics show difficulties in phonological processing (Siegel, 2006; Navas et al., 2014; Giofrè et al., 2019). Sensory or orthographic visual processing deficits have only been observed in a subgroup of the dyslexics (Wright and Conlon, 2009; Giofrè et al., 2019). Visual processing in RD remains an important processing aspect to study in reading research, which has already been a focus of investigation in the literature (Salmelin et al., 1996; Lobier et al., 2014; Archer et al., 2020). However, the ties between visual and auditory information processes in the context of reading vs. speech processing remain unclear. The processing of several letters in a short timeframe is an important skill for developing fluent reading. It has been shown that RD is characterized by slow word recognition and a higher error rate compared to typical reading (Ozeri-Rotstain et al., 2020). Efficient word processing depends on parallel visual processing of multiple letters (Lobier et al., 2012), where a problem in letter pattern perception leads to a problem in orthographic processing, inducing reading problems (Georgiou et al., 2012). Monzalvo et al. (2012) used fMRI to investigate cortical networks for vision and language by comparing cortical activity in minimally demanding visual tasks and speech-processing tasks. In the visual paradigm, objects, faces, words, and a checkboard were used as stimuli presented in different blocks, and short sentences in native and foreign (unfamiliar) languages were used in the speech processing paradigm. Both visual and spoken language systems have been reported to be impaired in dyslexics. Monzalvo et al. found that dyslexics had reduced activation of words in the VWFA in the visual task and reduced responses in different brain areas, including the posterior temporal cortex, left insula, planum temporal, and left basal language area, extending to the VWFA, in the speech tasks, and the authors concluded that there was hypoactivation in the VWFA for written words and speech listening. These results highlight the role of the VWFA as an associative area in the processing of both types of stimuli: visual information in reading and auditory information in speech processing. A more recent fMRI study by Malins et al. (2018) used a task of matching printed and spoken words to pictures and found a significant correlation between the neural activity of both print and speech and reading skills in children. The authors studied trial-by-trial neural activation of different brain areas and their relationship to reading. They showed that the variability of the neural activation to print was positively correlated with the activation variability of the inferior frontal gyrus providing an additional evidence on the relationship between reading skills and sound processing. The authors discussed the common neural activations for print and speech and highlighted individual differences. When studying visual processing, the eye-tracking technique is frequently used to examine visual processes and eye movements to investigate reading and reading disorders (Jainta and Kapoula, 2011; Tiffin-Richards and Schroeder, 2015; Kim and Lombardino, 2016; Nilsson Benfatto et al., 2016; Jarodzka and Brand-Gruwel, 2017; Breadmore and Carroll, 2018; Robertson and Gallant, 2019; Christoforou et al., 2021). FRPs are a specific type of ERP that rely on eye fixations and their corresponding brain activity (Baccino, 2011). This combined technique is commonly used to investigate reading (Baccino, 2011; Wenzel et al., 2016; Loberg et al., 2019; Degno and Liversedge, 2020). The FRP is based on EEG measurements of brain activity in response to visual fixations obtained by extracting the signal-averaged time-locked to the onset of eye fixations (Baccino, 2011). Fixations in reading are known to reflect the online cognitive process of several factors, such as the duration and location of a word, word frequency, and predictability. This process occurs in a series of events, starting with the transmission of the visual signal of the printed word from the retina to the visual cortex, visual encoding, initiation of word identification, and programming the next eye movement (Degno and Liversedge, 2020). A commonly used measure for studying individual differences in reading is first-pass fixation duration. This measure reflects the cognitive components of early visual processing, word identification, attention shifts, and oculomotor control (Zhang et al., 2021a). Jainta and Kapoula’s (2011) study of eye fixations in reading showed a large fixation disparity that caused unstable fixations in dyslexic children when reading sentences. The authors concluded that visual perturbation may cause letter/word recognition and processing Frontiers in Neuroscience | www.frontiersin.org 3July 2022 | Volume 16 | Article 921977
Azaiez et al. Speech and Reading Brain Correlates difficulties that lead to reading disorders. Zhang et al. (2021a) used first-pass fixation in sentence reading to investigate the brain network in natural reading. They showed that seed regions in the early visual cortex, VWFA, and eye-movement control network were associated with individual reading performance and brain connectivity in a resting state. Interestingly, this visual dysfunction was not found systematically, since some studies did not report any differences between RD and typical readers and not all children with RD show a visual deficit. In the context of RD, both speech and visual processes have only rarely been investigated via the ERP method. For example, Bonte and Blomert (2004a) investigated dyslexic readers’ phonological processing in spoken word recognition using a priming paradigm. The authors examined the general ERP response and reading skills of beginning readers and reported deficits in N1 and N2 speech processes in dyslexics compared to controls. They interpreted these results as a phonological processing deficit reflecting the recruitment of different neural sources (Bonte and Blomert, 2004a). The N250 response, which is known to be part of the obligatory response (P1-N250), was also investigated in dyslexia, and previous studies showed a different response in this component in the RD group compared to the control group (Lachmann et al., 2005; Lohvansuu et al., 2014). The N250 is thought to represent lowlevel auditory processing, such as sound detection or feature extraction, but it is also part of a critical processing stage, which is the formation of the neuronal representation of sound/speech stimuli (Karhu et al., 1997; Hämäläinen et al., 2015). As reading involves the ability to convert print into sound, it is critical to further investigate the N250 response and its relationship to reading, as previous evidence has shown differences in this component between good readers and dyslexics. However, the relationship between N250 and reading remains unclear. In addition to the N1-N2 findings, later ERP responses were also found deficient among RD participants, such as the P3a, the N400, and the LDN (Hämäläinen et al., 2008, 2013; Jednoróg et al., 2010; Desroches et al., 2013; Leppänen et al., 2019). These findings provide evidence that speech processing may be altered in dyslexics at different stages of processing and at different latencies. The brain potential of interest in reading is the N170, an ERP component that peaks between 150 and 200 ms, with a peak around 170 ms and a temporo-occipital negative topography (Rossion et al., 2002; Maurer et al., 2005b; Sánchez-Vincitore et al., 2018). The N170 has been identified as reflecting facial recognition and being sensitive to facial expressions (Blau et al., 2009; Hinojosa et al., 2015; Wang et al., 2019). This component is known to be sensitive to orthographic processing (Rossion et al., 2003) and to letters strings/words in reading. When left lateralized, the N170 has been shown to be a reliable physiological marker of reading and reading skills (Maurer et al., 2005b, 2008; Lin et al., 2011; Hasko et al., 2013; Zhao et al., 2014; Lochy et al., 2016). For example, it was studied in dyslexic children compared to controls, where the N170 was shown to have a larger response in the dyslexic group compared to controls (Fraga González et al., 2014; González et al., 2016). Time-locked to the visual response, this ERP response becomes a strong indicator for studying the dynamics of the visual cognitive processes (labeled FRP N170) of reading and reading disorders (Dimigen et al., 2011, 2012; Kornrumpf et al., 2016; Loberg et al., 2019; Dimigen and Ehinger, 2021). In the present study, we investigated how the basic speech ERP responses—the P1-N250—are related to reading process, and how the visual FRP response in reading—the N170, which is known as a reliable marker of reading processes (Maurer et al., 2005b; Hasko et al., 2013)—are associated with reading skills in the same children. Previous evidence has shown a link between speech perception and reading, with speech processing being a predictor of reading development at an early age, but the temporal-brain dynamics remain unclear. Moreover, the question of whether this relationship remains present after the development of reading skills has scarcely been investigated. Here, we aim to investigate whether the basic processes of speech remain associated with basic processing of reading in schoolaged children who have established a reading network, and how their reading skills may reflect their neuronal activity. This study represents a new approach to investigate how visual reading and auditory speech processes may be interlinked and linked to reading skills by combining different methods (ERP, FRP, and CLARA) for high temporo-spatial analysis. Both auditory and visual modalities were tested in two separate tasks: a speech perception task and a sentence-reading task. We used source reconstruction with correlation analyses to identify the link(s) among reading skills and auditory processes, reading skills and visual processes, and the neuronal activity of the two modalities. This enabled us to study the brain dynamics of these processes by examining the neuronal origin of brain activity at the source level and to explore its relationship to reading skills. Based on previous evidence, we hypothesized that speech perception basic responses (P1-N250) would show correlations with reading skills (Bonte and Blomert, 2004a; Lohvansuu et al., 2018) and that the visual N170 response would also correlate with reading skills (Maurer et al., 2008; Mahé et al., 2013; Fraga González et al., 2014). Furthermore, we expect to observe a relationship between the speech processes P1 and N250, and the visual reading processes over the VWFA within the same subjects in these two independent tasks. MATERIALS AND METHODS Participants A total of 440 children from eight schools in the area of Jyväskylä, Finland, participated in three test cohorts. The study included a subsample of 112 children, all Finnish native speakers aged between 11 and 13. These children were invited to participate in the eSeek project (Internet and Learning Difficulties: A Multidisciplinary Approach for Understanding Reading in New Media). The participants were grouped based on their reading fluency scores derived from three different reading tasks. The latent score was computed for reading fluency using principal factor analysis (PAF) with PROMAX rotation in the IBM SPSS 24 statistical program (IBM Inc.). This score was based on the following three tests: The Word Identification Test, a Frontiers in Neuroscience | www.frontiersin.org 4July 2022 | Volume 16 | Article 921977
Azaiez et al. Speech and Reading Brain Correlates subtest of standardized Finnish reading test ALLU (Lindeman, 1998) (factor loading 0.683); the Word Chain Test (Nevala and Lyytinen, 2000) (factor loading 0.683); and the Oral Pseudoword Text reading (Eklund et al., 2015) (factor loading 0.653). The word identification test included 80 items, each consisting of a picture and four alternative written words. The task was to identify and connect correct picture–word pairs. The score was the number of correctly connected pairs within the 2 min. The word chain test consisted of 25 chains of four words written without spaces between them. The task was to draw a line at the word boundaries. The score was the number of correctly separated words within the 90 s time limit. The oral pseudoword text-reading test consisted of 38 pseudowords (277 letters). These pseudowords were presented in the form of a short passage, which children were instructed to read aloud as quickly and accurately as possible. The score was the number of correctly read pseudowords divided by the time, in seconds, spent on reading (for details, Kanniainen et al., 2019). This reading score was computed for the whole sample for each subject. Children who scored below the 10th percentile were identified as poor readers (RD) and those who scored above the 10th percentile were identified as good readers (CTR). All participants scoring equal to or below 15 points (10th percentile) in the cognitive non-verbal assessment testing were excluded. This assessment included a 30-item version of Raven’s progressive matrices test (Raven and Court, 1998). Attentional problems were screened via the ATTention and EXecutive function rating teacher inventory (ATTEX in English and KESKY in Finnish) (Klenberg et al., 2010). To be included in the analyses, the participants had to score below 30 points on this test. Children with clear attentional problems were excluded from the study. The brain response analyses were conducted on 112 participants: auditory data: 86 CTR participants (43 females and 43 males; age range =11.78–12.84 years; mean age 12.36 years, SD: 0.27) and 26 RD participants (eight females and 18 males; age range =11.84–12.94; mean age 12.31 years, SD: 0.34). Preprocessing and source modeling were performed on 92 participants’ reading data: 65 CTR participants and 27 RD participants. The correlation analysis only included participants with valid auditory and visual data. Sixty of these participants comprised the final CTR group (30 females and 30 males; age range =11.88– 12.84 years; mean age 12.37 years, SD: 0.28) and 20 participants were in the RD group (six females and 14 males; age range = 11.84–12.94 years; mean age 12.34 years, SD: 0.36). The final group, which included both samples from CTR and RD (labeled CTRD), comprised 80 subjects and was tested for normality and skewness. The tests showed a normal distribution and no skewness. For details, see the Supplementary Material. None of the participants declared any auditory problems, and they all had normal or corrected vision with no history of neurological problems or head injuries. The current study was conducted in compliance with the Declaration of Helsinki, and the study protocols were approved by the Ethics Committee of the University of Jyväskylä, Finland. All of the methods used were performed in accordance with university guidelines and regulations. The participants and their parents provided signed informed consent prior to the study. Materials and Procedures Auditory Materials and Stimulus Presentation The auditory stimulus used for this study was originally presented in a passive oddball paradigm designed for another study, comprising a standard stimulus and two deviant stimuli presented over a duration of 10 min. The target stimulus (standard) was presented 800 times in the paradigm, but only 200 trials, which were the pre-deviant standard stimulus responses, were used for the analysis. These trials are believed to have the strongest representations of stimuli due to repetition. The stimulus consisted of a Finnish monosyllabic word suu (which means “mouth” in English), a basic, frequent, short, and easy word that is commonly used by itself in the Finnish language but could also be part of other words like [osuus (“a portion or contribution”) or asuu (“lives”)]. This is also one of the first words learned by Finnish children at a very early age and is therefore expected to have a strong neural representation among Finnish participants. The stimuli were recorded by a male native speaker and were pronounced in a neutral manner. The recording was equalized and normalized in segmental durations, pitch contours, and amplitude envelopes using Praat software (Boersma and Weenink, 2010) for a more detailed description of stimulus preparation (Ylinen et al., 2019). The stimuli were presented via a loudspeaker placed on the ceiling ∼100 cm above the participants’ ear position and were presented at ∼65 dB. The stimulus volume level was calibrated before each recording with a sound level meter (Brüel and Kjaer) placed on a pedestal device at the participant’s head position (with the following settings: sound incidence =frontal; time weighting =fast; ext filter =out; frequency weighting =A, range =40–110 dB; display =max). Reading Materials Two hundred sentences, each with between five and nine words, and a median length of six words, were used as visual stimuli. The sentences were presented in 20-point Times New Roman font on the screen in a free-reading task. Each letter was subtended at an average visual angle of 0.4 degrees on the screen, where the distance of the participants was ∼60 cm from the monitor. A total of 912 words, with lengths varying from 5 to 13 letters, were included in the FRP analysis. The materials for this paradigm were part of a previous study. For a detailed description, see Loberg et al. (2019). Data Measurements EEG recordings were performed in a sound-attenuated and electrically shielded EEG laboratory room located at the University of Jyväskylä facilities. There was no task for the auditory paradigm. Each child was instructed to minimize movement while listening passively to auditory stimuli. To maintain the child’s interest in the experiment, he/she watched a muted cartoon movie playing on a computer screen. In the reading paradigm, the measurement was performed in the same room using a dim light. The child was instructed to freely read Frontiers in Neuroscience | www.frontiersin.org 5July 2022 | Volume 16 | Article 921977
Azaiez et al. Speech and Reading Brain Correlates different sentences that appeared on the screen. During the recordings, the experimenters observed the participant via live video camera streaming and monitoring from a separate control room to ensure the wellbeing of the participant and that the experiment proceeded as expected. Both EEG datasets were recorded with 128 Ag-AgCl electrode nets (Electrical Geodesic, Inc.) with Cz as the online reference, using NeurOne software and a NeurOne amplifier (MegaElectronics Ltd., new designation Bittium). The data were sampled online at 1,000 Hz, high-pass filtered at 0.16 Hz, and low-pass filtered at 250 Hz during the recording. The experimenter aimed to keep impedances below 50 kand the data quality was checked continuously. All necessary adjustments or corrections were performed during short breaks and between the experiments’ blocks to maintain good quality throughout the measurements. The Eyelink 1,000 with 2,000 Hz upgrade (SR research) version was used for the eye-movement data acquisition of the reading task using a 1,000 Hz sampling rate. The sentences were presented on a Dell Precision T5500 workstation with an Asus VG-236 monitor (1,920 ×1,080, 120 Hz, 52 ×29 cm). At the beginning and the end of each trial, the synchrony between the two measures was ensured with a mixture of transistor-totransistor logic pulses (to EEG) and Ethernet messages [to eye tracking (ET)]. The participants held their heads in a chinrest during the measurements. The calibration routine consisted of a 13-point run of fixation dots performed before each block and before each trial. This reading task was divided into four blocks. If the fixation diverged from the calibration by more than one degree, the calibration was redone. The experiment’s trial started only upon the experimenter’s approval of the calibration. Once the task started, the participants were instructed to press a button to move to the next trial (for details, see Loberg et al., 2019). The participants were instructed to read as quickly as possible. The quality of the EEG and the ET was maintained throughout the experiment, and corrections and recalibrations were performed as required. Short breaks were taken when needed or upon the participant’s request. In both experiments, the participants were informed that they were allowed to terminate the experiment at any time in the case of discomfort. Auditory Data Preprocessing BESA Research 6.0 and 6.1 were used for offline data processing. Bad channels were identified from the data (number of bad channels: mean: 5.6, range: 1–13). Independent component analysis (Infomax applied to a 60-s segment of the EEG) (Bell and Sejnowski, 1995) was used to correct the blinks from each subject’s data. Epoch length was set from −100 ms (pre-stimulus baseline) to 850 ms. The artifact detection criterion was set to a maximum of 175 µV for amplitude fluctuations within the total duration of the epoch. A high-pass filter of 0.5 Hz was set before averaging. Bad channels showing noisy data were interpolated using the spherical spline interpolation method (Ferree, 2006). The data were re-referenced offline to average the reference and averaged individually and separately for the standard stimulus. Reading Data Preprocessing The co-registered EEG-ET data were processed in MATLAB using EEGLAB (v14.1.2) with an EYE-EEG (0.85) add-on. A high-pass filter at 0.5 Hz and a low-pass filter at 30Hz were applied. Synchronization between the raw gaze position data and the EEG data was performed using shared messages in both data streams at the beginning and the end of each trial. Gaze positions outside the screen were automatically discarded. Discarded trials included all zero gaze positions resulting from blinks and between trial gaps in the recordings. All fixations corresponding to all the words within the sentences, except for the last word, during a first-pass reading were used to compute the FRP estimate. The responses were locked to the first fixation of each word, mean word length of 8, and saccade amplitude of 1,8798’. A time window of 100 ms was also considered bad data before and after these values. A binocular median velocity algorithm for detecting fixations (and saccades) was applied to the remaining gaze positions. Deconvolution Modeling of FRPs The UNFOLD toolbox (Ehinger and Dimigen, 2019) was used for the FRPs estimation. The FRPs were estimated via a generalized linear model that was used for response estimation and the correction of overlaps between the responses with a generalized additive model for non-linear predictors (Loberg et al., 2019). The modeled response ranged from −700 to 500 ms from fixation onset. All blink time points, eye movements outside the screen, and segments with large fluctuations were removed from the response estimates. Fixations on the target word during rereadings were excluded from the FRP estimation. Source Reconstruction and Spatial Filtering Source analyses were conducted using BESA Research 6.1 and 7.0 to estimate the active sources in the speech processing and reading tasks. The neuronal sources were estimated via an inverse approach with a distributed source model in the brain volume: classical LORETA analysis recursively applied (CLARA) restricted to the cortex. For accurate forward head modeling, an appropriate FEM head model for 12-year-olds was implemented. Model solutions were created based on the group ERP brain source reconstructions for each brain component for the CTRD group combined in a unique model. For the auditory data, source locations were calculated for P1, P1-2, N250, and N250-2(see an illustration of the ERP auditory responses in Figure 1). Model solutions were similarly computed for the reading data based on the group FRP estimates, where the target component was N170. The source analysis was performed ∼10 ms before the peak for all components. This time point was chosen after inspection and after searching for the best solutions for the different responses. This time showed the best modeling solution for the source activity, with the clearest sources and the best residual variance. These group-based solutions were used to create a standard model to filter cortical sources, and only sources that were found to be activated in the common group (CTRD) were included in the final model. For each CLARA source identified, a regional dipole was fixed to combine the power sum of the three Frontiers in Neuroscience | www.frontiersin.org 6July 2022 | Volume 16 | Article 921977
Azaiez et al. Speech and Reading Brain Correlates FIGURE 1 | (A) (a) Auditory/speech ERPs in the CTRD group (N=80) grand average. Butterfly plots for the responses to the standard stimulus “suu” over 129 electrodes. The boxes around the peaks indicate P1, P1-2, N250, and N250-2responses. (b) The corresponding mean topographic maps for the time windows of 70–120 ms (P1), 150–200 ms (P1-2), 230–280 ms (N250), and 360–410 ms (N250-2), respectively. (c) Cortical CLARA reconstruction for each component. (B) (a) Visual/reading FRPs in the CTRD group (N=80) grand average. Butterfly plots for the responses to word stimuli over 129 electrodes. (b) The topographic map of N170 at 170 ms and (c) its cortical source CLARA reconstruction. orthogonal orientations of the regional sources. The regional sources were computed for each component. They were then used as spatial source filters and applied to individual data. The source filter generated individual solution waveforms for each participant. A mean scalar value for each subject was computed as the sum of the source activity measures at all time points over a time window between ∼20 and 30 ms around the peak, specified for each component (a detailed description of the time windows is provided below). Correlations Correlations between source activations were converted into scalar values for each modality, and the reading scores (PAF) were examined across the CTRD group using Pearson’s Frontiers in Neuroscience | www.frontiersin.org 7July 2022 | Volume 16 | Article 921977
Azaiez et al. Speech and Reading Brain Correlates correlation coefficients. For each source activity, the mean value was calculated around the peak using MATLAB R2019b (Mathworks R ), as described above. For the auditory data, the time windows for the averages were 80–110 ms for P1, 150– 180 ms for P1-2, 230–250 ms for N250, and 360–390 ms for N250-2. For the visual data, the time window 180–210 ms was used for N170. These time windows were chosen based on visual inspection of the group ERP and FRP grand averages. The time windows were fixed so that the peak was always located in the middle of the window. Pearson’s correlation coefficients were calculated between the average source activity and the reading score of the participants using IBM SPSS statistics 26 (IBM corp), version 26.0.0.1, and applying a false discovery rates (FDR) correction of q = 0.05 (Benjamini and Hochberg, 1995) for the brain-to-behavior correlations and the brain-to-brain correlations. Correlations within brain activity between auditory and visual source activities were computed. A partial correlation (controlling for reading skills/PAF) between the source activity in the reading and speech processes was also performed. RESULTS Brain Responses and Source Reconstructions Brain Responses to Auditory ERP and Visual FRP Data The auditory grand average ERP and the different auditory components are illustrated in Figure 1A. The ERP waveform (Figure 1Aa) shows four components that emerged in response to the auditory stimulus. The first component peaked at around 90 ms, with a clear fronto-central positive polarity, and reflected the P1 response to the stimulus onset. This was followed by a second positive component peaking at around 170 ms, reflecting a second P1 response (P1-2) in response to the onset of the vowel or to the consonant-vowel transition. This response had a somewhat more central topography. The third component peaked at around 250 ms and reflected the N250 response to the stimulus onset, followed by a fourth component peaking at around 370 ms, most likely reflecting a second 250 (N250-2) response to the consonant-vowel transition or the onset of the vowel in the stimulus. Both responses showed clear negativity in the fronto-central area, with a larger amplitude for the second N250 response (Figure 1Ab). The grand average of the FRPs during reading is illustrated in Figure 1B. The component peaking around 200 ms reflects the visual N170 response, with topography (Figure 1Bb) showing a typical N170 response. The polarity was positive over the central area and negativity in the occipital areas, with a preponderance toward the left occipital hemisphere. Cortical Sources in Speech Processing The group-based cortical source reconstruction (applying CLARA) of the auditory responses is illustrated in Figure 1Ac. For auditory P1, the source reconstruction at 80 ms, shows a bilateral focal activation of the primary auditory cortices (A1) [with a total residual variance (RV) of 1.78%]. The source reconstruction of the second component P1-2performed at 160 ms shows the activation of similar bilateral sources over the auditory cortices. This second response shows slightly larger activity covering a larger area than the first P1, with an additional small activation over the central region (total RV =5.12%). The third source reconstruction performed at 230 ms for the first N250 response revealed four sources. Two sources were active bilaterally in the left and right temporal lobes at the level of the superior temporal area (STA). In addition, the inferior frontal area (IFA) in the left hemisphere and the middle frontal area in the right hemisphere were activated (total RV =2.83%). The fourth reconstruction was performed for the N250-2response at 370 ms. The source reconstruction showed four sources: bilateral activation of the left and right STA, the third source in the right IFA, and the fourth in the center-right area of the cortex (total RV =2.19%). Only the bilateral auditory sources across the different components were used to run the correlation analysis to investigate the relationship between the auditory speech perception processes and the reading processes at both the behavioral and neuronal levels. The other sources were discarded because they are believed to reflect additional processes that are related to attentional or semantic processes. Cortical Sources in Reading Processing The group-based cortical source reconstruction of the visual response is illustrated in Figure 1Bc. For reading N170, the reconstruction was performed at 190 ms and showed five main sources (with an RV of 6.07%). Two sources were located in the left and right occipital areas: one over the middle temporal area and one over the right visual cortex. Two additional activations were also found over the left frontal area: one source located in the left orbitofrontal area and the second in the left prefrontal area. Only the visual reading sources of the occipital areas were kept for the correlation analysis to investigate the reading processes, as the frontal sources are believed to reflect other processes that are mainly related to attentional processes. Correlations Cortical Source Correlations With Reading Scores Table 1 presents the correlations between the scalar values of the cortical source activity in the speech paradigm and reading scores, and in the cortical source activity in the reading paradigm and reading scores. A significant negative correlation was found between the P1 source activity of the left auditory cortex (A1) and the reading score (PAF). The correlation analysis with the right source activity did not reveal any significant results. Neither the right nor the left brain activity of the P1-2or N250 sources correlated with PAF. At the time window of the N250-2response, source activities in both the left and right temporal areas (STA) correlated negatively with PAF. The correlations indicated that the larger the response, the poorer the reading score. The correlations between the scalar values of the visual sources and the PAF are illustrated in Table 1. Only the left occipital source activity located over the left occipital area (L VWFA) correlated negatively with the PAF score. However, this correlation became non-significant after multiple comparison corrections. Frontiers in Neuroscience | www.frontiersin.org 8July 2022 | Volume 16 | Article 921977
Azaiez et al. Speech and Reading Brain Correlates Hämäläinen, J. A., Salminen, H. K., and Leppänen, P. H. (2013). Basic auditory processing deficits in dyslexia: systematic review of the behavioral and event-related potential/field evidence. J. Learn. Disabil. 46, 413–427. doi: 10.1177/0022219411436213 Hasko, S., Groth, K., Bruder, J., Bartling, J., and Schulte-Körne, G. (2013). The time course of reading processes in children with and without dyslexia: an ERP study. Front. Hum. Neurosci. 7, 570. doi: 10.3389/fnhum.2013.00570 Hayiou-Thomas, M. E., Carroll, J. M., Leavett, R., Hulme, C., and Snowling, M. J. (2017). When does speech sound disorder matter for literacy? The role of disordered speech errors, co-occurring language impairment and family risk of dyslexia. J. Child Psychol. Psychiatry 58, 197–205. doi: 10.1111/jcpp.12648 He, Y., Liu, X., Hu, J., Nichols, E. S., Lu, C., and Liu, L. (2021). Difference between children and adults in the print-speech coactivated network. Sci. Stud. Read. 1–16. doi: 10.1080/10888438.2021.1965607 Heimrath, K., Fiene, M., Rufener, K. S., and Zaehle, T. (2016). Modulating human auditory processing by transcranial electrical stimulation. Front. Cell. Neurosci. 10, 53. doi: 10.3389/fncel.2016.00053 Hickok, G., and Poeppel, D. (2007). The cortical organization of speech processing. Nat. Rev. Neurosci. 8, 393–402. doi: 10.1038/nrn2113 Hinojosa, J. A., Mercado, F., and Carreti,é, L. (2015). N170 sensitivity to facial expression: a meta-analysis. Neurosci. Biobehav. Rev. 55, 498–509. doi: 10.1016/j.neubiorev.2015.06.002 Hoeft, F., McCandliss, B. D., Black, J. M., Gantman, A., Zakerani, N., Hulme, C., et al. (2011). Neural systems predicting long-term outcome in dyslexia. Proc. Nat. Acad. Sci. 108, 361–366. doi: 10.1073/pnas.1008950108 Holloway, I. D., van Atteveldt, N., Blomert, L., and Ansari, D. (2015). Orthographic dependency in the neural correlates of reading: evidence from audiovisual integration in English readers. Cerebral Cortex 25, 1544–1553. doi: 10.1093/cercor/bht347 Hommet, C., Vidal, J., Roux, S., Blanc, R., Barthez, M. A., De Becque, B., et al. (2009). Topography of syllable change-detection electrophysiological indices in children and adults with reading disabilities. Neuropsychologia 47, 761–770. doi: 10.1016/j.neuropsychologia.2008.12.010 Hornickel, J., and Kraus, N. (2013). Unstable representation of sound: a biological marker of dyslexia. J. Neurosci. 33, 3500–3504. doi: 10.1523/JNEUROSCI.4205-12.2013 Hsu, C. H., Tsai, J. L., Lee, C. Y., and Tzeng, O. J. L. (2009). Orthographic combinability and phonological consistency effects in reading Chinese phonograms: an event-related potential study. Brain Lang. 108, 56–66. doi: 10.1016/j.bandl.2008.09.002 Hullett, P. W., Hamilton, L. S., Mesgarani, N., Schreiner, C. E., and Chang, E. F. (2016). Human superior temporal gyrus organization of spectrotemporal modulation tuning derived from speech stimuli. J. Neurosci. 36, 2014–2026. doi: 10.1523/JNEUROSCI.1779-15.2016 Hulme, C., and Snowling, M. J. (2014). The interface between spoken and written language: developmental disorders. Philos. Trans. R. Soc. B Biol. Sci. 369, 20120395. doi: 10.1098/rstb.2012.0395 Jainta, S., and Kapoula, Z. (2011). Dyslexic children are confronted with unstable binocular fixation while reading. PLoS ONE 6, e18694. doi: 10.1371/journal.pone.0018694 Jaramillo, M., Paavilainen, P., and Näätänen, R. (2000). Mismatch negativity and behavioural discrimination in humans as a function of the magnitude of change in sound duration. Neurosci. Lett. 290, 101–104. doi: 10.1016/S0304-3940(00)01344-6 Jarodzka, H., and Brand-Gruwel, S. (2017). Tracking the reading eye: towards a model of real-world reading. J. Comp. Assist. Learn. 33, 193–201. doi: 10.1111/jcal.12189 Jednoróg, K., Marchewka, A., Tacikowski, P., and Grabowska, A. (2010). Implicit phonological and semantic processing in children with developmental dyslexia: evidence from event-related potentials. Neuropsychologia 48, 2447–2457. doi: 10.1016/j.neuropsychologia.2010.04.017 Kanniainen, L., Kiili, C., Tolvanen, A., Aro, M., and Leppänen, P. H. (2019). Literacy skills and online research and comprehension: struggling readers face difficulties online. Read. Writ. 32, 2201–2222. doi: 10.1007/s11145-019-09944-9 Karhu, J., Herrgård, E., Pääkkönen, A., Luoma, L., Airaksinen, E., and Partanen, J. (1997). Dual cerebral processing of elementary auditory input in children. Neuroreport 8, 1327–1330. doi: 10.1097/00001756-199704140-00002 Karipidis, I. I., Pleisch, G., Brandeis, D., Roth, A., Röthlisberger, M., Schneebeli, M., et al. (2018). Simulating reading acquisition: the link between reading outcome and multimodal brain signatures of letter–speech sound learning in prereaders. Sci. Rep. 8, 1–13. doi: 10.1038/s41598-018-24909-8 Karipidis, I. I., Pleisch, G., Röthlisberger, M., Hofstetter, C., Dornbierer, D., Stämpfli, P., et al. (2017). Neural initialization of audiovisual integration in prereaders at varying risk for developmental dyslexia. Hum. Brain Mapp. 38, 1038–1055. doi: 10.1002/hbm.23437 Kavale, K. A., and Forness, S. R. (2000). Auditory and visual perception processes and reading ability: a quantitative reanalysis and historical reinterpretation. Learn. Disabil. Q. 23, 253–270. doi: 10.2307/1511348 Khan, A., Hämäläinen, J. A., Leppänen, P. H., and Lyytinen, H. (2011). Auditory event-related potentials show altered hemispheric responses in dyslexia. Neurosci. Lett. 498, 127–132. doi: 10.1016/j.neulet.2011.04.074 Kim, S., and Lombardino, L. J. (2016). Simple sentence reading and specific cognitive functions in college students with dyslexia: an eye-tracking study. Clin. Arch. Commun. Disord. 1, 48–61. doi: 10.21849/cacd.2016.00073 Klenberg, L., Jäms,ä, S., Häyrinen, T., Lahti-Nuuttila, P. E. K. K.A., and Korkman, M. (2010). The attention and executive function rating inventory (ATTEX): psychometric properties and clinical utility in diagnosing ADHD subtypes. Scand. J. Psychol. 51, 439–448. doi: 10.1111/j.1467-9450.2010.00812.x Kornrumpf, B., Niefind, F., Sommer, W., and Dimigen, O. (2016). Neural correlates of word recognition: a systematic comparison of natural reading and rapid serial visual presentation. J. Cogn. Neurosci. 28, 1374–1391. doi: 10.1162/jocn_a_00977 Kronschnabel, J., Brem, S., Maurer, U., and Brandeis, D. (2014). The level of audiovisual print–speech integration deficits in dyslexia. Neuropsychologia 62, 245–261. doi: 10.1016/j.neuropsychologia.2014.07.024 Kujala, T., Myllyviita, K., Tervaniemi, M., Alho, K., Kallio, J., and Näätänen, R. (2000). Basic auditory dysfunction in dyslexia as demonstrated by brain activity measurements. Psychophysiology 37, 262–266. doi: 10.1111/1469-8986.3720262 Kuuluvainen, S., Leminen, A., and Kujala, T. (2016). Auditory evoked potentials to speech and nonspeech stimuli are associated with verbal skills in preschoolers. Dev. Cogn. Neurosci. 19, 223–232. doi: 10.1016/j.dcn.2016. 04.001 LaBerge, D., and Samuels, S. J. (2017). Basic Processes in Reading: Perception and Comprehension. London: Routledge. doi: 10.4324/9781315467610 Lachmann, T., Berti, S., Kujala, T., and Schröger, E. (2005). Diagnostic subgroups of developmental dyslexia have different deficits in neural processing of tones and phonemes. Int. J. Psychophysiol. 56, 105–120. doi: 10.1016/j.ijpsycho.2004.11.005 Ladeira, A., Fregni, F., Campanh,ã, C., Valasek, C. A., De Ridder, D., Brunoni, A. R., et al. (2011). Polarity-dependent transcranial direct current stimulation effects on central auditory processing. PLoS ONE 6, e25399. doi: 10.1371/journal.pone.0025399 Leppänen, P. H., Richardson, U., Pihko, E., Eklund, K. M., Guttorm, T. K., Aro, M., et al. (2002). Brain responses to changes in speech sound durations differ between infants with and without familial risk for dyslexia. Dev. Neuropsychol. 22, 407–422. doi: 10.1207/S15326942dn2201_4 Leppänen, P. H., Tóth, D., Honbolyg,ó, F., Lohvansuu, K., Hämäläinen, J. A., Demonet, J. F., et al. (2019). Reproducibility of brain responses: high for speech perception, low for reading difficulties. Sci. Rep. 9, 1–12. doi: 10.1038/s41598-019-41992-7 Lin, S. E., Chen, H. C., Zhao, J., Li, S., He, S., and Weng, X. C. (2011). Left-lateralized N170 response to unpronounceable pseudo but not false Chinese characters – the key role of orthography. Neuroscience 190, 200–206. doi: 10.1016/j.neuroscience.2011.05.071 Lindeman, J. (1998). ALLU – Ala-asteen lukutesti [ALLU – Reading Test for Primary School]. University of Turku, Finland: The Center for Learning Research. Lizarazu, M., Lallier, M., Molinaro, N., Bourguignon, M., Paz-Alonso, P. M., Lerma-Usabiaga, G., et al. (2015). Developmental evaluation of atypical auditory sampling in dyslexia: functional and structural evidence. Hum. Brain Mapp. 36, 4986–5002. doi: 10.1002/hbm.22986 Loberg, O., Hautala, J., Hämäläinen, J. A., and Leppänen, P. H. (2019). Influence of reading skill and word length on fixation-related brain activity in school-aged children during natural reading. Vision Res. 165, 109–122. doi: 10.1016/j.visres.2019.07.008 Frontiers in Neuroscience | www.frontiersin.org 15 July 2022 | Volume 16 | Article 921977
Azaiez et al. Speech and Reading Brain Correlates Lobier, M., Zoubrinetzky, R., and Valdois, S. (2012). The visual attention span deficit in dyslexia is visual and not verbal. Cortex 48, 768–773. doi: 10.1016/j.cortex.2011.09.003 Lobier, M. A., Peyrin, C., Pichat, C., Le Bas, J. F., and Valdois, S. (2014). Visual processing of multiple elements in the dyslexic brain: evidence for a superior parietal dysfunction. Front. Hum. Neurosci. 8, 479. doi: 10.3389/fnhum.2014.00479 Lochy, A., Van Reybroeck, M., and Rossion, B. (2016). Left cortical specialization for visual letter strings predicts rudimentary knowledge of letter-sound association in preschoolers. Proc. Nat. Acad. Sci. 113, 8544–8549. doi: 10.1073/pnas.1520366113 Lohvansuu, K., Hämäläinen, J. A., Ervast, L., Lyytinen, H., and Leppänen, P. H. (2018). Longitudinal interactions between brain and cognitive measures on reading development from 6 months to 14 years. Neuropsychologia 108, 6–12. doi: 10.1016/j.neuropsychologia.2017.11.018 Lohvansuu, K., Hämäläinen, J. A., Tanskanen, A., Ervast, L., Heikkinen, E., Lyytinen, H., et al. (2014). Enhancement of brain event-related potentials to speech sounds is associated with compensated reading skills in dyslexic children with familial risk for dyslexia. Int. J. Psychophysiol. 94, 298–310. doi: 10.1016/j.ijpsycho.2014.10.002 Mahé, G., Bonnefond, A., and Doignon-Camus, N. (2013). Is the impaired N170 print tuning specific to developmental dyslexia? A matched readinglevel study with poor readers and dyslexics. Brain Lang. 127, 539–544. doi: 10.1016/j.bandl.2013.09.012 Malins, J. G., Pugh, K. R., Buis, B., Frost, S. J., Hoeft, F., Landi, N., et al. (2018). Individual differences in reading skill are related to trial-by-trial neural activation variability in the reading network. J. Neurosci. 38, 2981–2989. doi: 10.1523/JNEUROSCI.0907-17.2018 Maurer, J., Collet, L., Pelster, H., Truy, E., and Gallégo, S. (2002). Auditory late cortical response and speech recognition in digisonic cochlear implant users. Laryngoscope 112, 2220–2224. doi: 10.1097/00005537-200212000-00017 Maurer, U., Blau, V. C., Yoncheva, Y. N., and McCandliss, B. D. (2010). Development of visual expertise for reading: rapid emergence of visual familiarity for an artificial script. Dev. Neuropsychol. 35, 404–422. doi: 10.1080/87565641.2010.480916 Maurer, U., Brandeis, D., and McCandliss, B. D. (2005a). Fast, visual specialization for reading in English revealed by the topography of the N170 ERP response. Behav. Brain Funct. 1, 1–12. doi: 10.1186/1744-9081-1-13 Maurer, U., Brem, S., Bucher, K., and Brandeis, D. (2005b). Emerging neurophysiological specialization for letter strings. J. Cogn. Neurosci. 17, 1532–1552. doi: 10.1162/089892905774597218 Maurer, U., and McCandliss, B. D. (2007). “The development of visual expertise for words: the contribution of electrophysiology,” in Single-Word Reading (Psychology Press), 57–77. Maurer, U., Schulz, E., Brem, S., van der Mark, S., Bucher, K., Martin, E., et al. (2011). The development of print tuning in children with dyslexia: evidence from longitudinal ERP data supported by fMRI. Neuroimage 57, 714–722. doi: 10.1016/j.neuroimage.2010.10.055 Maurer, U., Zevin, J. D., and McCandliss, B. D. (2008). Left-lateralized N170 effects of visual expertise in reading: evidence from Japanese syllabic and logographic scripts. J. Cogn. Neurosci. 20, 1878–1891. doi: 10.1162/jocn.2008.20125 Meng, X., Sai, X., Wang, C., Wang, J., Sha, S., and Zhou, X. (2005). Auditory and speech processing and reading development in Chinese school children: behavioural and ERP evidence. Dyslexia 11, 292–310. doi: 10.1002/dys.309 Mesgarani, N., Cheung, C., Johnson, K., and Chang, E. F. (2014). Phonetic feature encoding in human superior temporal gyrus. Science 343, 1006–1010. doi: 10.1126/science.1245994 Meyler, A., Keller, T. A., Cherkassky, V. L., Lee, D., Hoeft, F., Whitfield-Gabrieli, S., et al. (2007). Brain activation during sentence comprehension among good and poor readers. Cerebral Cortex 17, 2780–2787. doi: 10.1093/cercor/bhm006 Mody, M., Wehner, D. T., and Ahlfors, S. P. (2008). Auditory word perception in sentence context in reading-disabled children. Neuroreport 19, 1567. doi: 10.1097/WNR.0b013e328311ca04 Moll, K., Hasko, S., Groth, K., Bartling, J., and Schulte-Körne, G. (2016). Sound processing deficits in children with developmental dyslexia: an ERP study. Clin. Neurophysiol. 127, 1989–2000. doi: 10.1016/j.clinph.2016.01.005 Monzalvo, K., Fluss, J., Billard, C., Dehaene, S., and Dehaene-Lambertz, G. (2012). Cortical networks for vision and language in dyslexic and normal children of variable socio-economic status. Neuroimage 61, 258–274. doi: 10.1016/j.neuroimage.2012.02.035 Näätänen, R., and Rinne, T. (2002). Electric brain response to sound repetition in humans: an index of long-term-memory-trace formation? Neurosci. Lett. 318, 49–51. doi: 10.1016/S0304-3940(01)02438-7 Navas, A. L. G. P., Ferraz, É. D. C., and Borges, J. P. A. (2014). “Phonological processing deficits as a universal model for dyslexia: evidence from different orthographies,” in CoDAS, Vol. 26 (Sociedade Brasileira de Fonoaudiologia), 509–519. Nevala, J., and Lyytinen, H. (2000). Sanaketjutesti [Word chain test]. Jyväskylä, Finland: Niilo Mäki Instituutti ja Jyväskylän yliopiston lapsitutkimuskeskus [Niilo Mäki Institute and Child Research Center of University of Jyväskylä]. Nilsson Benfatto, M., Öqvist Seimyr, G., Ygge, J., Pansell, T., Rydberg, A., and Jacobson, C. (2016). Screening for dyslexia using eye tracking during reading. PLoS ONE 11, e0165508. doi: 10.1371/journal.pone.0165508 Noordenbos, M. W., Segers, E., Serniclaes, W., Mitterer, H., and Verhoeven, L. (2012). Neural evidence of allophonic perception in children at risk for dyslexia. Neuropsychologia 50, 2010–2017. doi: 10.1016/j.neuropsychologia.2012.04.026 Norton, E. S., Beach, S. D., and Gabrieli, J. D. (2015). Neurobiology of dyslexia. Curr. Opin. Neurobiol. 30, 73–78. doi: 10.1016/j.conb.2014.09.007 Ortiz-Mantilla, S., Hämäläinen, J. A., and Benasich, A. A. (2012). Time course of ERP generators to syllables in infants: a source localization study using age-appropriate brain templates. Neuroimage 59, 3275–3287. doi: 10.1016/j.neuroimage.2011.11.048 Ozeri-Rotstain, A., Shachaf, I., Farah, R., and Horowitz-Kraus, T. (2020). Relationship between eye-movement patterns, cognitive load, and reading ability in children with reading difficulties. J. Psycholinguist. Res. 49, 491–507. doi: 10.1007/s10936-020-09705-8 Parviainen, T., Helenius, P., Poskiparta, E., Niemi, P., and Salmelin, R. (2011). Speech perception in the child brain: cortical timing and its relevance to literacy acquisition. Hum. Brain Mapp. 32, 2193–2206. doi: 10.1002/hbm.21181 Pennington, B. F., and Bishop, D. V. (2009). Relations among speech, language, and reading disorders. Annu. Rev. Psychol. 60, 283–306. doi: 10.1146/annurev.psych.60.110707.163548 Peterson, R. L., and Pennington, B. F. (2015). Developmental dyslexia. Annu. Rev. Clin. Psychol. (New York, NY: Oxford university Press) 11, 283–307. Pleisch, G., Karipidis, I. I., Brem, A., Röthlisberger, M., Roth, A., Brandeis, D., et al. (2019). Simultaneous EEG and fMRI reveals stronger sensitivity to orthographic strings in the left occipito-temporal cortex of typical versus poor beginning readers. Dev. Cogn. Neurosci. 40, 100717. doi: 10.1016/j.dcn.2019.100717 Prestes, M. R. D., and Feitosa, M. A. G. (2017). Theories of dyslexia: support by changes in Auditory perception1. Psicologia Teoria e Pesquisa 32, 1–9. doi: 10.1590/0102-3772e32ne24 Price, C. J. (2012). A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading. Neuroimage 62, 816–847. doi: 10.1016/j.neuroimage.2012.04.062 Proverbio, A. M., D’Aniello, G. E., Adorni, R., and Zani, A. (2011). When a photograph can be heard: vision activates the auditory cortex within 110 ms. Sci. Rep. 1, 1–11. doi: 10.1038/srep00054 Ptak, R. (2012). The frontoparietal attention network of the human brain: action, saliency, and a priority map of the environment. Neuroscientist 18, 502–515. doi: 10.1177/1073858411409051 Ramus, F. (2014). Neuroimaging sheds new light on the phonological deficit in dyslexia. Trends Cogn. Sci. 18, 274–275. doi: 10.1016/j.tics.2014.01.009 Ramus, F., and Szenkovits, G. (2008). What phonological deficit? Q. J. Exp. Psychol. 61, 129–141. doi: 10.1080/17470210701508822 Raven, J. C., and Court, J. H. (1998). Raven’s Progressive Matrices and Vocabulary Scales, Vol. 759. Oxford: Oxford Psychologists Press. Richardson, U., Thomson, J. M., Scott, S. K., and Goswami, U. (2004). Auditory processing skills and phonological representation in dyslexic children. Dyslexia. 10, 215–233. Robertson, E. K., and Gallant, J. E. (2019). Eye tracking reveals subtle spoken sentence comprehension problems in children with dyslexia. Lingua 228, 102708. doi: 10.1016/j.lingua.2019.06.009 Rossion, B., Curran, T., and Gauthier, I. (2002). A defense of the subordinatelevel expertise account for the N170 component. Cognition 85, 189–196. doi: 10.1016/S0010-0277(02)00101-4 Frontiers in Neuroscience | www.frontiersin.org 16 July 2022 | Volume 16 | Article 921977
Azaiez et al. Speech and Reading Brain Correlates Rossion, B., Joyce, C. A., Cottrell, G. W., and Tarr, M. J. (2003). Early lateralization and orientation tuning for face, word, and object processing in the visual cortex. Neuroimage 20, 1609–1624. doi: 10.1016/j.neuroimage.2003.07.010 Ruhnau, P., Herrmann, B., Maess, B., and Schröger, E. (2011). Maturation of obligatory auditory responses and their neural sources: evidence from EEG and MEG. Neuroimage 58, 630–639. doi: 10.1016/j.neuroimage.2011. 06.050 Rüsseler, J., Ye, Z., Gerth, I., Szycik, G. R., and Münte, T. F. (2018). Audio-visual speech perception in adult readers with dyslexia: an fMRI study. Brain Imaging Behav. 12, 357–368. doi: 10.1007/s11682-0179694-y Sacchi, E., and Laszlo, S. (2016). An event-related potential study of the relationship between N170 lateralization and phonological awareness in developing readers. Neuropsychologia 91, 415–425. doi: 10.1016/j.neuropsychologia.2016.09.001 Salmelin, R., Kiesil,ä, P., Uutela, K., Service, E., and Salonen, O. (1996). Impaired visual word processing in dyslexia revealed with magnetoencephalography. Ann. Neurol. 40, 157–162. doi: 10.1002/ana.4104 00206 Sánchez-Vincitore, L. V., Avery, T., and Froud, K. (2018). Word-related N170 responses to implicit and explicit reading tasks in neoliterate adults. Int. J. Behav. Dev. 42, 321–332. doi: 10.1177/01650254177 14063 Schulte-Körne, G., Deimel, W., Bartling, J., and Remschmidt, H. (1998). Auditory processing and dyslexia: evidence for a specific speech processing deficit. Neuroreport 9, 337–340. doi: 10.1097/00001756-19980126000029 Shahin, A., Roberts, L. E., and Trainor, L. J. (2004). Enhancement of auditory cortical development by musical experience in children. Neuroreport 15, 1917–1921. doi: 10.1097/00001756-20040826000017 Shaywitz, B. A., Shaywitz, S. E., Pugh, K. R., Mencl, W. E., Fulbright, R. K., Skudlarski, P., et al. (2002). Disruption of posterior brain systems for reading in children with developmental dyslexia. Biol. Psychiatry 52, 101–110. doi: 10.1016/S0006-3223(02)01365-3 Siegel, L. S. (2006). Perspectives on dyslexia. Paediatr. Child Health 11, 581–587. doi: 10.1093/pch/11.9.581 Simon, G., Petit, L., Bernard, C., and Reba,ï, M. (2007). N170 ERPs could represent a logographic processing strategy in visual word recognition. Behav. Brain Funct. 3, 1–11. doi: 10.1186/1744-9081-3-21 Simos, P. G., Breier, J. I., Wheless, J. W., Maggio, W. W., Fletcher, J. M., Castillo, E. M., et al. (2000). Brain mechanisms for reading: the role of the superior temporal gyrus in word and pseudoword naming. Neuroreport 11, 2443–2446. doi: 10.1097/00001756-200008030-00021 Smith-Spark, J. H., Henry, L. A., Messer, D. J., and Ziecik, A. P. (2017). Verbal and non-verbal fluency in adults with developmental dyslexia: phonological processing or executive control problems? Dyslexia 23, 234–250. doi: 10.1002/dys.1558 Snowling, M. (1998). Dyslexia as a phonological deficit: evidence and implications. Child Psychol. Psychiatry Rev. 3, 4–11. doi: 10.1017/S1360641797001366 Snowling, M. J. (2001). From language to reading and dyslexia 1. Dyslexia 7, 37–46. doi: 10.1002/dys.185 Snowling, M. J., Hulme, C., and Nation, K. (2020). Defining and understanding dyslexia: past, present and future. Oxford Rev. Educ. 46, 501–513. doi: 10.1080/03054985.2020.1765756 Stein, J. (2018). What is developmental dyslexia? Brain Sci. 8, 26. doi: 10.3390/brainsci8020026 Tiffin-Richards, S. P., and Schroeder, S. (2015). Children’s and adults’ parafoveal processes in German: phonological and orthographic effects. J. Cogn. Psychol. 27, 531–548. doi: 10.1080/20445911.2014.999076 Trébuchon, A., Démonet, J. F., Chauvel, P., and Liégeois-Chauvel, C. (2013). Ventral and dorsal pathways of speech perception: an intracerebral ERP study. Brain Lang. 127, 273–283. doi: 10.1016/j.bandl.2013.04.007 Uno, T., Kasai, T., and Seki, A. (2021). The developmental change of printtuned N170 in highly transparent writing systems 1. Jpn. Psychol. Res. doi: 10.1111/jpr.12397 Van Atteveldt, N., Formisano, E., Goebel, R., and Blomert, L. (2004). Integration of letters and speech sounds in the human brain. Neuron 43, 271–282. doi: 10.1016/j.neuron.2004.06.025 Vellutino, F. R., Fletcher, J. M., Snowling, M. J., and Scanlon, D. M. (2004). Specific reading disability (dyslexia): what have we learned in the past four decades? J. Child Psychol. Psychiatry 45, 2–40. doi: 10.1046/j.0021-9630.2003.00305.x Vernon, M. D. (2016). Backwardness in Reading. Cambridge: Cambridge University Press. Vidal, J., Bonnet-Brilhault, F., Roux, S., and Bruneau, N. (2005). Auditory evoked potentials to tones and syllables in adults: evidence of specific influence on N250 wave. Neurosci. Lett. 378, 145–149. doi: 10.1016/j.neulet.2004.12.022 Vogel, A. C., Church, J. A., Power, J. D., Miezin, F. M., Petersen, S. E., and Schlaggar, B. L. (2013). Functional network architecture of reading-related regions across development. Brain Lang. 125, 231–243. doi: 10.1016/j.bandl.2012.12.016 Wang, Y., Huang, H., Yang, H., Xu, J., Mo, S., Lai, H., et al. (2019). Influence of EEG references on N170 component in human facial recognition. Front. Neurosci. 13, 705. doi: 10.3389/fnins.2019.00705 Wass, S. V., Daubney, K., Golan, J., Logan, F., and Kushnerenko, E. (2019). Elevated physiological arousal is associated with larger but more variable neural responses to small acoustic change in children during a passive auditory attention task. Dev. Cogn. Neurosci. 37, 100612. doi: 10.1016/j.dcn.2018. 12.010 Wenzel, M. A., Golenia, J. E., and Blankertz, B. (2016). Classification of eye fixation related potentials for variable stimulus saliency. Front. Neurosci. 10, 23. doi: 10.3389/fnins.2016.00023 Wright, C. M., and Conlon, E. G. (2009). Auditory and visual processing in children with dyslexia. Dev. Neuropsychol. 34, 330–355. doi: 10.1080/87565640902801882 Yang, Y., Yang, Y. H., Li, J., Xu, M., and Bi, H. Y. (2020). An audiovisual integration deficit underlies reading failure in nontransparent writing systems: an fMRI study of Chinese children with dyslexia. J. Neurolinguistics 54, 100884. doi: 10.1016/j.jneuroling.2019.100884 Ye, Z., Rüsseler, J., Gerth, I., and Münte, T. F. (2017). Audiovisual speech integration in the superior temporal region is dysfunctional in dyslexia. Neuroscience 356, 1–10. doi: 10.1016/j.neuroscience.2017.05.017 Yi, H. G., Leonard, M. K., and Chang, E. F. (2019). The encoding of speech sounds in the superior temporal gyrus. Neuron 102, 1096–1110. doi: 10.1016/j.neuron.2019.04.023 Ylinen, S., Junttila, K., Laasonen, M., Iverson, P., Ahonen, L., and Kujala, T. (2019). Diminished brain responses to second-language words are linked with native-language literacy skills in dyslexia. Neuropsychologia 122, 105–115. doi: 10.1016/j.neuropsychologia.2018. 11.005 Žari´ c, G., Fraga González, G., Tijms, J., van der Molen, M. W., Blomert, L., and Bonte, M. (2014). Reduced neural integration of letters and speech sounds in dyslexic children scales with individual differences in reading fluency. PLoS ONE 9, e110337. doi: 10.1371/journal.pone.01 10337 Zhang, G., Yuan, B., Hua, H., Lou, Y., Lin, N., and Li, X. (2021a). Individual differences in first-pass fixation duration in reading are related to resting-state functional connectivity. Brain Lang. 213, 104893. doi: 10.1016/j.bandl.2020.104893 Zhang, J., and McBride-Chang, C. (2010). Auditory sensitivity, speech perception, and reading development and impairment. Educ. Psychol. Rev. 22, 323–338. doi: 10.1007/s10648-010-9137-4 Zhang, R., Wang, Z., Wang, X., and Yang, J. (2021b). N170 adaptation effect of the sub-lexical phonological and semantic processing in Chinese character reading. Acta Psychol. Sinica 53, 807. doi: 10.3724/SP.J.1041.2021.00807 Zhao, B., Dang, J., and Zhang, G. (2016). “EEG evidence for a three-phase recurrent process during spoken word processing,” in 2016 10th International Symposium on Chinese Spoken Language Processing (ISCSLP) (IEEE), 1–5. Zhao, J., Kipp, K., Gaspar, C., Maurer, U., Weng, X., Mecklinger, A., et al. (2014). Fine neural tuning for orthographic properties of words emerges early in children reading alphabetic script. J. Cogn. Neurosci. 26, 2431–2442. doi: 10.1162/jocn_a_00660 Frontiers in Neuroscience | www.frontiersin.org 17 July 2022 | Volume 16 | Article 921977
Azaiez et al. Speech and Reading Brain Correlates Zhao, J., Li, S., Lin, S. E., Cao, X. H., He, S., and Weng, X. C. (2012). Selectivity of N170 in the left hemisphere as an electrophysiological marker for expertise in reading Chinese. Neurosci. Bull. 28, 577–584. doi: 10.1007/s12264-0121274-y Conflict of Interest: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. Publisher’s Note: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher. Copyright © 2022 Azaiez, Loberg, Hämäläinen and Leppänen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. Frontiers in Neuroscience | www.frontiersin.org 18 July 2022 | Volume 16 | Article 921977