Exploring Frequency-Dependent Brain Networks from Ongoing EEG Using Spatial ICA During Music Listening
Full text
This is a self-archived version of an original article. This version may differ from the original in pagination and typographic details. Author(s): Title: Year: Version: Copyright: Rights: Rights url: Please cite the original version: CC BY 4.0 https://creativecommons.org/licenses/by/4.0/ Exploring Frequency-Dependent Brain Networks from Ongoing EEG Using Spatial ICA During Music Listening © The Authors 2020 Published version Zhu, Yongjie; Zhang, Chi; Poikonen, Hanna; Toiviainen, Petri; Huotilainen, Minna; Mathiak, Klaus; Ristaniemi, Tapani; Cong, Fengyu Zhu, Y., Zhang, C., Poikonen, H., Toiviainen, P., Huotilainen, M., Mathiak, K., Ristaniemi, T., & Cong, F. (2020). Exploring Frequency-Dependent Brain Networks from Ongoing EEG Using Spatial ICA During Music Listening. Brain Topography, 33(3), 289-302. https://doi.org/10.1007/s10548-020-00758-5 2020
Vol.:(0123456789) 1 3 Brain Topography https://doi.org/10.1007/s10548-020-00758-5 ORIGINAL PAPER Exploring Frequency‑Dependent Brain Networks fromOngoing EEG Using Spatial ICA During Music Listening YongjieZhu1,2 · ChiZhang1· HannaPoikonen6· PetriToiviainen3· MinnaHuotilainen4· KlausMathiak5· TapaniRistaniemi2· FengyuCong1,2 Received: 14 August 2019 / Accepted: 20 February 2020 © The Author(s) 2020 Abstract Recently, exploring brain activity based on functional networks during naturalistic stimuli especially music and video represents an attractive challenge because of the low signal-to-noise ratio in collected brain data. Although most efforts focusing on exploring the listening brain have been made through functional magnetic resonance imaging (fMRI), sensor-level electroor magnetoencephalography (EEG/MEG) technique, little is known about how neural rhythms are involved in the brain network activity under naturalistic stimuli. This study exploited cortical oscillations through analysis of ongoing EEG and musical feature during freely listening to music. We used a data-driven method that combined music information retrieval with spatial Fourier Independent Components Analysis (spatial Fourier–ICA) to probe the interplay between the spatial profiles and the spectral patterns of the brain network emerging from music listening. Correlation analysis was performed between time courses of brain networks extracted from EEG data and musical feature time series extracted from music stimuli to derive the musical feature related oscillatory patterns in the listening brain. We found brain networks of musical feature processing were frequency-dependent. Musical feature time series, especially fluctuation centroid and key feature, were associated with an increased beta activation in the bilateral superior temporal gyrus. An increased alpha oscillation in the bilateral occipital cortex emerged during music listening, which was consistent with alpha functional suppression hypothesis in task-irrelevant regions. We also observed an increased delta–beta oscillatory activity in the prefrontal cortex associated with musical feature processing. In addition to these findings, the proposed method seems valuable for characterizing the large-scale frequency-dependent brain activity engaged in musical feature processing. Keywords Frequency-specific networks· Music information retrieval· EEG· Independent components analysis Introduction Understanding how our brain perceives complex and continuous inputs from the real-world has been an attractive problem in cognitive neuroscience in the past few decades. Brain imaging technology provides an opportunity to address this issue. However, revealing brain states is generally more Handling editor: Christoph M. Michel. Yongjie Zhu and Chi Zhang have contributed equally to this work. * Fengyu Cong [email protected] 1 School ofBiomedical Engineering, Faculty ofElectronic andElectrical Engineering, Dalian University ofTechnology, Dalian116024, China 2 Faculty ofInformation Technology, University ofJyväskylä, Jyväskylä40014, Finland 3 Department ofMusic, Art andCulture Studies, University ofJyväskylä, Jyväskylä40014, Finland 4 CICERO Learning Network andCognitive Brain Research Unit, Faculty ofEducational Sciences, University ofHelsinki, Helsinki00014, Finland 5 Department ofPsychiatry, Psychotherapy andPsychosomatics, Medical Faculty, RWTH Aachen, Pauwelsstraße 30, Aachen52074, Germany 6 Institute ofLearning Sciences andHigher Education, ETH Zürich, Zürich, Switzerland
Brain Topography 1 3 difficult during real-word experiences than those recorded brain activities during resting-state or simplified abstract stimuli like controlled and rapidly repeated stimuli (Hasson etal. 2010; Malcolm etal. 2016; Spiers and Maguire 2007). The question of how to disentangle stimuli-induced brain activity from spontaneous activity still remains open for scientific research due to the complexity of natural situations. In the present study, we attempt to formulate an approach with several analysis techniques including spatial ICA, source localization, acoustic feature extraction, and temporal correlation to examine the elicited oscillatory brain networks using ongoing electroencephalography (EEG) recorded during music listening. Recently, the brain state under the naturalistic stimuli including music and movie has been investigated through functional magnetic resonance imaging (fMRI) (Alluri etal. 2012a, b; Alluri etal. 2013; Burunat etal. 2014, 2016a, b; Liu etal. 2017; Toiviainen etal. 2014), MEG (Koskinen etal. 2013; Lankinen etal. 2014) and EEG (Cong etal. 2013a, b; Daly etal. 2014, 2015; Schaefer etal. 2013; Sturm etal. 2015; Zhu etal. 2019, 2020). Alluri etal. explored the neural correlates of music feature processing as it occurs in a realistic or naturalistic environment, where eleven participants attentively listened to the whole piece of music (Alluri etal. 2012a, b; Burunat etal. 2016b, a). They successfully identified brain regions involved in processing of musical features in a naturalistic paradigm and found large-scale brain responses in cognitive, motor and limbic brain networks during continuous processing of low-level (timbral) and high-level (tonal and rhythmical) acoustic features using fMRI. Burunat etal. studied the replicability of Alluri’s findings using a similar methodological approach with a similar group of participants and found the processing mechanisms for low-level musical features were more reliable than highlevel features (Burunat etal. 2016b, a). Unfortunately, all BOLD measurements by fMRI are to some degree confounded since they are indirect assessments of brain activity; they relate to blood flow and not to electrical processes and are therefore limited by poor temporal resolution due to the protracted hemodynamic response (Brookes etal. 2014; Li etal. 2019). After that, Cong etal. used an analogous to correlation analysis technique to investigate neural rhythms based on ongoing EEG data collected during listening to same music stimuli (Cong etal. 2013a, b; Wang etal. 2016). They found the theta and alpha oscillations along central and occipital area of scalp topology seems significantly associated with high-level (tonal and rhythmical) acoustic features processing. Also, many other studies tried to examine the neural underpinnings of music listening based on sensorlevel EEG data (Jäncke etal. 2015, 2018; Markovic etal. 2017), in which different frequency bands were extracted using time–frequency analysis methods and further analyzed separately (e.g., event-related synchronizations and oscillatory power changes). Those studies showed the influence of different music listening styles on neurophysiological and psychological state interpreted by brain activation. Some sensor-level EEG studies examined the physiological correlates of continuous changes in subjective emotional states while listening to a complete music piece (Mikutta etal. 2012, 2014). Compared with sensor-level EEG analysis, recent studies adopted a mathematical approach (called sLORETA–ICA) combing source localization techniques with ICA to detect the independent functional networks during music listening (Jäncke and Alahmadi 2016; Rogenmoser etal. 2016). Although the aforementioned studies investigated the oscillatory activation or functional networks during music listening, the specific networks emerging from dynamic processing of musical features are not yet fully understood (Meyer etal. 2006). For example, there is evidence indicating that timbral feature processing was associated with increased activations in cognitive areas of the cerebellum, and sensory and default mode network cerebrocortical areas, but musical pulse, and tonality processing recruited cortical and subcortical cognitive, motor and emotion-related circuits (Alluri etal. 2012a, b; Meyer etal. 2006). Thus, we aimed to examine the electrophysiological underpinnings of these networks emerging from dynamic processing of musical features. Independent component analysis (ICA) is a well-established data-driven approach increasingly used to factor resting-state fMRI data into temporally covarying, spatially independent sources or networks. By contrast, in the analysis of EEG/MEG data, ICA has mainly been applied for artifact rejection. However, spatial Fourier–ICA was proposed for data-driven characterization of oscillatory brain activity using EEG/MEG data. Compared with other ICA method applied to the context of music listening, spatial Fourier–ICA used in the current study can automatically extract narrowband oscillations from broadband data without having to manually specify a frequency band of interest. So far, spatial Fourier–ICA has already been proved to be fruitful in gaining insights into electrophysiological underpinnings of networks (Kauppi etal. 2013; Li etal. 2018; Ramkumar etal. 2014). By applying spatial Fourier–ICA in combination with acoustical feature extraction, this study aims at probing the spatial–spectral patterns under music listening. Particularly, the current study attempts to provide an analysis framework for identifying the spatial, temporal, and spectral signatures of brain activation recruited during dynamic processing of music features. Similar to our previous music listening studies (Alluri etal. 2012a, b; Cong etal. 2013a, b), we extracted five musical features from the musical stimulus, and spatial, temporal, and spectral factors using spatial Fourier–ICA to EEG data. We then analyzed the correlation between temporal courses and the musical feature time series to identify
Brain Topography 1 3 frequency-specific brain networks emerging from dynamic processing of musical features. We expected spatial FourierICA to reveal functionally oscillatory EEG source contributing to the musical feature processing. Material andMethods Data Acquisition Participants Fourteen right-handed and healthy adults aged 20 to 46years old were recruited to take part in the current experiment after signing written informed consent. None of them was reported about hearing loss or history of neurological illnesses and none of them had professional musical education. However, many participants reported background in different music-related interests such as learning to play an instrument, producing music with a computer, singing. Table1 demonstrates the age and the non-professional musical background of each participant. This study was approved by the local ethics committee. EEG Data Acquisition During the experiment, participants were informed to listen to the music with eyes open. A 512s long musical piece of modern tango by Astor Piazzolla was used as the stimulus. Music was presented through audio headphones with about 30dB of gradient noise attenuation. This music clip had appropriate duration for the experimental setting, because of its high range of variation in several musical features such as dynamics, timbre, tonality and rhythm (Alluri etal. 2012a, b). The EEG data were recorded according to the international 10–20 system with BioSemi electrode caps (64 electrodes in the cap and 5 external electrodes at the tip of the nose, left and right mastoids and around the right eye both vertically and horizontally). EEG were sampled at a rate of 2048Hz and stored for further processing in offline. The external electrode at the tip of the nose was used as the reference. EEG channels were re-referenced using a common average. The data preprocessing was carried out using EEGLAB (Delorme and Makeig 2004). The EEG data were visually inspected for artefacts and bad channels were interpolated using a spherical spline model. A notch filter at 50Hz was applied to remove noise. High-pass and low-pass filter with 1Hz and 30Hz cutoff frequencies were then applied as our previous investigation of the frequency domain revealed that no useful information was found in higher frequencies (Cong etal. 2013a, b). Finally, the data were down-sampled to 256Hz. In order to remove EOG (i.e., eye blinks), ICA was performed on EEG data of each participant. To additionally remove any DC-jumps occasionally present in the data, we differentiated each time series, applied a median filter to reject large discontinuities and reintegrated the signals back (Ramkumar etal. 2012). Musical Features Based on the length of the window used in the computational analyses, the musical features can be generally classified into two categories: long-term features and short-term features (Alluri etal. 2012a, b; Cong etal. 2013a, b). Five long-term musical features including Mode, Key Clarity, Fluctuation Centroid, Fluctuation Entropy and Pulse Clarity Table 1 Age and musical background of each participant No. of participant Age Years of musical activity Instrument Years of activity in dance Type of dance Sub01 20 15 Piano/singing None Sub02 23 13 Piano/flute None Sub03 23 16 Cello None Sub04 23 None 6 Ballet Sub05 20 2 Piano None Sub06 42 15 Alto saxophone None Sub07 46 None None Sub08 22 7 Piano None Sub09 21 None None Sub10 34 6 Piano/keyboards None Sub11 31 5 Piano None Sub12 25 7 Piano/violin 7 Folk dance Sub13 25 None None Sub14 24 3 Piano None
Brain Topography 1 3 were examined here. They were extracted using a frameby-frame analysis approach commonly used in the field of Music Information Retrieval (MIR). The duration of the frames was 3s and the overlap between two adjacent frames 67% of the frame length. The chosen length of the frame was approximately consistent with the length of the auditory sensory memory (Alluri etal. 2012a, b). This analysis process yielded the time series of musical feature at a sampling frequency of 1Hz, in accordance with the short-time Fourier transform (STFT) analysis of EEG data. Thus, both the musical features and temporal courses of EEG had 512 time points. All the features were extracted using the MIRtoolbox (Lartillot etal. 2008) in MATLAB environment. For the completeness of the content, we briefly introduce the five features below. We extracted two tonal and three rhythmic features. For the tonal features, Mode represents the strength of major or minor mode. Key Clarity is defined as the measure of the tonal clarity. The rhythmic features included Fluctuation Centroid, Fluctuation Entropy, and Pulse Clarity. Fluctuation Centroid is the geometric mean of the fluctuation spectrum, representing the global repartition of rhythm periodicities within the range of 0–10Hz (Alluri etal. 2012a, b). This feature indicates the average frequency of these periodicities. Fluctuation entropy is the Shannon entropy of the fluctuation spectrum, representing the global repartition of rhythm periodicities. Fluctuation entropy is a measure of the noisiness of the fluctuation spectrum (Alluri etal. 2012a, b; Cong etal. 2013a, b). Pulse Clarity, naturally, is an estimate of clarity of the pulse (Alluri etal. 2012a, b; Cong etal. 2013a, b). Source Localization For each subject, the brain’s cortical surface was reconstructed from an anatomical MRI template in Brainstorm (Tadel etal. 2011). Dipolar current sources were estimated at cortical-constrained discrete locations (source points) separated by 15mm. Each hemisphere was modelled by a surface of approximately 2000 vertices, thus a mesh of approximately 4000 vertices modelled the cortical surface for each subject. The measured EEG signals are generated by postsynaptic activity of ensembles of cortical pyramidal neurons of the cerebral cortex (Lei and Yao 2011). These cortical pyramidal neurons can be modelled as current dipoles located at cortical surface (Lin etal. 2006). The scalp potentials generated by each dipole depend on the characteristics of the various tissues of the head and are measured by the EEG scalp electrodes (Tian etal. 2011). With the geometry of the anatomy and the conductivity of the subject’s head, the time course of the dipole’s activity can be assessed by solving two consecutive problems: the forward problem and the inverse problem. The forward problem is to model the contribution of each dipole to the signals of the EEG electrodes by solving Maxwell’s equations, which takes the geometry and conductivity of head tissues into account. In this study, a forward solution was calculated using the symmetric boundary element method (BEM) for each source point while a relative conductivity coefficient was assigned to each tissue (with default MNI MRI template). To solve the inverse problem, minimum-norm estimate (Lin etal. 2006) was adapted with a loose orientation constraint favoring source currents perpendicular to the local cortical surface (no noise modelling). When computing the inverse operator (1) the source orientations were constrained to be normal to the cortical surface; (2) a depth weighting algorithm was used to compensate for any bias affecting the superficial sources calculation; and (3) a regularization parameter, 𝜆2=0.1 was used to minimize numerical instability, and to effectively obtain a spatially smoothed solution. Finally, an inverse operator G of dimensions Ns×Nc (where Ns is the number of source points and Nc is the number of channels: Ns≫Nc ) was obtained to map the data from sensor-space to source-space. Here, we had Ns=4000 and Nc=64 . Spatial Fourier Independent Component Analysis Spatial Fourier-ICA was recently proposed to characterize oscillatory EEG/MEG activity in cortical source space (Ramkumar etal. 2012, 2014). The main idea was to apply complex-valued ICA to short-time Fourier transforms of source-level EEG/MEG signals to reveal physiologically meaningful components. We briefly introduced the main steps of spatial Fourier-ICA for the completeness of the content. Figure1 demonstrates the analysis pipeline based on spatial Fourier-ICA and acoustical feature extraction. Time–Frequency Data inCortical Source Space Preprocessed EEG data Y0 ( Nc channels × Np sampling points) were transformed by STFT to obtain complex-valued time–frequency representation (TFR) data Y1 ( Nc , Nf , Nt ). To obtain TFR data in source space, three-way sensor-space TFR data Y1 was reorganized as two-way matrix Y1 ( Nc , Nt×Nf ). The source-space TFR data Y2 was then obtained by left-multiplying the linear inverse operator G ( Ns,Nc ) which was computed using the minimum-norm estimate inverse solution sensor-space data Y1 , Two-way data Y2 ( Ns , Nt×Nf ) can be rearranged as a three-way tensor format Y2 ( Ns , Nt , Nf ). For application of spatial Fourier ICA, we then rearranged the three-way tensor (1) Y2 =G Y 1
Brain Topography 1 3 Y2 as a two-way matrix X0 ( Nt , Nf×Ns ). Thus, each row of X0 was comprised of the complex-valued short-time Fourier coefficients from each source point for specific time points and each column represented a time point corresponding to a short-time window. In this study, the Hamming-widow with 3-s-length and 2-s-overlap of the adjacent windows was selected, resulting in a sampling rate of 1Hz in time dimension. This sampling rate was in consistent with musical feature time series (see Musical features). The duration of EEG was 512s, so we had Nt=512 time points. We adopted a 512-point FFT to calculate the STFT resulting in 256 frequency bins (Range of frequency: 1–128Hz) for each window. We selected the range of frequency bins covering 1–30Hz ( Nf=60 ) for further analysis. Application ofComplex‑Valued ICA onReshaped Data For data X0 , we applied complex-valued ICA (A. Hyvarinen etal. 2010) and treated each row as an observed signal assumed to be a linear mixture of unknown spatial spectral pattern. Since the original data ( X0 ) dimension was relatively high for the complex ICA calculation, data dimension reduction was required in the preprocessing step of ICA. A common approach of data dimension reduction is principal component analysis (PCA) which is linear. Here we extended PCA to the complex domain by considering complex-valued eigenvalue decomposition (Li etal. 2011). The choice of model order was based on previous studies (Abou-Elseoud etal. 2010; Smith etal. 2009), which suggested the number of a dimension slightly larger than the expected number of underlying sources. In this study, we tried different model orders and found that 20 was a reasonable order, which preserved much of the information in the data and reduced the dimensionality of the results. Then we extracted 20 independent components using complexvalued FastICA algorithm which applied ICA to STFT of EEG data in order to find more interesting sources than with time-domain ICA (A. Hyvarinen etal., 2010). This method is especially useful for finding sources of rhythmic activity. After complex-valued ICA, a mixing matrix A ( Nt , Nic =20 is number of components) and estimated source matrix S were obtained. Each column of A represented the temporal course for each independent component (IC). The ICs in the rows of S ( Nic , Nf×Ns ) represented spatial-spectral patterns, which can be decomposed into the spatial power map and power spectra. Spatial Map, Spectrum, andTemporal Course ofICs By reshaping each row of S for each IC, we obtained a matrix ( Nf,Ns ), which meant there was a Fourier coefficient spectrum for each cortical source point. To obtain and visualize the spatial map of the IC, we computed the average of the squared magnitude of the complex Fourier coefficients ... ... Spatial Fourier-ICA EEG Channels time ... time compsCortical ptsxfreq Spatialmaps Temporal courses Spectra Temporal courses of musicalfeature Retained ICswith significant correlation Spatialmaps clustering TheNO. of Subjects and ICsacross musicalfeature SpectraofICs involved in cluster Acoustic feature extraction Fig. 1 Analysis pipeline based on spatial Fourier–ICA and acoustical feature extraction. Temporal, spectral and spatial profiles of brain pattern were extracted using spatial Fourier–ICA. Musical feature time series were extracted using acoustical feature extraction. Then, correlation analysis between temporal course of components and musical time series were performed to retain music elicited components. The spatial maps of retained components were clustered into several patterns
Brain Topography 1 3 across those frequency bins. Since the distribution of mean squared Fourier amplitude over the whole brain is highly non-Gaussian, we did not apply conventional z-score-based thresholding; instead, we applied a threshold to display for each component map only source points with the top 5% squared Fourier amplitude (Ramkumar etal. 2012). Then we analyzed the correlation coefficient of the spatial maps in those frequency bins and those spatial maps were similar. To visualize and obtain the spectrum of each IC, we calculated the mean of the Fourier power spectrum across those source points exceeding the 95th percentile (Ramkumar etal. 2012). Finally, we extracted the absolute values of the column of mixing matrix A corresponding to the row of the estimated IC as the time course, which reflected fluctuations of the Fourier amplitude envelope for the specific frequency and spatial profile. Stability ofICA Decomposition To examine the stability of ICA, we applied 100 times ICA decomposition for each subject with different initial conditions. For the real-valued case, ICASSO toolbox (Himberg etal. 2004) has been used to evaluate stability among multiple estimates of the fastICA algorithm (Hyvarinen 1999). All the components estimated from all runs were collected and clustered based on the absolute value of the correlation coefficients among the squared source estimates of ICASSO. Finally, the stability index Iq was computed for each component. Iq reflects the isolation and compactness of a cluster (Himberg etal. 2004). Iq is calculated as follows: where − S (i) int denotes the average intra-cluster similarity; − S(i)ext indicates average inter-cluster similarity and J is the number of clusters. The Iq ranges from ‘0′ to ‘1′. When Iq approaches ‘1′, it means that the corresponding component is extracted in almost every ICA decomposition application. This indicates a high stability of the ICA decomposition for that component. Otherwise, it means the ICA decomposition is not stable. Correspondingly, if all the clusters are isolated with each other, ICA decomposition should be stable. In general, there is no established criterion upon which to base a threshold for cluster quality. Given the preliminary nature of this investigation, we consider the decomposition is stable if the Iq is greater than 0.7. In this study, the ICASSO toolbox was modified to be available for the complex-valued case as well. The correlation matrix was used as the similarity measure for clustering in real-valued ICASSO. For the complex case, since the ICs were complex-valued, we just considered the correlation matrix among the magnitude ICs to perform the clustering (2) Iq =S(i) int −S(i) ext ,i=1, … ,J (Li etal. 2011). Then, we took the Iq as the criterion to examine stability of the ICA estimate. Testing forStimulus‑Related Networks After ICA decomposition, we obtained 20 × 14 = 280 ICs (14 subjects, 20 components for each subject). Now the challenge is to determine which one of these represents the genuine brain responses. In all ICA based methods, it is a general question that which independent components need to be retained or which component just reflects noise. Here, we examine which components were modulated significantly by the musical features. We computed the correlation (Pearson’s correlation coefficient) between the time courses of musical features and the time courses of those ICs (the dimensionality of both them is 512 points) in order to select stimulusrelated activations. We used the Monte Carlo method and permutation tests presented in our previous research (Alluri etal. 2012a, b; Cong etal. 2013a, b) to calculate the threshold of significant correlation coefficient. In this method, a Monte Carlo simulation of the approach was performed to determine the threshold for multiple comparisons. We kept those ICs whose time courses were significantly correlated (p < 0.05) with the time courses of musical features for further analysis. Cluster Analysis The selected ICs had been represented by spatial map, spectrum, and temporal course. Since spatial ICA was carried out on individual level EEG data, we needed to examine the inter-subject consistency among participants. In this study, we focused on the spatial pattern emerging in the process of freely listening to music, so a group level data analysis was performed by clustering spatial maps of the selected ICs to evaluate the consistency among the participants. For reliable clustering, we applied a conventional z-score-based normalization to each spatial map. All spatial maps of the screened components significantly correlated with musical features were clustered into M clusters to find common spatial patterns among most of participants. Here for simplicity, a conventional k-means cluster algorithm was used with the Kaufman Approach (KA) for initializing the algorithm. We used the minimum description length (MDL) to determine the number of clusters M. Afterwards we countered the number of subjects involved in ICs in each cluster. If the number of subjects in one cluster is less than half of the all subjects, this cluster would be discarded for the reason that such a cluster does not reveal information shared among enough participants. For the retained clusters, the spatial-spectral-temporal information was obtained, which was represented by the centroid of the cluster, the spectra
Brain Topography 1 3 of ICs and the numbers of subjects whose temporal courses were involved in this cluster. Results Musical Features Five musical features were extracted by MIRtoolbox (Lartillot and Toiviainen 2007) with 3s time-widow and 2s overlap, resulting in 1Hz sampling rate of temporal course. They are Fluctuation Centroid, Fluctuation Entropy, Key Clarity, Mode and Pulse Clarity. The time series of these features had a length of 512 samples, which matched the length of the time course of the EEG components. Figure2 shows their temporal courses. Stability ofICA Decomposition We extracted 20 ICs using modified ICASSO with 100 runs for each subjects’ data, then we obtained the stability index Iq . Figure3 shows the magnitude of Iqs for each participant, greater than 0.7 for most ICs. The 20 ICs were separated with each other for every participant from the view of clustering. Thus, the ICA estimate was stable and the results of ICA decomposition in this study were satisfactory for each participant data to further analysis. Interesting Clusters: Frequency‑Specific Networks After 85 ICs whose spatial maps were significantly correlated with musical features were selected, we set the number of clusters as five by performing MDL to estimate the optimal model order. Then the spatial maps of ICs were clustered into five clusters. Three clusters representing Fig. 2 Time course of five musical features 0100 200300 40 0500 Time(second) Pu lse Clarity Mode Key Clarity Fluctuation Entropy Fluctuation Centroid Time courses of musical features Magnitude of Iq 246810 12 14 16 18 20 0 0.2 0.4 0.6 0.8 1 Component # Fig. 3 Iq of each component extracted. Different curves represent different participants
Brain Topography 1 3 frequency-specific networks were chosen since the number of subjects in the cluster is more than half of the all subjects. Figure4 demonstrates one of these clusters including the centroid of all spatial maps (Fig.4a), the distribution of number of subjects across musical features (Fig.4b) and the spectrum of the ICs in this cluster (Fig.4c). Then we computed the correlation coefficients among spatial maps in each cluster to evaluate the performance of clustering. Figure5 shows the inter-cluster similarity. We computed the mean of the correlation coefficients in each cluster and the corresponding standard deviation (SD). For cluster#1, the mean is 0.642 and the corresponding standard deviation (SD) is 0.1238. For cluster#2, the mean is 0.7125 and SD is 0.0572. For cluster#3, the mean is 0.8084 and SD is 0.0747. This indicates that the spatial patterns are similar across the participants. In the Table2, we listed the participants whose EEG data were correlated with every musical feature in each cluster. Beta‑Specific Network Figure4 shows results of the Beta-specific brain networks engaged in processing music features. The spatial map displays that musical features were associated with increased activation in the bilateral superior temporal gyrus (STG). The spectrum of ICs in this cluster illustrates the beta rhythm (focusing on 20Hz) was involved in generating this network. Thus, relatively large-scale brain region generated by beta rhythm was activated in the bilateral STG and the magnitude of activation in right hemisphere was a little stronger than left hemisphere. This Beta-specific network was found in seven subjects during music free-listening (see the first row of Table2). Fluctuation Centroid were associated with this brain networks among subjects 2, 4, 5, and 12. The brain networks of subjects 1, 2, 3 and 13 were correlated with key feature. For fluctuation entropy, pulse clarity and mode, ASpatialMap Fluctuation Centroid Fluctuation Entropy KeyModePulse Clarity 0 2 4 6 8 Normalized Ampl itude BThenumberofICs &subjects Totalcomponents Totalsubjects 0510 15 20 25 30 35 Freqquency (Hz) 0 0.2 0.4 0.6 0.8 1 Number CThenormalizedspectrumofeachIC Beta bandBeta band Fig. 4 Cluster#1: Beta-specific networks. a The centroid of the spatial maps in the cluster, which reflected a spatial pattern across most of participants. The bilateral superior temporal gyrus (STG) was activated (from left to right: left hemisphere, top view, right hemisphere). b The number of ICs and subjects involved in the cluster were distributed across musical features. c The spectra of each components were located in delta or beta band. Different curves represent different ICs