scieee AI-readable full text Open interactive document viewer

Exploratory and Confirmatory Factor Analysis of the Social Skills Scale for Young Immigrants

Tomé Fernández, María,Fernández Leyva, Christian,Olmedo Moreno, Eva María

Abstract

Research Project Competitive EDU2017-88641-R

Full text

sustainability Article Exploratory and Confirmatory Factor Analysis of the Social Skills Scale for Young Immigrants María Tomé-Fernández , Christian Fernández-Leyva * and Eva María Olmedo-Moreno Department of Research and Diagnostic Methods in Education, University of Granada, 18194 Granada, Spain; [email protected] (M.T.-F.); [email protected] (E.M.O.-M.) *Correspondence: [email protected]; Tel.: +34-675-278-566 Received: 5 August 2020; Accepted: 22 August 2020; Published: 25 August 2020   Abstract: The integration of young immigrants in the societies that host them highlights the need for the intervention of social workers to facilitate their adaptation and inclusion from an individualized diagnosis of their needs. The development of social skills in the immigrants is one of the main ways to make that integration happen, and therefore its diagnosis is fundamental. However, at present, there are no valid and reliable instruments that take into account the sociocultural factors that surround young immigrants for the evaluation of their social skills. It is for this reason that the purpose of this study was to adapt and validate a current and useful instrument for the diagnosis of such social skills to young immigrants welcomed in Spain. To do this, it was started on the choice and adaptation of The Social Skills Scale (Escala de Habilidades Sociales). Subsequently, the questionnaire was submitted to concurrent, predictive, and nomological validation processes. The construct validity was carried out by factor analysis first and second order to confirm the hierarchical structure of the scale. After validation with Exploratory Factor Analysis (n=330), the structure was checked, and the model was later adjusted with Confirmatory Factor Analysis (n=568) by means of structural equations. The reliability and internal consistency of the instrument was also tested with values in all dimensions above 0.8. It is concluded that this new instrument has 29 items and 6 dimensions, has acceptable validity and reliability, and can be used for the diagnosis of Social Skills in Young Immigrants. Keywords: immigrants; instrument; social skills; validation; factor analysis; structural equations 1. Introduction The assessment of social skills has been a difficult area of research since its inception [ 1 , 2 ]. This difficulty is emphasized if the diagnoses of ideas, feelings, and opinions [ 3 ] are made for young immigrants. The social context of the immigrant in his adolescent and youthful stage is difficult [ 4 ]. When the child arrives in the receiving country, he faces high levels of unemployment, marginalization, social exclusion, and discrimination, which leads to a steep growth in the social gap towards him [ 5 ] and social skills, that he owned, are depleted [ 4 ]. Social skills are defined as behaviors through which people are able to express ideas, opinions, feelings, and affection for others [6]. More specifically in Spain, young immigrants face different challenges, which vary depending on the socioeconomic level and the country of origin [ 7 ]. For example, to young people, immigrants from Morocco, this being the population from which the most immigrants arrive in Spain, together with the Romanian population, are those who arouse the least sympathy among Spanish natives, which causes greater rejection towards them and consequently poor academic performance [ 8 ]. This translates into socioeconomic disadvantages, due to the lack of employment and a proper integration process, getting in some Spanish cities to be a segregated culture [4,5]. Sustainability 2020,12, 6897; doi:10.3390/su12176897 www.mdpi.com/journal/sustainability Sustainability 2020,12, 6897 2 of 20 However, a large number of Latin American migrants arrive in Spain, attracted by the call effect and by the similarity in language [ 9 ]. The Latin culture, similar to the Spanish one, together with the language, facilitate their social integration, and this, in turn, is reflected in the socioeconomic level, because they find paid jobs in the country more easily than other groups [10]. In addition, immigrants from the European continent arrive in Spain, especially in search of certain sanitary conditions and the warm climate that characterizes the country [ 11 , 12 ]. These immigrants usually form their own communities, even going so far as to create schools linked to the educational system of the country of origin [13]. Finally, in recent decades, the number of immigrants of Asian origin in Spain has increased. The greatest difficulty for these are found in language [ 14 ]. As with the previous group, they limit social relations to people from the community, although this is disappearing in generations to come. This may be due to the limited time they spend interacting [15,16]. The difficult integration of young immigrants in host societies [ 17 ] emphasizes the need for action by social workers to facilitate their adaptation and real inclusion [ 18 ]. When arriving in a country with cultural and linguistic differences, young immigrants are seen, in some situations, as separated from the rest of their equals [ 3 ]. Because of this, they need to learn the customs and language of the receiving country, and, therefore, learn to communicate and socialize to achieve full social inclusion [ 2 ]. The development of social skills is a key element for this to happen, decreases social anxiety and fear of rejection [ 19 ], enhancing the confidence of immigrants and therefore increasing the number of interpersonal relationships between them and people of different cultural and linguistic origins [20]. Currently, the struggle to find a better future has increased the number of young immigrants in western cities, nurturing the social and educational institutions of adolescents of diverse cultures, ethnicities, and religions [ 21 , 22 ]. For example, in Spain, 10% of the total student population are immigrants, which means about 400,000 young people in school (Instituto Nacional de Estad í stica, 2017) who need the help of social workers for the social inclusion of these and their families [ 23 ]. The social integration of these young people is one of the greatest current challenges, although the strategies that have been put in place for this purpose still do not achieve the desired results, especially in relation to the development of social skills in educational institutions [ 2 , 24 , 25 ], which is the first context in which they need to socialize. The problem is that obsolete instruments of self-report of social skills published in the 1970s are still used [ 2 , 26 , 27 ], added to the difficulty of finding culturally sensitive instruments [ 28 ] for young immigrants. What makes it difficult for social workers is their subsequent intervention, since the diagnosis of the social skills needs of this sample is not carried out effectively [29]. In addition, it is worth mentioning the lack of instruments for the diagnosis of social skills that were built taking into account the linguistic difficulties that may arise in culturally diverse participants [ 30 – 32 ]. Fact that bases the objective of this research, that adapt and validate a new instrument whose items were simple enough to be understood by those subjects who dominated the Spanish language in an incipient manner and also allowed the quick translation of these, for those young people who totally ignore the language. For this reason, the use of consolidated questionnaires was discarded in this investigation, such as the Social Skills Questionnaire (CHASO-III) [ 2 ], the Social Skills Questionnaire for College Students (SSQ-U) [33] or the Social Skills Inventory [34]. On the other hand, following theoretical indications [ 35 , 36 ], a short instrument was sought, which could be applied quickly and inexpensively, whose corrections were easy to make and interpret; the reason that supported the discard of instruments with a large number of items such as The Social Skills Improvement System-RS [ 26 ] or The Social Skills Questionnaire for Traumatic Brain Injury (SSQ-TBI) [27]. The use of questionnaires that did not fit the dimensions considered important for the analysis of social skills was also rejected [ 37 – 39 ], such as the Skills Learning Team Questionnaire (CHSEA) [ 40 ] or those whose content and expression did not fit the age and reading comprehension of the selected Sustainability 2020,12, 6897 3 of 20 sample; for example, the Social Competence in Higher Education Questionnaire (CCSES) [ 41 ] or The Social-Emotional Assessment/Evaluation Measure (SEAM) [42]. Choosing for the adaptation and validation on which this research is based, the instrument that, complying with the aforementioned requirements, verifies the best psychometric properties of validity and reliability [ 43 ], in addition to being current for the treatment of social skills, is based on theoretical models of robust behavior [27], and it is based on the pattern of the Social Skills Scale (EHS) [1]. The instrument is composed of six underlying constructs. The first of these, the ability to say no and cut interactions, pretends to know the ability of young people to refuse to perform a task when they think it is not fair for them. To say no, it is a way of expressing social skills and defending a person’s right to choose what is right [39]. The second construct, self-expression in social situations, aims to find out the degree to which young immigrants are capable of carrying out activities of daily life. For this, the trust they have towards themselves is analyzed, since one of the indicators of self-expression in social situations is the confidence in their own possibilities [38]. With respect to the third construct of the instrument, defense of one’s rights as a consumer, it is used to detect the immigrant’s ability to demonstrate his knowledge of his own rights when he goes to a public establishment. In relation to this, it highlights the right to security, the right to be informed, the right to be heard, the right to choose, the right to privacy, and the right to compensation as fundamental to the social development of a subject [37]. With the fourth construct, expressing anger or disagreement, the questionnaire identifies the ability to externalize anger towards other people. This anger is defined as a negative emotional response to the blocking of the objective and the unjust behavior of others towards oneself, and they affirm that this construct characterizes the social skills that are used as a shield against harm caused by other people [44]. The fifth construct is the ability to make requests, through which it is intended to measure the degree to which young immigrants are able to ask for something they consider their own. The ability to petition causes the individual to leave his internal forum and externalize a problem that he does not know or cannot solve by himself [ 45 ]. In this way, the subject must relate to others, leaving shyness aside. The sixth construct is identified with the factor initiating positive interactions with the opposite sex, through which it is intended to know if the participants are able to hold conversations and interact with people of the opposite sex. This ability is related to spontaneously making a compliment or simply being able to talk to someone who is attractive [ 46 ]. It is important to note that interactions with the opposite sex become increasingly common and important in adolescence and that, although they are exciting, these interactions are full of ambiguity due to the relative lack of romantic experience and to the lack of clarity about the norms that regulate them [47]. 2. Materials and Methods 2.1. Instrument Development In a first phase, a review of the relevant literature and the exploration of instruments related to the topic was carried out, such as the Social Skills Learning Team Questionnaire (Cuestionario de habilidades sociales de equipos de aprendizaje) (CHSEA) [ 40 ], Social Skills Questionnaire (Cuestionario de habilidades sociales) (CHASO-III) [ 2 ], the Social Skills Inventory [ 34 ], the Social Skills Questionnaire for College Students (SSQ-U) [ 33 ], the Social Skills Improvement System-RS [ 26 ], the Social Skills Questionnaire for Traumatic Brain Injury (SSQ-TBI) [ 27 ], the Social-Emotional Assessment/Evaluation Measure (SEAM) [ 42 ], the Social competence in Higher Education Questionnaire (Cuestionario de competencias sociales en Educaci ó n Superior) (CCSES) [ 41 ], or EHS [ 1 ]. Subsequently, the research group decided to adapt the last-mentioned scale to the sample of immigrants, considering it more appropriate in terms of the simplicity of the language of the constructs evaluated, in addition to Sustainability 2020,12, 6897 4 of 20 complying with excellent psychometric properties of validity and reliability [ 44 ] and of being novel in the definition and diagnosis of social skills; remaining, an initial questionnaire of 37 items. Subsequently, a first validation of the questionnaire was carried out through the expert judgment technique and with the participation of 13 professionals. Seven of the experts were professionals related to the development and social skills of young people. These worked in non-Governmental Organization, educational institutions and public posts linked to intervention activities to improve emotional and social relationships. The remaining six were researchers from different Spanish universities, whose lines of work were linked to the diagnosis and evaluation of social aspects in immigrants. The initial scale presented to them was composed of 7 elements for the dimension that measures the ability to say no and cut interactions, 9 elements to measure self-expression in social situations, 7 elements to measure the defense that makes the rights themselves as a consumer, 5 elements for the factor that measures the expression of anger or disagreement, 6 elements to measure the ability to make requests to others, and 3 elements for the dimension that measures the ability to initiate positive interactions with people of the opposite sex. The experts established the content validity of this instrument through the content validity index for each element (I-CVI). More specifically, they assessed the relevance of each item to assess the social skills of young immigrants. The questionnaire and the method of escalation were sent through email, which indicated that they value from 1 to 5 (1 =not relevant, 2 =somewhat relevant, 3 =relevant, 4 =quite relevant, and 5 =very relevant) the importance of each item. The elements that scored with I-CVI <0.78 were extracted from the instrument [ 48 ], leaving the questionnaire with 33 elements. In addition, the experts evaluated the content validity index of the scale in general (S-CVI); this was done taking into account the average I-CVI of each item [ 49 ], obtaining a S-index CVI =0.92, which reflected excellent content validity [48]. The apparent validity and readability of the questionnaire were also consulted upon with the experts, asking them to indicate qualitatively and answering open questions, the adequacy of the information of the instrument for immigrant young, as well as the understanding and writing of the items [ 50 ]. Thus, taking into account the experts’ responses, several elements were modified in a nonsignificant way and 4 were substantially modified. Finally, the final questionnaire was obtained, demonstrating its hierarchical structure through the performance of factor analysis. For this, the quantitative data acquired through the application of the instrument to the participants in two periods were analyzed; a first period, through which was carried the Exploratory Factor Analysis (EFA) by means of the SPSS statistical software in its latest version, involved the elements of the instrument being reduced to 29 items organized in six dimensions (the ability to say no and cut interactions formed by 7 items, the self-expression in social situations formed by 8 items, the defense of one’s rights as a consumer formed by 4 items, the expression of anger or disagreement formed by 3 items, the ability to make requests to others formed by 4 items, and the ability to initiate positive interactions with people of the opposite sex consisting of 3 items). In addition, this involved a second period, in which the Confirmatory Factor Analysis (CFA) was carried out through the AMOS statistical program, in where is ratified the hierarchical structure of the previous analysis. The 29 items were divided in the same way into the aforementioned dimensions. 2.2. Scoring of Scales All the categories of the instrument are measured through a rating scale about frequency that ranges from never (1) to always (4). In this way, the ability to say no and cut interactions is measured by seven elements to achieve a possible range of 7 to 28. The self-expression in social situations of participants is measured with eight items to achieve a possible range of 8 to 32. The defense of one’s rights as a consumer is measured by four items to achieve a possible range of 4 to 16. The expression of anger or disagreement is measured with three items to achieve a possible range of 3 to 12. The ability to make requests to others is measured by four items to achieve a range of 4 to 16, and the ability to initiate positive interactions with people of the opposite sex is measured by three elements to achieve a Sustainability 2020,12, 6897 5 of 20 range of 3 to 12. To obtain the scores that differentiate the presence or not of the ability to average the scores in each of the dimensions will be followed [ 51 ]. In this way, the ability to “say no and cut interactions” will be obtained when the score is less than 17.5 points, the ability of “self-expression in social situations” with a score less than 20 points, the ability of “defense of one’s rights as a consumer” with a score of less than 10 points, the ability to “express anger or disagreement” with a score of less than 7.5 points, the ability to “make requests” with a score of less than 10 points and the ability to “initiate positive interactions with the opposite sex” when the score is less than 7.5 points. The instrument aims to measure social skills in young immigrants. For this, it has a series of distinctive characteristics that make it appropriate for the measurement in the context and the selected sample. These characteristics mainly focus on simple language, easy to read and understand in subjects in the process of learning the language, as well as viable and quick to translate in cases where it is necessary [52–54]. In addition, the language of the questionnaire is inclusive and generalizable [ 55 – 57 ], avoiding hurtful, racist, or intolerant words that cause a negative reaction to the answer of the items [ 58 ]. Also, this avoids value judgments or any expression that relates the item to the different ethnicities, cultures, or religions of the selected sample, so that the instrument allows generalized measurement of culturally diverse samples. The items of the instrument represent simple actions of daily life that will allow to diagnose the existence or not of the underlying social ability, considering it essential for the improvement of the subsequent intervention, as the lack of such skills tends to be associated with low acceptance, rejection, low self-esteem, helplessness, maladjustment, delinquency, or addictions in young immigrants [ 59 , 60 ]. This is a fact that would hinder their social integration and their necessary acculturation [61–63]. 2.3. Pilot Test After the Institutional Review Board of the University of Granada approved the study, the instrument was applied in a pilot test to 20 young immigrants from the city of Granada, with similar characteristics to the study target population, to determine readability, the time of completion, and the understanding. The results indicated that adolescent immigrants between 12 and 18 years old could understand and perform the questionnaire successfully. 2.4. Sample and Procedure For both factor analyses, the sample was selected through a nonprobabilistic sampling for convenience, in which the participants were the young immigrants belonging to the social and educational institutions of different Spanish cities who wanted to participate. Table 1shows the number of young people that make up the study sample in each city. In all of them, the confidentiality of the data was assured, and the questionnaire was administered anonymously. Table 1. Number of young immigrants who participated in the study in each city. Province Immigrants in Exploratory Factor Analysis Immigrants in Confirmatory Factor Analysis Granada 77 206 Málaga 50 51 Almería 47 69 Jaén 16 27 Córdoba 18 22 Cádiz 40 62 Sevilla 12 27 Huelva 33 49 Ceuta 18 27 Melilla 19 28 Total 330 568 Sustainability 2020,12, 6897 6 of 20 The questionnaire was completed by a total of 330 immigrants for the EFA. The demographic data that the EFA showed were that 54.8% were men and 45.2% were women, with an average of X=14.82 years (SD =1.7). The countries of origin of the participants included Morocco (33.9%), Bolivia (10%), Ecuador (5.2%), China, Colombia, and Japan (3.9%), Venezuela (3.6%), Argentina (3.3%), Paraguay (3%), Senegal (2.7%), Brazil (2.1%), Uruguay, Nigeria, Ukraine, and Algeria (1.5%), Cote d’Ivoire, Mali, South Korea, Russia, Italy and France (1.2%), Pakistan, Dominican Republic, Cuba, Romania, and England (0.9%), Honduras, Mexico, Peru, Syria and Germany (0.6%), and Nicaragua, Guinea, Kosovo, Greece, Latvia, Sweden, Poland, Bulgaria, Switzerland, Portugal, and Georgia (0.3%). For the CFA, the questionnaire was completed by a total of 568 immigrants; 56% were men and 44% women X =13.66 years (SD =1.4). The countries of origin of the participants included Morocco (43.7%), Ecuador (9.2%), Romania (6.7%), Senegal (3.7%), Peru (3.3%), China and Colombia (3.2%), Bolivia (2.6%), Japan (2.5%), Mexico, Argentina, and Brazil (2.1%), Venezuela (1.9%), Portugal (1.8%), Germany (1.6%), Italy and Cote d’Ivoire (1.4%), Nigeria (1.2%), Chile (1.1%), France (0.9%), Mali (0.7%), Honduras, Cuba, and England (0.5%), Bulgaria, Russia, Algeria, and Syria (0.4%), and the Dominican Republic, Uruguay, Guinea, and Poland (0.2%). 2.5. Reliability Tests The reliability of the final instrument was made using the test–retest reliability and internal consistency method in order to test and retest the reliability of the questionnaire. The instrument was administered twice at two-week intervals to 30 participants. As the theorists [ 64 ] show, acceptable levels were obtained for Cronbach’s alphas. It is considered excellent when Cronbach’s alphas is over 0.70 [65] (Table 2). Table 2. Cronbach’s alphas and correlation coefficient between the subscales. Cronbach’s Alphas Correlation Coefficient between the Subscales Test 0.775 0.105 Re-test 0.826 0.105 2.6. Criterion Validity In order to know if the adapted instrument correlates with the already measured elements of the original instrument, the concurrent and the predictive validity of the same was carried out utilizing a sample of 30 subjects. To carry out the concurrent validity, following theoretical indications [ 66 , 67 ], we utilized the original questionnaire [ 1 ] and the final adapted questionnaire, correlating the variables of both instruments through Spearman’s correlation coefficient [ 68 ], due to the non-normal distribution of the data, where it was obtained that all the evaluated elements correlate positively with Spearman’s Rho over 0.87 (Table 3). This justifies an excellent concurrent validity of the Social Skills Scale for Young Immigrant. Table 3. Spearman’s rho test for concurrent validity. Social Skills Scale for Young Immigrant 1. Say No 2. Self-Exp. 3. Rights Def. 4. Angry Exp. 5. Make Requ. 6. Int. Opp. Sex 1. Say no 0.95 2. Self-Exp 0.91 3. Rights D. 0.87 4. AngryExp. 0.90 5. Make Req. 0.98 6. Int. Opp. S. 0.99 Sustainability 2020,12, 6897 7 of 20 The predictive validity of the instrument was also carried out. For this, the original instrument [ 1 ] and the final instrument, with a three-month difference period, were applied to a sample of 30 people. In this case, Spearman’s correlation coefficients were greater than 0.80 (Table 4), which evidences an excellent predictive validity of the SSYI. Table 4. Spearman’s rho test for predictive validity. Social Skills Scale for Young Immigrant 1. Say No 2. Self-Exp. 3. Rights Def. 4. Angry Exp. 5. Make Requ. 6. Int. Opp. S. 1. Say no 0.85 2. Self-Exp 0.80 3. RightsD. 0.80 4. Angry Ex. 0.81 5. Make Re. 0.90 6. Int.Opp.S. 0.93 2.7. Nomological Validity In order to show the nomological validity of the SSYI, the means of the scores, and the respective standard deviation (SD), were compared between the group of immigrant women and men, using the variation coefficient [ 69 ]. According to theoretical approaches, women were expected to present greater social skills [ 70 – 72 ]. Results were obtained that ratify the underlying theory, which was evidenced by a good nomological validity for the instrument (Table 5). Table 5. Coefficient of variation for nomological validity. Dimension Men Women 1 0.3393 0.3356 2 0.2961 0.2954 3 0.3686 0.3494 4 0.3673 0.3355 5 0.2732 0.2774 6 0.3932 0.3498 2.8. Construct Validity To establish the construct validity of the questionnaire, two different factor analysis approaches were used. The first was the realization of the EFA, and the second, the CFA. The latter was carried out using the structural equation model (SEM). The eigenvalues (quantity of variance in the original set of variables explained by each main component) greater than 1 and the factor load greater than 0.30 were established a priori [ 73 ] as criteria acceptable for this study. Statistical software SPSS in its latest version and Amos 24 were used to analyze the data. 3. Results 3.1. Descriptive Statistics Descriptive statistics and study of the internal consistency of the Social Skills Scale for Young Immigrants. Table 6shows the descriptive statistics of the factors that make up the SSYI: mean, asymmetry, kurtosis, range of scores, and Cronbach’s alphas coefficient. The dimensions presented values of asymmetry and kurtosis within the range of normality [74]. The internal consistency indexes ranged between 0.81 and 0.89. This indicates that the instrument has a high level of reliability. Sustainability 2020,12, 6897 8 of 20 Table 6. Descriptive statistics of the dimensions of the Social Skills Scale for Young Immigrants. Dimensions Nº Items αMean Asymmetry Kurtosis Range To say no 7 0.89 6.66 0.61 −0.24 12 Self-exp. 8 0.81 12.69 0.85 0.37 21 Rights Def. 4 0.81 14.17 1.09 1.57 24 Angry Exp. 3 0.81 8.15 0.74 −0.01 12 Make requests 4 0.85 11.00 −0.25 0.60 12 Int. Opp. S. 3 0.82 6.73 0.36 −0.68 9 Scale (SSYI) 29 0.82 Notes: α: Internal consistency test, Cronbach’s alphas. 3.2. Reliability and Validity After conducting the expert judgment, the instrument was validated using the EFA, a statistical analysis method used to design a model by identifying the correlation between a latent variable and an observed or measured variable [ 42 , 75 ]. This analysis was obtained with the data of 330 immigrants, who answered the 33 items of the questionnaire. This fact ratified the participant-items ratio (10:1) recommended in the literature [76]. Before this analysis, the varimax rotation method was applied to verify that the factors were able to measure if the subjects had social skills [ 77 , 78 ]. The value of Kaiser–Meyer–Olkin (KMO) was 0.81 and the Bartlett Chi-square approximation was 2344.36 with p=0.000. A KMO value close to 1 indicated that the correlation pattern was compact enough to produce different and reliable factors [ 79 ]. The results in the Kaiser–Meyer–Olkin and Bartlett sphericity tests indicated that the EFA method was appropriate for use in this study [80] (Table 7). The statistical program SPSS was used to analyze the data. Table 7. Kaiser–Meyer–Olkin and Bartlett’s sphericity tests. Kaiser–Meyer–Olkin Measure of Sampling Adequacy 0.81 Chi-square Approx. 2344.36 Gl 528 Bartlett’s sphericity test 0.000 According to Siembida et al. [ 73 ], after performing the extraction, the communalities must be greater than 0.30 to assume that the measurement has a good validity (Table 8). The analyzed instrument fulfills this criterion in most of the items, except for item number 7 (0.26), number 9 (0.29), number 14 (0.28), and number 16 (0.24), so they were eliminated from the questionnaire, going from having 33 items to the final 29 with which the questionnaire was configured. Further, the EFA study grouped the 33 initial items into six factors or dimensions with rotated factor loads that vary between 0.291 and 0.740 (Table 9). The grouping of the items in the aforementioned dimensions was carried out through the Analysis of Main Components, which is a method of data reduction that allows transforming a set of original variables into a new set with a smaller number of elements [ 81 , 82 ]. To simplify the interpretation of the data obtained in this analysis, in the study, the rotation of the components or factors was carried out through the Varimax orthogonal rotation method, which allows to minimize the number of variables that have high loads in each factor. It is for this reason that Table 6 shows the variables with the highest saturations in each of the six factors obtained. Sustainability 2020,12, 6897 9 of 20 Table 8. Communalities to perform list elimination. Items Extraction 1. I’m afraid they’ll laugh at me when I ask questions. 0.518 2. It’s hard for me to phone other friends. 0.383 3. I keep my opinions to myself. 0.424 4. I avoid meetings with many people for fear of doing or saying something foolish. 0.528 5. It is hard for me to express my feelings to others. 0.417 6. If I had to look for a job, I would prefer to write letters/emails rather than having to go through personal interviews. 0.361 7. I feel violent when someone of the opposite sex tells me that he likes something about my physical appearance. 0.267 8. I find it difficult to express my opinion in groups (in classroom, meetings, etc.) 0.567 9. If I buy something and I see that it is not right, I go to the store to return it. 0.296 10. When a store first serves someone who came in after me, I do not say anything. 0.581 11. If I’m in the cinema and someone bothers me with their conversation, I can hardly tell them to shut up. 0.377 12. I am unable to ask for the price of something I am buying to be discounted. 0.393 13. When someone “jumps” the queue, I do not say anything. 0.472 14. When a friend expresses an opinion with which I do not agree, I do not say anything, even if I think otherwise. 0.284 15. When a close relative bothers me, I prefer to hide my feelings rather than expressing anger. 0.405 16. I find it hard to express aggression or anger toward the opposite sex, even if I have justified reasons. 0.241 17. I prefer to shut up to avoid problems with other people. 0.612 18. If a seller insists on showing me a product that I do not want, it’s hard for me to say I do not want it. 0.420 19. When I’m in a hurry and a friend calls me on the phone, it’s hard for me to hang up. 0.389 20. When someone borrows my things from me, I lend them, even if I do not want to or I do not like it. I do not know how to say no. 0.383 21. I do not know how to tell a friend that he talks a lot, that he stops talking. 0.459 22. When I decide that I do not want to go out with someone again, it’s hard for me to tell it. 0.419 23. When someone calls me to leave, I do not know how to refuse, even though I do not feel like it. 0.520 24. I find it difficult to ask for something to be returned. 0.480 25. If, in a restaurant, they do not bring me the food as I had requested, I call the waitress and ask the cook to do it again, 0.470 26. If I leave a store and I realize that they have given me the change badly, I return there to ask for the correct change, 0.529 27. If I lend money to a friend and he does not return it, I can remember it, 0.434 28. It’s hard for me to ask favors from my friends, 0.343 29. When I like a boy or a girl I know what to say, 0.523 30. When I have to flatter someone, I do not know what to say, 0.356 31. I prefer to keep quiet so as not to create problems for other people, 0.609 32. If I find a person I like, I approach him to talk, 0.382 33. I am not able to ask someone for an appointment, 0.379 In addition, the principals’ components analysis showed that the six dimensions have 43.09% of the total variance explained. The distribution of the items in six factors coincides with the hierarchical structure of the reference instrument [ 1 ], which bases the dimensions of social skills in important theoretical references [ 83 – 88 ], which specify that when a subject presents social skills, he is able to express his emotions in social situations, defend his own rights, show denial and make requests, as well as initiate interactions with people of another gender. These are aspects that are developed in the six dimensions established in the EFA (the ability to say no and cut interactions, self-expression in social situations, the defense of one’s rights as a consumer, the expression of anger or disagreement, the ability to make requests to others, and the ability to initiate positive interactions with people of the opposite sex). Finally, CFA was carried out, through which it was intended to configure the final instrument (Figure 1). This second-order analysis validated the hierarchical structure of the instrument [ 89 – 91 ] and checked the previously defined relationships in the EFA between the variables. In addition, it is considered effective to determine the reliability [ 92 ] and to measure the invariance of the measurement between groups, thus checking that the instrument is appropriate to examine the equivalence of measurement with respect to two particularly relevant variables in relation to the construct evaluated [93]. The CFA was carried out in the investigation to complement the results obtained with the EFA. It is necessary to perform this second-order analysis to ratify and complement any doubt about the validity of a questionnaire [94], as it complements the factor analysis carried out [95]. To carry out this analysis, the questionnaire was administered again to young immigrants from the cities of Granada, M á laga, Almer í a, Ja é n, C ó rdoba, Sevilla, C á diz, Huelva, Ceuta, and Melilla, in this case to a sample of 568 participants. The analysis was carried out using the AMOS software in version 24. Sustainability 2020,12, 6897 16 of 20 21. Wagner, M.F.; Pereira, A.S.; Oliveira, M.S. Intervention on the dimensions of social anxiety through a social skills training program. Behav. Psychol. 2014,22, 425–442. 22. Wilson, M.; Gochyyev, P.; Scalise, K. Modeling data from collaborative assessments: Learning in digital interactive social networks. J. Educ. Meas. 2017,54, 85–102. [CrossRef] 23. Raineri, M.L.; Calcarreta, V. Social work strategies against crisis in everyday practice: An anti-oppressive case study. Int. Soc. Work 2018,61, 130–142. [CrossRef] 24. Azor í n-Abell á n, C.M. Analysis of instruments on inclusive education and attention to diversity. Rev. Complt. Educ. 2017,28, 1043–1060. 25. Marcu, S. Refugee students in Spain: The role of universities as sustainable actors in institutional integration. Sustainability 2018,10, 2082. [CrossRef] 26. Bunford, N.; Evans, S.W.; Becker, S.P.; Langberg, J.M. Attentiondeficit/hyperactivity disorder and social skills in youth: A moderated mediation model of emotion dysregulation and depression. J. Abnorm. Child Psych. 2015,43, 283–296. [CrossRef] 27. Francis, H.M.; Osborne-Crowley, K.; McDonald, S. Validity and reliability of a questionnaire to assess social skills in traumatic brain injury: A preliminary study. Brain Inj. 2017,31, 336–343. [CrossRef] 28. Mendo-L á zaro, S.; Le ó n, B.; Felipe-Castaño, E.; Polo, M.I. Training in social skills in the university context: Effect on social skills to work in teams and social anxiety. Behav. Psychol. 2016,24, 423–438. 29. Choi, S.; Lee, S.; Kim, J.H.; Na, J. Effects of community integration on quality of life among Asian Americans. Int. Soc. Work 2018,62, 1404–1415. [CrossRef] 30. Danzer, A.M.; Yaman, F. Ethnic concentration and language fluency of immigrants: Evidence from the guest-worker placement in Germany. J. Econ. Behav. Organ. 2016,131, 151–165. [CrossRef] 31. Kizilcec, R.F.; P é rez-Sanagust í n, M.; Maldonado, J.J. Self-regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses. Comput. Educ. 2017,104, 18–33. [CrossRef] 32. Lalibert é , J.W. Language skill acquisition in immigrant social networks: Evidence from Australia. Labour. Econ. 2019,57, 35–45. [CrossRef] 33. Mor á n, V.E.; Olaz, F.O.; Del Prette, Z.A.P. Social Skills Questionnaire for Argentinean college students (SSQ-U). Development and validation. Span. J. Psychol. 2015,18, 1–11. [CrossRef] [PubMed] 34. Oldmeadow, J.A.; Quinn, S.; Kowert, R. Attachment style, social skills, and facebook use amongst adults. Comput. Hum. Behav. 2013,29, 1142–1149. [CrossRef] 35. Fernholz, I.; Menzel, J.; Jabusch, H.C.; Gembris, H.; Fischer, F.; Kendel, F.; Kreutz, G.; Schmidt, A.; Willich, S.N.; Weikert, C. Musical inactivity—A risk factor? A short Questionnaire to Assess Musical Activity (MusA). Gesundheitswesen 2019,8, 907–910. 36. Mart í nez-Gin é s, M.L.; Garc í a-Dom í nguez, J.M.; Sarmiento, M.; Maurino, J. Spanish cultural adaptation of the short version of the Multiple Sclerosis Work Difficulties Questionnaire (MSWDQ-23). Neurolog í a 2019 ,34, 611–614. [CrossRef] 37. Alsmadi, S.; Alnawas, I. Consumer rights paradigm: Development of the construct in the Jordanian context. J. Bus. Ethics 2018,159, 777–794. [CrossRef] 38. Ciftci, S. Self-expression values, loyalty generation, and support for authoritarianism: Evidence from the Arab world. Democratization 2018,25, 1132–1152. [CrossRef] 39. Kettrey, H.H. “Bad girls” say no and “good girls” say yes: Sexual subjectivity and participation in undesired sex during heterosexual college hookups. Sex. Cult. 2018,22, 685–705. [CrossRef] 40. Le ó n, B.; Felipe, E.; Mendo, S.; Iglesias, D. Social skills in cooperative learning teams in the university context. Behav. Psychol. 2015,23, 191–214. 41. Legan é s-Lavall, E.N.; P é rez-Aldeguer, S. Social competence in Higher Education Questionnaire (CCSES): Revision and psychometric analysis. Front. Psychol. 2016,7, 1–6. [CrossRef] [PubMed] 42. Hintermair, M.; Sarimski, K.; Lang, M. Preliminary evidence assessing social–emotional competences in deaf and hard of hearing infants and toddlers using a new parent questionnaire. J. Deaf Stud. Deaf Educ. 2016 ,22, 143–154. [CrossRef] [PubMed] 43. Al Maqbali, M.; Dunwoody, L.; Rankin, J.; Hacker, E.; Hughes, C.; Gracey, J. Psychometric properties and cultural adaptation of sleep disturbance measures in Arabic-speaking populations: A systematic review. J. Sleep Res. 2020,29, 1–12. [CrossRef] 44. Klimeckil, O.M.; Sander, D.; Vuilleumier, P. Distinct brain areas involved in anger versus punishment during social interactions. Sci. Rep. UK 2018,8, 1–12. Sustainability 2020,12, 6897 17 of 20 45. S á nchez-Teruel, D.; Robles-Bello, M.A.; Gonz á lez-Cabrera, M. Social skills in university students studying health sciences (Spain). Educ. Méd. 2015,16, 126–130. [CrossRef] 46. Shaw, L.A.; Wainryb, C.; Smetana, J. Early and middle adolescents’ reasoning about moral and personal concerns in opposite-sex interactions. Soc. Dev. 2014,23, 784–802. [CrossRef] 47. Hensel, D.J.; Tanner, A.E. Daily emotional and behavioral interactions in young men’s and young women’s single and multiple partner relationships. J. Adolesc. Health 2015,56, 5–6. [CrossRef] 48. Polit, D.F.; Beck, C.T.; Owen, S.V. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res. Nurs. Health 2007,30, 459–467. [CrossRef] 49. Berry, S.L.; Crowe, T.P.; Deane, F.P. Preliminary development and content validity of a measure of Australian Aboriginal cultural engagement. Ethn. Health 2012,17, 325–336. [CrossRef] 50. M é rida, R.; Serrano, A.; Tabernero, C. Design and validation of a questionnaire for children’s self-esteem assessment. R.I.E. 2015,33, 149–162. 51. Kaliisa, R.; Palmer, E.J.; Miller, J. Mobile learning in higher education: A comparative analysis of developed and developing country contexts: Mobile learning in higher education. Br. J. Educ. Technol. 2017 ,50, 546–561. [CrossRef] 52. Grigoryev, D.; Van de Vijver, F. Acculturation expectation profiles of Russian majority group members and their intergroup attitudes. Int. J. Intercult. Relat. 2018,64, 90–99. [CrossRef] 53. Ren, H.; Sun, S.; Cheah, C.S.L.; Sang, B.; Liu, J. Confirmatory factor analyses of the Parent Attributions Questionnaire among Asian immigrant mothers. Int. J. Behav. Dev. 2019,43, 185–193. [CrossRef] 54. Schachner, M.K.; He, J.; Heizmann, B.; Van de Vijver, F. Acculturation and school adjustment of immigrant youth in six European countries: Findings from the Programme for International Student Assessment (PISA). Front. Psychol. 2017,8, 1–11. [CrossRef] 55. Fragapane, S.; Minaldi, G. Migration policies and digital technologies in Europe: A comparison between Italy and Spain. J. Eur. Integr. 2018,40, 905–921. [CrossRef] 56. Lee, B. The strengths and difficulties questionnaire: The factor structure in a sample of Korean immigrant parents in New Zealand. Psychiatry Clin. Psychopharmacol. 2018,28, 429–435. [CrossRef] 57. Schachner, M.K.; Schwarzenthal, M.; Van de Vijver, F.; Fons, J.R. How all students can be long and achieve: Effects of the cultural diversity climate amongst students of immigrant and nonimmigrant background in Germany. J. Educ. Psychol. 2019,111, 703–716. [CrossRef] 58. Mundra, K. Immigrant and minority homeownership experience: Evidence from the 2009 American housing survey. East. Econ. J. 2019,46, 53–81. [CrossRef] 59. Liu, E.; Blunden, H. Cultural diversity and sensitivity in public estate renewals: Evidence from an Australian longitudinal study. Hous. Stud. 2019,35, 1–22. [CrossRef] 60. Romero-Oliva, C.; Nunes, C.; Montilla Coronado, C.; Lemos, I.; G ó mez, Á .H.; Ayala-Nunes, L. Quality of life and social skills: A comparative study between native and immigrant adolescents in Spain and Portugal. Univ. Psychol. 2017,16, 1–11. 61. Curran, T.; Meter, D.; Janovec, A.; Brown, E.; Caban, S. Maternal adult attachment styles and mother–child transmissions of social skills and self-esteem. J. Fam. Stud. 2019, 1–15. [CrossRef] 62. Mihalec-Adkins, B.P.; Cooley, M.E. Examining individual-level academic risk and protective factors for foster youth: School engagement, behaviors, self-esteem, and social skills. Child. Fam. Soc. Work 2019 ,25, 256–266. [CrossRef] 63. Urz ú a, A.; Ferrer, R.; Godoy, N.; Leppes, F.; Trujillo, C.; Osorio, C.; Caqueo-Ur í zar, A. The mediating effect of self-esteem on the relationship between perceived discrimination and psychological well-being in immigrants. PLoS ONE 2017,13, e0198413. 64. Asare, M.; Sarma, M. Establishing validity and reliability of a health belief model and acculturation scale for measuring safe-sex and sexual communication behaviors among African immigrants for protecting against HIV/AIDS. J. Immigr. Refug. Stud. 2015,12, 191–209. [CrossRef] 65. Taber, K.S. The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Res. Sci. Educ. 2018,48, 1273–1296. [CrossRef] 66. Eddy, C.L.; Herman, K.C.; Reinke, W.M. Single-item teacher stress and coping measures: Concurrent and predictive validity and sensitivity to change. J. Sch. Psychol. 2019,76, 17–32. [CrossRef] 67. Fosnacht, K.; Copridge, K.; Sarraf, S.A. How valid is grit in the postsecondary context? A construct and concurrent validity analysis. Res. High. Educ. 2019,60, 803–822. [CrossRef] Sustainability 2020,12, 6897 18 of 20 68. Xu, W.; Chen, C.; Dai, J.; Zhou, Y.; Zhang, Y. Detection of known signals in additive impulsive noise based on Spearman’s rho and Kendall’s tau. Signal Process. 2019,161, 165–179. [CrossRef] 69. Davis, M.A.; Cernas, D.A. Revisiting the structural and nomological validity of the Zimbardo time perspective inventory. Pers. Individ. Differ. 2017,104, 98–103. [CrossRef] 70. Arace, A.; Scarzello, D.; Zonca, P.; Agostini, P. Early child care experiences and individual differences: The role of gender and temperament in social skills and problem behaviors in Italian toddlers. Early Child Dev. Care 2019, 1–14. [CrossRef] 71. Jenkins, L.N.; Nickerson, A.B. Bystander Intervention in Bullying: Role of Social Skills and Gender. J. Early Adolesc. 2017,39, 141–166. [CrossRef] 72. Tan, K.; Shin Oe, J.; Hoang Lee, M.D. How does gender relate to social skills? Exploring differences in social skills mindsets, academics, and behaviors among high-school freshmen students. Psychol. Sch. 2018 ,55, 429–442. [CrossRef] 73. Siembida, E.J.; Moss, K.; Kadan-Lottick, N.; Bellizzi, K.M. The patient-provider relationship in adolescent oncology: An exploratory factor analysis of a thirteen-item self-report measure. J. Adolesc. Health 2018 ,63, 509–512. [CrossRef] [PubMed] 74. L ó pez-Mora, C.; Gonz á lez, J.; Garc é s, E.J.; Portoles, A. Reduced version of the CMA questionnaire for adolescent goals (CMA-R). R.I.E. 2017,35, 445–464. 75. Wiktorowicz, J. Exploratory factor analysis in the measurement of the competencies of older people. J. Econ. Lit. 2016,54, 48–60. 76. Williams-Washington, K.N.; Mills, C. African American historical trauma: Creating an inclusive measure. J. Multicult. Couns. Dev. 2018,46, 246–263. [CrossRef] 77. Flick, U.; Hans, B.; Hirseland, A.; Rasche, S.; Röhnsch, G. Migration, unemployment, and lifeworld: Challenges for a new critical qualitative inquiry in migration. Qual. Inq. 2017,23, 77–88. [CrossRef] 78. Flick, U.; Hirseland, A.; Hans, B. Walking and talking integration: Triangulation of data from interviews and go-alongs for exploring immigrant welfare recipients’ sense(s) of belonging. Qual. Inq. 2019 ,25, 799–810. [CrossRef] 79. Surastina, S.; Dedi, F.S.O. Examining academic writing motivation of prospective Indonesian language teachers using exploratory factor analysis. Int. J. Instr. 2018,11, 15–24. [CrossRef] 80. Auerswald, M.; Moshagen, M. How to determine the number of factors to retain in exploratory factor analysis: A comparison of extraction methods under realistic conditions. Psychol. Methods 2019 ,24, 468–491. [CrossRef] 81. Bacci, L.A.; Mello, L.G.; Incerti, T.; de Paiva, A.P.; Balestrassi, P.P. Optimization of combined time series methods to forecast the demand for coffee in Brazil: A new approach using Normal Boundary Intersection coupled with mixture designs of experiments and rotated factor scores. Int. J. Prod. Econ. 2019 ,212, 186–211. [CrossRef] 82. Deliu, G.; Miron, C.; Opariuc-Dan, C. Item dimensionality exploration by means of construct map and categorical principal components analysis. J. Balt. Sci. Educ. 2019,18, 209–226. [CrossRef] 83. Baton, E.; Crosland, K.; Haynes, R. An evaluation of a social skills application for children who are homeless. Res. Soc. Work Pract. 2019,29, 323–332. [CrossRef] 84. Buchanan, Z.E.; Abu-Rayya, H.M.; Kashima, E.; Paxton, S.J. The interconnection between acculturation and subjective and social wellbeing among refugee youth in Australia. J. Refug. Stud. 2016 ,30, 511–529. [CrossRef] 85. Espinosa, P.; Clemente, M.; Uña, O. Motivational values, parental influences and the experience of discrimination among romanian and moroccan young immigrants in Spain. Span. J. Psychol. 2016 , 19, 1–11. [CrossRef] 86. Grabowska, I. The transition from education to employment abroad: The experiences of young people from Poland. Eur. Asia Stud. 2016,68, 1421–1440. [CrossRef] 87. In, H.; Kim, H.; Carney, J.V. The relation of social skills and school climate of diversity to children’s life satisfaction: The mediating role of school connectedness. Psychol. Schools 2019, 1–14. [CrossRef] 88. Menesini, E.; Salmivalli, C. Bullying in schools: The state of knowledge and effective interventions. Psychol. Health Med. 2017,22, 240–253. [CrossRef] 89. Caringi, J.; Hardiman, E.; Weldon, P.; Fletcher, S.; Devlin, M.; Stanick, C. Secondary traumatic stress and licensed clinical social workers. Trauma 2017,23, 186–195. [CrossRef] Sustainability 2020,12, 6897 19 of 20 90. Steenbergen-Hu, S.; Makel, M.C.; Olszewski-Kubilius, P. What one hundred years of research says about the effects of ability grouping and acceleration on k–12 students’ academic achievement: Findings of two second-order meta-analyses. Rev. Educ. Res. 2016,86, 849–899. [CrossRef] 91. Young, J. Technology-enhanced mathematics instruction: A second-order meta-analysis of 30 years of research. Educ. Res. Rev. 2017,22, 19–33. [CrossRef] 92. Tartakovsky, E. Personal value preferences and burnout of social workers. J. Soc. Work 2016 ,16, 657–673. [CrossRef] 93. Wilson, F. Identifying, preventing, and addressing job burnout and vicarious burnout for social work professionals. J. Evid. Inf. Soc. Work 2016,13, 479–483. [CrossRef] [PubMed] 94. Ammann, J.; Hartmann, C.; Siegrist, M. Development and validation of the Food Disgust Picture Scale. Appetite 2018,125, 367–379. [CrossRef] [PubMed] 95. Abrahim, S.; Mir, B.A.; Suhara, H.; Mohamed, F.A.; Sato, M. Structural equation modeling and confirmatory factor analysis of social mediause and education. Int. J. Educ. Technol. High. Educ. 2019 ,16, 2–25. [CrossRef] 96. Wong, P.; Wong, D.; Zhuang, Y. Psychometric properties of the AIR Self-Determination Scale: The Chinese version (AIR SDS-C) for Chinese people with intellectual disabilities. J. Intell. Disabil. Res. 2017 ,61, 233–244. [CrossRef] 97. Costa, J.; Maroco, J.; Pinto-Gouveia, J.; Ferreira, C.; Castilho, P. Validation of the psychometric properties of the Self-Compassion Scale. Testing the factorial validity and factorial invariance of the measure among borderline personality disorder, anxiety disorder, eating disorder and general populations. Clin. Psychol. Psychother. 2016,23, 460–468. [CrossRef] 98. Rodríguez, J.M.; Fernández-Díaz, M.J.; León, V. Validation of a questionnaire to evaluate the impact of ISO 9001 Standards in schools with a Confirmatory Factor Analysis. Stud. Educ. Eval. 2019 ,62, 37–48. [CrossRef] 99. Morin, A.J.S.; Arens, A.K.; Tran, A.; Caci, H. Exploring sources of construct-relevant multidimensionality in psychiatric measurement: A tutorial and illustration using the Composite scale of morningness. Int. J. Methods Psychiatry Res. 2016,25, 277–288. [CrossRef] 100. S á nchez-Oliva, D.; Morin, A.J.S.; Teixeira, P.J.; Carraça, E.V.; Palmeira, A.L.; Silva, M.N. A bifactor exploratory structural equation modeling representation of the structure of the basic psychological needs at work scale. J. Vocat. Behav. 2016,98, 173–187. [CrossRef] 101. Murphy, K.L.; Liu, M.; Herzog, T.A. Confirmatory factor analysis and structural equation modeling of socio-cultural constructs among chamorro and non-chamorro micronesian betel nut chewers. Ethnic Health 2019,24, 724–735. [CrossRef] [PubMed] 102. Carvalho, A.V.; Moura, A.A.; Braga, J.K.; Del-Ben, C.M.; Pinheiro, F.; Barbieri, M.A.; Bettiol, H. Perceived stress scale: Confirmatory factor analysis of the PSS14 and PSS10 versions in two samples of pregnant women from the BRISA cohort. Cad. Saúde Pública 2017,33, 13–25. 103. Miyejav, I. A confirmatory factor analysis of Mathematics Teachers’ Professional Competences (MTPC) in a Mongolian context. EURASIA Journal of Mathematics. Sci. Technol. Educ. 2018,14, 699–708. 104. Lecerf, T.; Canivez, G.L. Complementary exploratory and confirmatory factor analyses of the French WISC-V: Analyses based on the standardization sample. Psychol. Assess 2018,30, 793–808. [CrossRef] 105. Nagy, G.; Brunner, M.; Lüdtke, O.; Greiff, S. Extension Procedures for Confirmatory Factor Analysis. J. Exp. Educ. 2017,85, 574–596. [CrossRef] 106. Jonkman, A.; Janssen-Jansen, L. Identifying distributive injustice through housing (mis)match analysis: The case of social housing in Amsterdam. Hous. Theory Soc. 2018,35, 353–377. [CrossRef] 107. Dinour, L.M. Speaking out on “breastfeeding” terminology: Recommendations for gender-inclusive language in research and reporting. Breastfeed. Med. 2019,14, 523–532. [CrossRef] 108. Pirchio, S.; Passiatore, Y.; Carrus, G.; Taeschner, T. Children’s interethnic relationships in multiethnic primary school: Results of an inclusive language learning intervention on children with native and immigrant background in Italy. Eur. J. Psychol. Educ. 2019,34, 225–238. [CrossRef] 109. Sreekumar, H.; Varman, R. Vagabonds at the margins: Acculturation, subalterns, and competing worth. J. Macromark. 2018,39, 37–52. [CrossRef] 110. Bördlein, C. Student-directed behavioral community interventions in social work education. Res. Soc. Work Pract. 2018,28, 731–740. [CrossRef] 111. Hafford-Letchfield, T.; Thomas, B.; McDonald, L. Social work students as community partners in a family intervention programme. J. Soc. Work 2018,18, 598–617. [CrossRef] Sustainability 2020,12, 6897 20 of 20 112. Masilo, D.T. Social work intervention to address the phenomenon of bullying amongst learners in the school setting: Aliterature review. S. Afr. J. Educ. 2018,38, 1–9. [CrossRef] 113. Munoz, R.T.; Miller, C.R.; Fritz, T.A.; Miller, P.N.; Khojasteh, J. A screening, brief intervention, and referral to treatment collaborative: Impact for social work students. J. Soc. Work Educ. 2019,55, 363–375. [CrossRef] 114. Rodr í guez, M.D.; Ferreira, J. The contribution of the intervention in social networks and community social work at the local level to social and human development. Eur. J. Soc. Work 2018,21, 1–13. [CrossRef] © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).