¿Qué papel juegan los bibliotecarios en las altmetrics?
Abstract
Se busca identificar los pasos, a modo de hoja de ruta, que deben dar los bibliotecarios en la difusión, formación y asesoramiento de las métricas complementarias o altmetrics en el marco de los servicios que ofrecen a sus investigadores. Así mismo se enumeran una serie de razones por las que los bibliotecarios deben tener un papel activo en relación a estas métricas sin olvidar sus limitaciones. Se ha realizado una revisión de la bibliografía y dirigido una encuesta online a bibliotecarios de universidades españolas para conocer su grado de implicación y actividad en este tema, contribuyendo a proporcionar la visión que tienen de las altmetrics ya que representan un elemento estratégico en su difusión y formación.
Full text
Recibido: 11-03-2015; 1ª versión: 06-05-2015; aceptado: 16-06-2015. GONZÁLEZ FERNÁNDEZ-VILLAVICENCIO, N.; DOMÍNGUEZ AROCA, M. I.; CALDERÓN REHECHO, A. y GARCÍA HERNÁNDEZ, P. What role do librarians play in altmetrics? Anales de Documentación, 2015, vol. 18, nº 2. Available in: Doi: http://dx.doi.org/10.6018/analesdoc.18.2.222641. WHAT ROLE DO LIBRARIANS PLAY IN ALTMETRICS? Nieves González-Fernández-Villavicencio ∗ Library of the University of Seville Maria-Isabel Dominguez-Aroca ∗∗ Library of the University of Alcalá de Henares (Madrid) Antonio Calderón-Rehecho ∗∗∗ Library of the University Complutense of Madrid Pablo García- Hernández ∗∗∗∗ Library of the University of Salamanca Abstract: Our aim is to identify the steps that librarians can take concerning altmetrics within the framework of the research support services offered by librarians. The current bibliography on altmetrics has been reviewed, especially that which refers to librarians. A survey has also been carried out of librarians of Spanish universities to find out their degree of involvement in the matter and the setting up of relevant initiatives. Keywords: Altmetrics, librarians, academic library, researchers, scientific production metrics. 1. INTRODUCTION The social web has become a means which enables a better knowledge of the impact of scientific research beyond the information provided by indices of citations (Borrego, 2014). There is evidence that researchers are using the social media to discover papers, contact and communicate with other colleagues and disseminate their work and recommendations. This is shown by the results of a study published in Nature1, although it is true that they do not use these media on a massive scale (You, 2014). In the Horizon Report 2014, devoted to university libraries, altmetrics are spoken about as an open bibliometric technology which is based on the social web for the analysis of scientific publications and whose use by libraries will be applied in two or three years2. Although much remains unknown about how to interpret the data, what is being measured and what it represents, a large number of university libraries are showing an interest in this innovative approach to the quantifying of the scientific impact of their institutions. They understand them as being more complementary than alternative metrics3. Our question in this work is: what is the role that librarians must play in the scenario of altmetrics as complementary metrics of the impact of scientific publications? 2. METHODOLOGY AND OBJECTIVES The question we pose is: what is the role that librarians should play on the stage of the altmetrics as complementary metrics impact of scientific publication? Our goal is to define the role of the library and the librarian as bridges between altmetrics and researchers and to list the actions that should be carried out as a road map. We present a literature review providing the theoretical framework, the state of the art and the identification and description of the main agents involved. This study, together with the professional experience of the authors, led us to ask the reasons why librarians should incorporate altmetrics in their daily activity and the steps, showing good practices carried out by several libraries. ∗ [email protected] ∗∗ misabel.dom[email protected] ∗∗∗ [email protected] ∗∗∗∗ [email protected]
2 NIEVES GONZÁLEZ, MARÍA ISABEL DOMÍNGUEZ, ANTONIO CALDERÓN Y PABLO GARCÍA Anales de Documentación, 2015, vol. 18, nº 2 In order to provide data we have carried out an online survey of libraries at Spanish universities. The limited number of responses cannot be representative of the entire population but can offer a panoramic view of the situation in the Spanish university libraries. This can be considered a first approach to the practices of altmetrics at Spanish libraries. To carry out our survey, several questions were selected in order to give an overview from the point of view of librarians, regarding their level of knowledge and training in this area and that of its researchers, the degree of publicity of their products for libraries and researchers on their web sites, the level of responsibility of librarians in the dissemination and training of altmetrics and the tasks that are being carried out. Finally the conclusions of our work are presented. 3. RESULTS: STATE OF THE ART AND ACTIONS TO BE TAKEN The results include reference to altmetrics, identifying the agents involved, initiatives at reference libraries and the opinion of respondents.We offer ten reasons why librarians should take part in the dissemination and training of altmetrics and ten steps to be taken. 3.1 Facts about altmetrics from the literature Until now, traditional metrics have served the scientific community to measure the impact of research, but in recent years they have shown their lack of adaptation to the new academic ecosystem. They are, for example, difficult to apply to common research products such as technical reports, work documents, datasets, software, conference communications and multimedia products (Konkiel, 2013). A wish to find alternative metrics is a symptom that something is not going well in the evaluation of research4. This leads us to ask the following questions. Are citations the sole elements that should be measured? Do real readings which consolidate later research not matter? How do we measure these readings? By downloads, accesses, recommendations? What happens with those that are not reflected in the scientific production but which triumph in training areas, even in those which train new researchers? What happens with those that are fermenting and which it is still not possible to publish for one reason or another? The concept of altmetrics appears in this context. It is considered as “the study and use of scholarly impact measures based on activity in online tools and environments” (Priem, Groth & Taraborelli, 2012), or as it is defined by Galloway, Pease and Rauh (2013) “Altmetrics are the tools that help track a scholar’s influence and relevance beyond traditional citation metrics. Altmetrics provide immediate feedback because they rely on real-time data and interactions and can be quantified quickly”. As we see, alternative metrics appear at a moment when both authors and editors are beginning to understand that traditional metrics are not enough to know the interest that their publications arouse. They set out a change in the conception of scientific impact. This has until now been centered on valuing on the whole the place of publication - the journal - instead of taking into account the influence of the unit - the paper - and the research products stemming from it. These tools are capturing different types of impact. They can give an idea not only of the interest which the paper awakens in the academic world, but also of the social impact which it is having. This provides scientists with new filters to keep abreast of the publications with a greater social impact in their research fields. There has recently been a remarkable growth in the interest in the field of alternative metrics and this has been reflected in the appearance of an increasingly greater number of scientific publications. These aim to put these new tools of measuring academic impact into context. Accepting the invitation proposed in the Altmetrics Manifesto (Priem, et al, 2012) –the text which is the genesis of this new approach – a large number of researchers specialized in the field have dealt with the subject since its publication. Since 2012 various texts have been published once the first phase of skepticism had been overcome. The approaches have been diverse but there are some main streams: 1) Altmetrics as an indicator or sign of the research quality; 2) The way in which researchers use the social web; 3) The ease of measuring the research’s social
WHAT ROLE DO LIBRARIANS PLAY IN ALTMETRICS? 3 Anales de Documentación, 2015, vol. 18, nº 2 impact; 4) The correlation between altmetrics and traditional metrics; 5) The use of alternative metrics in institutional repositories and the relation with Open Access. Scientific journals specialized in bibliometric subjects are the ones which have shown most interest in the matter. Among the publications most cited, the Manifesto (Priem, et al, 2012) stands out above them all. Since its publication it has been referenced in more than a hundred publications. Likewise, in this group there are various publications of the founders of the tool ImpactStory5, which is very prolific in the matter. However, the conversation about altmetrics is currently found in traditional places that do not belong to the academic context (Galligan & Dyas-Correia, 2014) such as the Web. In this way, as well as the most extensive scientific blogs, websites of all kinds and social networks themselves have picked up on the story of the new bibliometric “hot topic” (Yew, Foon & Wee, 2014). The emergence of altmetrics has generated much of a stir in the scientific community and interest in the public at large and its impact is therefore academic but also popular (Konkiel & Scherer, 2013). If we base ourselves on the scientific bibliography which has appeared until now, the author who has the most publications dealing with the characteristics of altmetrics is Mike Thelwall6 (h index Scopus=38), Professor of the University of Wolverhampton, whose research is focused on the study of big data. In the social network Twitter, we find other influencers in altmetrics such as Keita Bando (@KeitaBando) (klout=47), a Japanese researcher who runs the non-profit organization MyOpenArchive; and Todd Carpenter (@TAC_NISO)( klout=58), Executive Director of NISO. On the other hand, since 2011 various academic events have dealt with alternative metrics in their programs. Advances in the matter have been presented in different congress papers. However, workshops have mainly been the format chosen to make the tools of altmetrics calculation known. The ones that stand out are those held in the framework of the ACM Web Science Conference and those organized by the Alfred P. Sloan Foundation and PLOS. It was not until 2014 that a meeting completely devoted to the new measures of the evaluation of academic impact was held. This was the 1st Altmetrics Conference (London)7 which included the participation of Altmetric.com and publishing houses such as Springer, Elsevier and Thomson Reuters. 3.2 Who are the agents involved in altmetrics? The actors affected in this context and which have a role in these new metrics are especially: 1) suppliers, 2) editors, firms and organizations which measure the impact of research with alternative metrics; 3) scientific journals; 4) repositories; 5) researchers and 6) librarians. 1) The suppliers Regarding suppliers of altmetrics services, there are three main tools which compile these data from different sources and which can be disseminated through public APIs that are at the disposal of the other agents involved. For example, PLUM Analytics, a payment service currently owned by EBSCO, supplies altmetrics data from a large number of sources and is commercialized for universities and research institutions (González-Fernández- Villavicencio, 2014). Both Altmetric.com8 and PlumX manage to connect the profiles of researchers with their ORCID Identifiers (EBSCOhost, 2014), although in the latter case this is only possible when the institution becomes a client of PlumX. 2) Editors and scientific journals Among the editors which supply altmetrics data we note the Public Library of Science (PLOS). This was the first to supply this type of data in their publications through their article-level-metrics (ALMs). They have been followed by other major publishing houses such as the Nature Editorial Group, Springer, Elsevier, and, more recently, Wiley. Elsevier has launched “The Metrics Development Program”9 whose point 2 incorporates “Altmetrics”. Elsevier expands metrics perspectives with the launching of new altmetrics pilots10. HighWire, offers an optional Article Level Metric (ALM) for the editors which use their platform and more than 15 subscribing editors take part in KUDOS11. This is a new free service which started up at the end of April 2014 to help researchers and their institutions to maximize the visibility and impact of their published scientific papers, including indicators of downloads, citations and alternative metrics.
4 NIEVES GONZÁLEZ, MARÍA ISABEL DOMÍNGUEZ, ANTONIO CALDERÓN Y PABLO GARCÍA Anales de Documentación, 2015, vol. 18, nº 2 Elsevier also participates in the project NISO Altmetrics12 –sponsored by the Alfred P. Sloan Foundation- to explain, identify and advance in “standards” and “recommended practices13” and improve the academic community’s methods of evaluation. As has been set out, firms and organizations are very interested in Altmetrics, but much remains to be done regarding normalization, transparency, time coverage, etc. (Zahedi & Costa, 2014). Scientific journals are incorporating altmetrics scores individually or benefitting from the platforms of databases which they are part of. Some outstanding examples that we find are, for instance, a paper published in the New England Journal of Medicine November 21st. 2013 which obtained an altmetrics qualification of 1837 and another article that was published November 8th. in PLOS ONE, and received 960.14 In November 2013, journals of the importance of The Lancet, Neuron, American Journal of Preventive Medicine, etc., of Elsevier, were already pilots in a 6-month initiative with the firm Altmetric.com, to include altmetrics data at a paper level in 26 journals of ScienceDirect15. The firm Altmetric.com annually provides the 100 main yearly papers.16 3) The repositories With respect to repositories, the close relationship between altmetrics and the open access to science movement is to be highlighted. In fact, the arrival of altmetrics is an opportunity for authors, editors and repository administrators to be able to obtain new data others than the use and downloads statistics which were until now retrieved. To do so, repositories worldwide are incorporating altmetrics to follow up the use and exchange of scientific production in the social web. For Konkiel & Scherer (2013): “University administrators are increasingly trying to find new ways to measure the impact of the scholarly output of their faculty, students and researchers through quantitative means. By reporting altmetrics (alternative metrics based on online activity) for their content, institutional repositories can add value to existing metrics – and prove their relevance and importance in an age of growing cutbacks to library services”. In Spain Digital.CSIC was the first repository which, in 2013, enriched the statistics on use that they obtained with altmetrics (CSIC Abierto, 2013). In January 2014, the Ranking Web of Repositories announced, in its 14th edition dedicated to 2014, that it had included altmetrics indicators from the following sources: Academia.edu, Facebook, LinkedIn, Mendeley, ResearchGate, Slideshare, Twitter, Wikipedia and YouTube.17 4) The scientific community Regarding the world of the scientific community, the social web has given researchers the opportunity to create, note, reuse and represent information in a way that was difficult to imagine some years ago (Procter et al., 2010). Increasingly more researchers and research groups have a greater presence in social networks such as Twitter, Facebook, Google, etc. This presence is essential to achieve reliable statistics altmetrics data. Universities are already realizing the possibilities of altmetrics data. Thus, in Spain there are universities such as Rovira i Virgili which disseminate in their news18 that it is among their research staff that we can find the second scientific paper of greatest global impact in the social networks in 2013, according to the ranking of Altmetric.com. Against this background, NISO, aware of the dilemma and the need to retrieve data in a normalized manner, began a project in 2013 (NISO, 2014) to develop standards and good altmetrics practices. This was because, among other advantages, they could potentially be useful for the evaluation of the professors and in the accreditation process. Undoubtedly, this will be a decisive step and a turning point in the valuing of these alternative metrics, especially if it is adopted institutionally. 5) The librarians The librarians of university and specialized libraries usually manage, organize, train and inform their researchers about citations and impact. This is why ACRL (2014) states that university libraries have the qualifications needed to appropriately use altmetrics and foster among the academic community the impact and value of the research produced in their institutions. Due to this, librarians should train and inform about these alternative metrics as one service more
WHAT ROLE DO LIBRARIANS PLAY IN ALTMETRICS? 5 Anales de Documentación, 2015, vol. 18, nº 2 of the Library, as they are “well positioned to inform and support researchers and decision makers in their use” (Lapinski, Piwowar & Priem, 2013). Moreover, the resources endorsed by libraries are incorporating altmetrics both in repositories (Konkiel & Scherer, 2013), and in databases and electronic resources. 3.3. 10 reasons for librarians to incorporate altmetrics in their daily activity Librarians play a star role in the area of alternative metrics as assessors, trainers and advocates in matters of scientific publication. The ACRL report (2014) on trends in university libraries discussed above, states that “university libraries serve research, offering information resources and helping in the different phases of the process of scientific research”... For Merlo-Vega (2011), librarians “are agents who foster resources, designing learning objects, producing information contents and carrying out training actions” and Science 2.0 “presents libraries with the opportunity to fulfill their commitment to serving research. Researchers subscribe to the blogs and lists of libraries to find out about the resources that they describe. But they also are enrolled in their training courses and are the main users of tutorials about documentation techniques, not only oriented at seeking resources but expanded to subjects such as bibliographic management, obtaining citations indices and signs of quality of publications, and the handling of participatory tools to share research projects”. In this context of the social web and Science 2.0, alternative metrics, or altmetrics, are seen to be strongly linked to the librarian’s task of supporting research but also to the figure of the liaison librarian or one who is integrated into teaching and research. For Sutton (2014), altmetrics are the natural extension of what libraries and librarians did before. Not in vain Plum was founded in 2012 by a librarian and a technologist. This situation is reflected in the countless congresses and seminars for librarians over these last years, as has already been mentioned. In the White Paper on altmetrics (NISO, 2014), which counted on the presence of librarians, it is indicated that “Libraries and librarians have the necessary qualification to train and disseminate the appropriate use of altmetrics to promote the global academic community, the impact, the attention and the value of the research produced in their institutions”. Many librarians are actively taking part in the dissemination of these metrics, so they are authorities in their institutions. Both NISO (2014) and ACRL (2014) see signs that libraries are incorporating information about altmetrics by including in their subject guides resources for scientific communication, impact and citations management. As evidence, they cite the great number of results in Google which include both “LibGuides” and “altmetrics” (106,000 in September 2014). Authors, such as Bando (2013), wonder when librarians are going to include alternative metrics in their day-to-day activities. For Galligan (2013) and other authors, there are various reasons why altmetrics are interesting for librarians in their daily activities. The following is a summary of them: 1. As librarians supporting research, they are consultants who help researchers to know, improve and build their own scientific impact, measuring this thanks to these alternative metrics, in real time and showing the value of their research, its impact and the attention that it gets. This is because altmetrics complement the traditional methods which measure academic impact and the peer review process. Different authors state that these practices transform the librarian into a genuine specialist in the scientific communication process (Priem, Piwowar & Hemminger, 2012; Galligan, 2013; Lapinski, S. et al., 2013), as they give evidence of the possible quality and usefulness of academic facets about which traditional metrics did not previously inform (ACRL, 2014). This information may prove to be important for the promotion and accreditation of the research professors given that they must continuously show the impact of their efforts in different circumstances. They also have to identify emerging trends in research and obtain financing for research projects. The involvement and know-how of librarians in an activity of vital importance for professors and researchers guarantees their strategic role in the process of academic scientific production and communication (Holmes, 2014). 2. Librarians who monitor the impact of their institution’s scientific activity are a way of showing the ROI of public investment in higher education (Sutton, 2014). Altmetric.com, one of the altmetrics firms, has announced the institutional edition of its product19. This offers librarians, research administrators and researchers in general an easy and intuitive way of monitorizing and registering the online impact of the publications and scientific papers of the members of the institution. They thus get the best result for the scant resources of the library and its corresponding institution. This monitorizing is interesting for university managers, as they can present the internal and external
6 NIEVES GONZÁLEZ, MARÍA ISABEL DOMÍNGUEZ, ANTONIO CALDERÓN Y PABLO GARCÍA Anales de Documentación, 2015, vol. 18, nº 2 stakeholders with supplementary results along with traditional metrics. They can hence demonstrate the value of the institution with different aims, such as identifying trends20 or seeking financing (Sutton, 2014). 3. As institutional assessors in issues of scientific production. University managers are demanding librarians to take a stance on these alternative metrics or on buying products which include them (Delasalle, 2014). This is an opportunity to train university managers and researchers in their strengths and weaknesses (Roemer & Borchardt, 2013). Likewise, librarians can recommend them to the editorial committees of the academic journals which accept evidence of alternative metrics in their editorial policy (Lapinski, S. et al. 2013). “Librarians can help administrators understand the limitations of using altmetrics for certain purposes and how they compare with other measures of influence” (Brigham, 2014). 4. As trainers in information and scientific literacy and in alternative science systems, the specific skills of scientific communication are having an increasingly greater relevance in the training plans of libraries (González- Fernández-Villavicencio, 2013). With training in the concepts of Ciencia 2.0, libraries include platforms which enable the free sharing of all kinds of information, management tools, storing and networking in the scientific area, the use of managers of social reference, such as Mendeley, of social media such as Twitter, of open encyclopedias such as Wikipedia, of open information access systems such as Meneame, of social publications such as Slideshare, of social networks such as Academia.edu and ResearchGate, of open repositories and scientific blogs, etc. All these media generate statistics about the activity and interaction between their users in social media (Google+1s, tweets, Likes, Shared, etc.), in reference managers (downloads, commentaries, readings), in scientific blogs (comments, inbound links), in repositories (views, downloads), etc. These metrics affect any kind of scientific and academic material and are complementing the evaluation of the science. It is necessary to tackle their limitations when including training in alternative systems (Galligan, 2013). Davis-Kahl et al. (2014) offer examples of university libraries which have integrated these information and scientific competences and we have already commented on how libraries have included the concepts of altmetrics in their LibGuides. 5. As trainers in the use of these new metrics within specific scientific competences for researchers (Roemer & Borchardt, 2012; Roemer & Borchardt, 2013) and encouraging experimentation with emerging altmetrics tools (Lapinski et al. 2013). Researchers have realized that there are buttons and symbols which show ranking symbols embedded in papers, repositories and databases, so they ask the library for information. In 2014, EBSCO acquired PLUM Analytics, Springer includes Altmetric.com in SpringerLink, Wiley added Altmetric.com to its open access journals21 and Scopus added reading statistics from Mendeley and Altmetric.com22. This is an opportunity to offer a guide and advice in training sessions (Konkiel & Scherer, 2013). 6. It is of interest for librarians in their activity of selecting information resources for the developing of collections. This is because it takes into account the impact of the publications for their inclusion in the libraries’ collections. Impact data which offer resources, such as Mendeley, can be considered (Galligan, 2013). Librarians and researchers get extra information about citations and altmetrics uses of resources (downloads, favorites, mentions, recommendations, etc.) when they purchase these altmetrics from suppliers of resources such as EBSCO (which acquired Plum Analytics). This is in addition to the data which traditional statistics such as COUNTER offer, which are statistics that librarians already use to account for and know the users’ employment of the collections of electronic resources (Sutton, 2014). 7. It is interesting for librarians as a source of information to know the needs and interests of their users (Borrego, 2014). We have already commented that altmetrics are a natural extension of what librarians now do – in this case, monotorizing the behavior of users for decision-making in relation to their collections, especially that which is electronic (Galligan & Dyas-Correia, 2013, p. 58). 8. To enrich their own collections and repositories. The value of altmetrics in repositories is clear. This is because they help to have a view of the whole of the collection. They also encourage the depositing of more material by confirming the advantages of the materials being in open access. They can be used to persuade and stimulate potential depositors in open access, by complementing the existing statistics of use. In this sense, it will have to be decided if the costs of the service, the technical support needs, the restrictions of the platforms and the real interest of the users have been taken into account when including these new metrics in repositories. As well as the most known altmetrics services, there are other forms of implementing these utilities through APIs and open access tools, such as PLOS’s Article Level Metrics, web sites and services which trace the impact of
WHAT ROLE DO LIBRARIANS PLAY IN ALTMETRICS? 7 Anales de Documentación, 2015, vol. 18, nº 2 scientific publications through various points of their scientific cycle, from reading to post-publication peer reviews (Scopus, Mendeley, PubMed, Faculty 1000, blogs and social networks). On the other hand, the use of repositories outside the academia has been seen to increase by adding these metrics, as they indicate the impact of each material deposited, letting us know in what way the content is used and shared (Konkiel & Scherer, 2013; Delasalle, 2014). The institution can use them to carry out both the internal and external dissemination activities of the repository and, as a consequence, of the scientific production deposited in it by its researchers. They can also be used by the evaluation committees as a complementary impact measure. 9. As the librarians/researchers that they are, they must foster and disseminate their skills in the use and practice of altmetrics, knowing the tools firsthand and using them for the impact of their own publications (Roemer & Borchardt, 2013; Lapinski et al. 2013), including them in their CVs (Curriculum Vitae).23 10. As a bridge with the suppliers of altmetrics. Librarians have to be always attentive to the existing metrics of the evaluation of scientific publications and can function as a bridge between the needs of the researchers and institutions and the suppliers of alternative metrics to indicate the errors that exist. 3.4. Ten steps that librarians must take to incorporate altmetrics Most authors generally agree that librarians should involve themselves in alternative metrics by offering their support in three directions: offering information about the latest trends in emerging research, supporting trying out innovative tools and getting involved with training in and with the results of alternative metrics (Lapinski et al. 2013). We propose that librarians should take the following 10 steps: 1. Train in alternative metrics (Lapinski et al. 2013). Gain firsthand knowledge of the services and tools that these metrics offer and try them out. Create profiles in different services and know better their functionalities, as in, for example, Altmetric for institutions. 2. Use these tools in their own profiles and CVs as researchers. 3. Contact other university scientific community support services and researchers to initiate projects of collaboration with them for the study and implementation of altmetrics. 4. Advise the institution about their use and disseminate both their advantages and the limitations of using them. Recommend them to the committees which award financing and the editorial teams of journals which accept different impact metrics including phrases such as “Evidence of alternative impact forms is accepted”. 5. Train their users of any kind in scientific competences and information literacy competencies, including training in bibliography management tools, such as Mendeley, Social Markers, Social networks, Open Access, Sites to share materials, etc. (Lapinski et al. 2013). Incorporate them into training materials, in the subject guides, such as LibGuides. 6. Train their researchers in scientific competences including alternative metrics and trying them out. Help the researchers to place their papers ideally with these services, depositing a copy of all the results of their research, including codes and data, in the appropriate repositories (Gunn, W. 2014). Include altmetrics in their CV and take into account the researchers in the evaluation of the research. Encourage researchers to tell their own impact stories in their curricula. Elsevier specifically recommends librarians to use a series of steps as a sample of their known infography24. 7. Incorporate Altmetrics in the selection of information resources and collection development. 8. Implement them in repositories, databases, library catalogs, etc. (Lapinski et al. 2013). There are various institutional repositories which incorporate altmetrics, such as the University of Indiana, IUScholarWorks Repository2526. It is recommended that if there is not activity, the button must not appear along with the paper and the author should decide if he/she wishes to include it or not in his/her materials (Delasalle, 2014). 9. Incorporate them into user study procedures (detecting their needs).
8 NIEVES GONZÁLEZ, MARÍA ISABEL DOMÍNGUEZ, ANTONIO CALDERÓN Y PABLO GARCÍA Anales de Documentación, 2015, vol. 18, nº 2 10. Disseminate the use of these metrics, their advantages and limitations, as well as accessing these services through mobile technologies and applications. 3.5. Reference initiatives in libraries There is really a boom of opinions and postures among librarians at the same time that there is a deepening or seeking of a closer collaboration with researchers and with the process and result of their duties - research that is in some cases fostered by more wide-ranging university policies or by consortia.27 One of the most widespread uses is the creating of guides28 (some excellent) with different formats and lengths in which there is a compiling of relevant information, an explanation of how to use them, what the pros and cons are, significant examples, etc. They have also created websites (LibGuides is one) and specific blogs29 in which they speak about them. They include as well posts in their general blogs, organize specific congresses30 and devote a section within them31 to cover it. Of course they have included training within what is most generic or specific about the evaluation of research activity or exclusively created training32 dedicated to altmetrics. Not only at the level of individual libraries, but also in consortia and major associations which publish states of the art or key data about the issue (Roemer & Bonchardt, 2014; Sutton, 2014; King & Thuna, 2013). Some important suppliers have signed up33. This is certainly interesting but they continue analyzing the role of librarians, who tend to be their direct intermediaries. Some examples of good practices in which libraries have experience with these low risk tools are: 1.- The University of Pittsburgh Library System (one of the most largest in the United States) is collaborating with Plum Analytics to find ways of evaluating the impact of its university’s research through less traditional means such as institutional repositories and social media platforms (Rodgers, 2013). In 2012 it contracted the services of Plum Analytics to create a directory of research and include in it a list of the publications of its researchers, metrics obtained from open access, social networks, repositories of data, blogs and other sources, with the aim of improving their profiles34. It has started to practice and disseminate the use of these tools in its community. 2.- P. Scott Lapinski (research support librarian of the Harvard Medical School and the Harvard School of Public Health for the NIH Public Access Policy) offers users training and advice in the use of altmetrics to demonstrate to researchers the benefits of their work being in open access (Rathemacher, 2014) 3.- Lisa Palmer, librarian of the institutional repository Lamar Soutter Library, University of Massachusetts Medical School, promotes Altmetric.com in the repository eScholarship@UMMS via training and the use of altmetrics products. To demonstrate a paper’s impact level, she has included the API of Altmetric.com in The Journal of eScience Librarianship35. Donuts of Altmetric.com appear in every paper, as they have a DOI assigned. Altmetrics have a great value for showing the impact of materials other than articles included in repositories that traditional metrics do not consider. They also offer training courses on altmetrics and LibGuides in open access. They have created profiles in ImpactStory for a group of researchers to use it as an example (Rathemacher, 2014). 4.- John Furfey, of the MBLWHOI Library, incorporated altmetrics into the system of profiles of researchers and their publications (Bibapp project). Through an API, they included the metrics of Altmetric.com and ImpactStory in the system36. Researchers began to ask questions and the library offered training courses in altmetrics to both researchers and students. One of the great advantages is the grouping of trends in the publications and offering those of the research groups37. Departments use this information to decide on the research lines which they are going to follow. In this way, librarians have for the first time become assessors of researchers (Rathemacher, 2014). 5.-The University of New South Wales (UNSW) Library has over the last seven years provided the university’s research community with a service called RIMS, the Research Impact Measurement Service. The aim of the service was to support research outcomes via measuring the publishing impact, for both authors and departmental units. Often while developing and delivering RIMS we have questioned whether the Library is the most appropriate provider of impact measurement services and whether these services are in general valued by the research community. Now they include training in altmetrics tools (Drummond, 2014).
WHAT ROLE DO LIBRARIANS PLAY IN ALTMETRICS? 9 Anales de Documentación, 2015, vol. 18, nº 2 6.- Lucy Ayre is the manager of the institutional repository LSE Research Online and works within Research Support Services at LSE Library. In an interview in the blog LSE38 Ayre states that they already collect statistics for publications downloaded from LSE Research Online. These statistics can afford useful data together with traditional citation counts. In more recent times they have added an altmetrics tool with the aim of measuring how LSE research is being employed in this broader social panorama. The altmetrics badge, which is displayed on every item in LSE Research Online with a DOI, indicates a score of attention and other metrics that go with it to help researchers to track online attention concerning their work. 3.6. The situation in spanish libraries. Results of the survey At the Spanish level it is noted that they devote some space in the web or in institutional blogs39 and/or give training40, normally included in the general area of the evaluation of research activity41. Likewise, they make these options known in the assessing requested by researchers, although the feeling is that until there is a real recognition, researchers are not going to pay too much attention. Perhaps this is more so in the case of those who are beginning and who have published little. They want to have an idea of the impact that their publications can have - if they are downloaded, if managers link to them, if they will have, ultimately, more possibilities of being cited. On the other hand, there is an aim in training in these matters. One of the references is the Grupo EC342 which addresses itself to both universities and university libraries and which receives (in its parent university, Granada, Spain) the consultations which arrive at the library. University and specialized libraries have taken part in some of its Seminars (as in the 4th on altmetrics). There are other libraries which show that they are getting ready to be able to give a timely answer and/or are receiving information about initiatives which aim at commercialization, such as PlumX which is offering the creation of individual profiles for institutions to value the opportunity of extending them to a greater number of researchers. As is reflected in the survey which we have carried out, in some cases they have also asked Altmetric.com for a test to include the data referring to their researchers in CRIS (Current Research Information Systems) institutional. In order to contribute recent data to this research about librarians and altmetrics, the authors of this work have carried out an online survey43 of Spanish university librarians with the aim of obtaining a general view of the perception of the librarians irrespective of the library where they work. There is also a first statistical approximation concerning the specific training which they have received and the activities related to altmetrics that they carry out. The answers were received between April and August 2014. There were 112 valid answers which came from 43 university and specialized libraries. The results show that only in 13 cases has training in altmetrics been received directly from their institution (question 1 of the survey), although a considerable number (44) have trained themselves. This is a sign of their professionalism. Twenty three libraries provide information in their web (question 2), which is more than those who train their librarians. This means that there is interest, although this is not materialized in more decisive steps. A great majority (90) believe that the library should train or advise their researchers in altmetrics (question 3) (Figure 1). The librarians show a categorical interest in and commitment to the improving of the visibility of their researchers and have a clear view that it may be interesting to train them in altmetrics, even if this is via prior selftraining.
16 NIEVES GONZÁLEZ, MARÍA ISABEL DOMÍNGUEZ, ANTONIO CALDERÓN Y PABLO GARCÍA Anales de Documentación, 2015, vol. 18, nº 2 ZAHEDI, Z.; FENNER, M. & COSTAS, R. (2014), “How consistent are altmetrics providers? Study of 1000 PLOS ONE publications using the PLOS ALM, Mendeley and Altmetric.com APIs”, Figshare, 2014. Available in: <http://dx.doi.org/10.6084/m9.figshare.1041821> [Consultation: October 11, 2014].