Collaborative Pathways to Responsible Research Assessment via Open Infrastructures
Tzouganatou, Angeliki; Malaguarnera, Giulia; Xenou, Zenia; Lippincott, Sarah
- Publisher
- Zenodo
- Language
- en
Abstract
Reforming research assessment has shifted from asking why to focusing on how. The proposed collaborative workshop addresses that challenge, specifically, how to turn CoARA policy principles into practice using infrastructures that are open, ethical, inclusive, and sustainable, by introducing and testing the Open Infrastructure Checklist, developed by the CoARA Working Group on Open Infrastructures for Responsible Research Assessment (OI4RRA). The checklist provides actionable guidance across four key dimensions: technical strength, operational excellence, community-led governance, sustainability, ethical and accountable practices.The workshop aims to empower institutions and infrastructure providers to operationalize responsible research assessment (RRA) using a practical, principle-based checklist, while exploring how existing tools can support this transition. Participants will apply the checklist to three real-world infrastructures: OpenAIRE’s Researcher Profile, a service for showcasing diverse research contributions, beyond traditional-publications model; the GraspOS catalogue of open data, tools, services, and templates for Open-Science-aware RRA, which utilises a metadata schema that complies with a draft specification developed by OI4RRA WG; and testing the ability to gather information from the checklist for Infra Finder from IOI, a catalogue of informational entries about open infrastructure tools and services, and provide feedback.Working in small groups, participants will evaluate each of these infrastructures against the checklist in a participatory format, test the tool’s usability and adaptability, identify gaps, strengths, and opportunities. This hands-on format encourages collaboration and critical reflection. Expected outcomes include a community-refined checklist, practical insights into infrastructure readiness, and a collaborative roadmap for broader institutional adoption and cross-organizational alignment in support of RRA. Workshop Schedule: Co-Designing for Effective-World Adoption 14:00–14:20 (20 min) — Welcome & Framing-Introduction to the workshop goals and collaborative format-Why infrastructure is central to operationalizing RRA principles-Presenting the CoARA OI4RRA WGIntroduction to the Open Infrastructure Checklist: Evaluating Open InfrastructuresFour dimensions: technical strength, operational excellence, community-led governance, ethical dimensionRole of the checklist in guiding adoption -Setting expectations: from shared values to shared implementation tools14:20–14:30 (10 min) —OpenAIRE MyResearchFolio14:30–14:40 (10 min) — GraspOS Catalogue14:40–14:50 (10 min) — IOI Infra Finder15:50 - 15:05 (15 min) Q&A15:05 - 15:10 (5 min) Choose/Find your Breakout Lab15:10 - 15:30 (20 min) Introductions among the participants and setting the scene 15:30-16:15 Coffee Break 16:15–17:00 (45 min) — Breakout Labs: Hands-On Checklist Testing17:00–17:25 (25 min) — Synthesis: Cross-Tool Insights & Checklist Refinement -Group reporting and discussion 17:25–17:40 (15 min) — From Alignment to Adoption: Collective Strategy Session & Commitments17:40–17:45 (5 min) — Closing
Full text
COLLABORATIVE PATHWAYS TO RESPONSIBLE RESEARCH ASSESSMENT VIA OPEN INFRASTRUCTURES 16 September 2025 ANGELIKI TZOUGANATOU, OPENAIRE | COARA OI4RRA WG WOKRSHOP 1
| OI4RRA WG 2 CoARA Vision The assessment of research, researchers and research organisations recognises the diverse outputs, practices and activities that maximise the quality and impact of research. This requires basing assessment primarily on qualitative judgement, for which peer review is central, supported by responsible use of quantitative indicators. 765 organisations have joined the Coalition (as of September 2025)
| OI4RRA WG| OI4RRA WG Mission •Enable institutions to move from proprietary infrastructure and research information, to open (interoperable) alternatives. •Take into consideration the wide range of research outputs and open science practices, addressing the diversity of the research community. 3 WG: Open Infrastructures for Responsible Research Assessment - OI4RRA 80 members 43 organisations Chairs: Natalia Manola (OpenAIRE), Clifford Tatum (CWTS)
| OI4RRA WG THE CASE FOR OPEN INFRASTRUCTURES Why
| OI4RRA WG| OI4RRA WG THE PARADOX We invest in Open Infrastructures for Research, Yet we rely on Closed Systems for Research Assessment 5
| OI4RRA WG WE USE CLOSED, PROPRIETARY SYSTEMS 01 02 03 04 05 Vendor Lock-In Dependence on commercial providers creates long-term financial and operational risks Opaque Processes Limited transparency in data provenance, methodology, and assessment criteria Restricted Access High subscription costs limit accessibility for researchers, institutions, and the public Siloed Information Data is often fragmented, locked within single systems, and lacks interoperability Focus on Metrics Overemphasis on traditional metrics (e.g., citations, journal impact) disregards multidimensional research outputs and impact How are we Currently Assessing Research? 6
| OI4RRA WG| OI4RRA WG Why Infrastructures & Services Matter for RRA Where principles become practice: •Make reforms actionable and scalableEnable transparency, interoperability, accountability •Connect research outputs, data, and assessment systemsRecognize diverse contributions (publications, data, software, engagement) •Anchor reforms beyond policy cycles •Reduce duplication and support systemic change 7
| OI4RRA WG THE PRINCIPLES & CHARACTERISTICS What
| OI4RRA WG| OI4RRA WG Open Infrastructures for Responsible Research Assessment: Principles and Framework Sets the foundation for the principles behind ΟΙs principles in RRA, specifically outlining: •The critical role of Open Infrastructures in ensuring transparent, equitable, and responsible assessment. •The essential characteristics that Open Infrastructures must possess to surpass the capabilities of proprietary systems. 9 https://zenodo.org/records/14844582
| OI4RRA WG Workshop Outline 16 •14:00–14:20 Welcome & Framing •14:20–14:50 Showcasing Infrastructures (MyResearchFolio, GraspOS, Infra Finder) •14:50–15:30 Q&A + Group Formation & group work start •16:15–17:00 Breakout Labs: Hands-on Checklist Testing •17:00–17:25 Synthesis & Checklist Refinement •17:25–17:40 Strategy & Commitments •17:40–17:45 Closing
