scieee AI-readable full text Open interactive document viewer

Beyond Traditional Metrics: Leveraging Open Data Integration for Equitable Research Evaluation

Huang, Chun-Kai (Karl)

Abstract

Presentation slides for a lightning talk at AIMOS 2025 on 20 November 2025. Abstract: The rapid development of open data sources for indexing research outputs is fundamentally transforming research evaluation practices. Recent milestones, including the release of the Leiden Ranking Open Edition and Australia's new Research Insights Capability (RIC) framework from the Australian Research Council, demonstrate a decisive shift toward open data sources and persistent identifiers in research assessment. The ability to link and integrate diverse open data sources creates unprecedented coverage and opens new possibilities for research evaluation. This presentation highlights work by the Curtin Open Knowledge Initiative that leverages these advances to address real-world challenges in research assessment. Our approach demonstrates how comprehensive open data integration can provide new perspectives on research impact measurement beyond traditional metrics. Critically, these developments enable us to ask more fundamental questions about knowledge accessibility and participation in knowledge creation. By examining who gets to access research outputs and who participates in knowledge generation, we can develop more equitable and comprehensive approaches to understanding research impact and value.

Full text

Beyond Traditional Metrics: Leveraging Open Data Integration for Equitable Research Evaluation Karl Huang (Curtin University) Link to this set of slides: https://doi.org/10.5281/zenodo.17626824 A RAPIDLY SHIFTING LANDSCAPE • CWTS Leiden Ranking Open Edition • Australia's new Research Insights Capability (RIC) framework • More and more funders and stakeholders requiring open access and transparency • Open data sources for indexing research outputs are expanding NEW OPPORTUNITIES Persistent Identifiers e.g., DOI, ROR, ORCID Published articles Authors Institutions Publishers And more… NTROs Books ●Open data is now more comprehensive and rapidly improving ●We can do “open science on open science” with open data, open source, open systems, etc. ●More open, equitable, and control COKI DATA >150 million >5 million >90k 227 >90k >120k >13 trillion data points https://open.coki.ac 225 countries 52,444 institutions NEW OPPORTUNITIES Demo version available at: https://demo.ries.coki.ac/ Automate the ERA process, and more! NEW OPPORTUNITIES NEW OPPORTUNITIES Thinking about citations in a different way: Huang et al. (2024). Open Access Research Outputs Receive More Diverse Citations. Scientometrics 129, 825-845. https://doi.org/10.1007/s11192-023-04894-0 OA citation diversity advantage is not equal for all places! NEW OPPORTUNITIES Q: Are all citations equal? Co-authorship diversity! NEW OPPORTUNITIES