Reproducibility in Scientometrics – special track at the STI2018

Reproducibility in Scientometrics – special track at the STI2018

Reproducibility in Scientometrics

Sybille Hinze1, Jason Rollins2, Andrea Scharnhorst3, Jesper Schneider4, Theresa Velden5, Ludo Waltman6

1DZHW, Berlin, Germany, 2Clarivate Analytics, USA, 3Royal Netherlands Academy of Arts and Sciences, The Netherlands, 4Danish Centre for Studies in Research & Research Policy, Aarhus University,5Technical University Berlin, Germany, 6Centre for Science and Technology Studies (CWTS), Leiden University, the Netherlands

A crisis in the reproducibility of published results has been hotly debated in fields like biomedicine and psychology. In the context of scientometric research and applied scientometric analysis, the ability to replicate the results produced by another team would equally seem to be a key requirement to instill confidence in the reliability of the results reported. Causes, prevalence and consequences of irreproducibility likely vary between scientific fields, and the discussion in scientometrics has only just begun (see workshop report from ISSI 2017

We call for contributions in form of short papers (max. 3,000 words) or abstracts of provocations (max. 1,000) that highlight and analyze issues related to reproducibility in scientometric research and applied scientometric analysis. One topic of recent interest is the potential impact of the Initiative for Open Citations, I4OC, and we welcome contributions that compare strengths and weaknesses of open sources of citation data and proprietary data sources.

The first session of the special track is dedicated to the presentation and discussion of the submitted and accepted contributions. The second session of the special track seeks to collectively develop ideas for key actions to address reproducibility, including the development of a list of top ten key actions. The interaction format (break-out groups, open fish bowl conversation or similar) will be adapted to the level and range of interests suggested by the response to this call for papers.

Important dates:

  • Deadline for submissions: April 1, 2018
  • Notification of acceptance: June 15, 2018
  • Early-bird registration: June 15 – July 15, 2018
  • Conference: September 12 – 14, 2018

If you are interested please go to the website and submit via EasyChair:


This initiative bases partly on work done in TD1210 in a couple of workshops around the topic of “Same data, different results”.