Reproducible Research and GIScience: An Evaluation Using GIScience Conference Papers

FO Ostermann, Daniel Nüst, Carlos Granell, Barbara Hofer, Markus Konkol

Publikation: Beitrag in Buch/Bericht/Konferenzband/GesetzeskommentarKonferenzbeitragPeer-reviewed

Abstract

GIScience conference authors and researchers face the same computational reproducibility challenges as authors and researchers from other disciplines who use computers to analyse data. Here, to assess the reproducibility of GIScience research, we apply a rubric for assessing the reproducibility of 75 conference papers published at the GIScience conference series in the years 2012-2018. Since the rubric and process were previously applied to the publications of the AGILE conference series, this paper itself is an attempt to replicate that analysis, however going beyond the previous work by evaluating and discussing proposed measures to improve reproducibility in the specific context of the GIScience conference series. The results of the GIScience paper assessment are in line with previous findings: although descriptions of workflows and the inclusion of the data and software suffice to explain the presented work, in most published papers they do not allow a third party to reproduce the results and findings with a reasonable effort. We summarise and adapt previous recommendations for improving this situation and propose the GIScience community to start a broad discussion on the reusability, quality, and openness of its research. Further, we critically reflect on the process of assessing paper reproducibility, and provide suggestions for improving future assessments. The code and data for this article are published at https://doi.org/10.5281/zenodo.4032875.
OriginalspracheEnglisch
Titel11th International Conference on Geographic Information Science (GIScience 2021) - Part II
Redakteure/-innenKrzysztof Janowicz, Judith A. Verstegen
ErscheinungsortDagstuhl, Germany
Seiten2:1-2:16
Band208
ISBN (elektronisch)9783959772082
DOIs
PublikationsstatusVeröffentlicht - 14 Sept. 2021

Publikationsreihe

NameLeibniz International Proceedings in Informatics, LIPIcs
Band208
ISSN (Print)1868-8969

Bibliographische Notiz

Funding Information:
Funding Daniel Nüst: Project o2r, German Research Foundation, grant number PE 1632/17-1. Carlos Granell: Ramón y Cajal Programme of the Spanish government, grant number RYC-2014-16913. Markus Konkol: Project o2r, German Research Foundation, grant numbers KR 3930/8-1 and TR 864/12-1.

Publisher Copyright:
© Frank O. Ostermann, Daniel Nüst, Carlos Granell, Barbara Hofer, and Markus Konkol; licensed under Creative Commons License CC-BY 4.0

Systematik der Wissenschaftszweige 2012

  • 107 Andere Naturwissenschaften

Dieses zitieren