2023
Nüst, Daniel; Ostermann, Frank O.; Granell-Canut, Carlos
A peer review process for higher reproducibility of publications in GIScience can also work for Earth System Sciences Proceedings Article
In: European Geosciences Union (EGU) General Assembly 2023, pp. EGU23-15384, Copernicus Publications, 2023.
Abstract | Links | BibTeX | Tags: AGILE, GIScience, Reproducibility, Reproducible research
@inproceedings{nust2023a,
title = {A peer review process for higher reproducibility of publications in GIScience can also work for Earth System Sciences},
author = {Daniel Nüst and Frank O. Ostermann and Carlos Granell-Canut},
doi = {https://doi.org/10.5194/egusphere-egu23-15384},
year = {2023},
date = {2023-04-24},
booktitle = {European Geosciences Union (EGU) General Assembly 2023},
pages = {EGU23-15384},
publisher = {Copernicus Publications},
abstract = {The Reproducible AGILE initiative (https://reproducible-agile.github.io/) successfully established a code execution procedure following the CODECHECK principles (https://doi.org/10.12688/f1000research.51738.2) at the AGILE conference series (https://agile-online.org/conference). The AGILE conference is a medium-sized community-led conference in the domains of Geographic Information Science (GIScience), geoinformatics, and related fields. The conference is organised under the umbrella of the Association of Geographic Information Laboratories in Europe (AGILE).},
keywords = {AGILE, GIScience, Reproducibility, Reproducible research},
pubstate = {published},
tppubtype = {inproceedings}
}
The Reproducible AGILE initiative (https://reproducible-agile.github.io/) successfully established a code execution procedure following the CODECHECK principles (https://doi.org/10.12688/f1000research.51738.2) at the AGILE conference series (https://agile-online.org/conference). The AGILE conference is a medium-sized community-led conference in the domains of Geographic Information Science (GIScience), geoinformatics, and related fields. The conference is organised under the umbrella of the Association of Geographic Information Laboratories in Europe (AGILE).
2020
Nüst, Daniel; Ostermann, Frank; Granell-Canut, Carlos; Kmoch, Alexander
The 15th Munin Conference on Scholarly Publishing 2020, organized online by UiT The Arctic University of Norway, November 17–19, 2020, 2020, ISSN: 2387-3086.
Links | BibTeX | Tags: Reproducible research
@conference{Nüst2020,
title = {Improving reproducibility of geospatial conference papers - lessons learned from a first implementation of reproducibility reviews},
author = {Daniel Nüst and Frank Ostermann and Carlos Granell-Canut and Alexander Kmoch},
doi = {10.7557/5.5601},
issn = {2387-3086},
year = {2020},
date = {2020-11-17},
booktitle = {The 15th Munin Conference on Scholarly Publishing 2020, organized online by UiT The Arctic University of Norway, November 17–19, 2020},
keywords = {Reproducible research},
pubstate = {published},
tppubtype = {conference}
}
Granell-Canut, Carlos; Hofer, Barbara; Nüst, Daniel; Ostermann, Frank O.; Sileryte, Rusne
Reproducibilidad en AGILE: Experiencias, logros y recomendaciones Journal Article
In: Revista Cartográfica, no. 100, pp. 155-172, 2020, ISSN: 0080-2085.
Abstract | Links | BibTeX | Tags: Reproducible research
@article{Granell-Canut2020,
title = {Reproducibilidad en AGILE: Experiencias, logros y recomendaciones},
author = {Carlos Granell-Canut and Barbara Hofer and Daniel Nüst and Frank O. Ostermann and Rusne Sileryte},
doi = {https://doi.org/10.35424/rcarto.v0i100.668},
issn = {0080-2085},
year = {2020},
date = {2020-05-04},
journal = {Revista Cartográfica},
number = {100},
pages = {155-172},
abstract = {Este artículo describe las experiencias, actividades realizadas, recursos generados y recomendaciones para la promoción e incentivación de prácticas en investigación reproducible en el campo de la ciencia de la información geográfica. Aunque el artículo se centra en la comunidad y conferencia AGILE (Association of Geographic Information Laboratories in Europe), creemos que los recursos y lecciones aprendidas pueden ser extrapolables a comunidades y asociaciones científicas afines en otras regiones, como puede ser Latinoamérica. En este sentido, hacemos especial hincapié en la descripción de las directrices para la redacción de artículos reproducibles propuestas en el seno de AGILE, así como en una serie de recomendaciones dirigidas principalmente a asociaciones y organizadores de conferencias científicas para la adopción y promoción paulatina de dichas prácticas. Se trata pues de una llamada a la comunidad Latinoamérica de la ciencia de la información geográfica a que consideren los recursos aquí detallados con el fin de incentivar la investigación reproducible en sus comunidades científicas.},
keywords = {Reproducible research},
pubstate = {published},
tppubtype = {article}
}
Este artículo describe las experiencias, actividades realizadas, recursos generados y recomendaciones para la promoción e incentivación de prácticas en investigación reproducible en el campo de la ciencia de la información geográfica. Aunque el artículo se centra en la comunidad y conferencia AGILE (Association of Geographic Information Laboratories in Europe), creemos que los recursos y lecciones aprendidas pueden ser extrapolables a comunidades y asociaciones científicas afines en otras regiones, como puede ser Latinoamérica. En este sentido, hacemos especial hincapié en la descripción de las directrices para la redacción de artículos reproducibles propuestas en el seno de AGILE, así como en una serie de recomendaciones dirigidas principalmente a asociaciones y organizadores de conferencias científicas para la adopción y promoción paulatina de dichas prácticas. Se trata pues de una llamada a la comunidad Latinoamérica de la ciencia de la información geográfica a que consideren los recursos aquí detallados con el fin de incentivar la investigación reproducible en sus comunidades científicas.
Zaragozí, Benito M.; Trilles-Oliver, Sergio; Navarro-Carrión, José T.
Leveraging container technologies in a GIScience project: A Perspective from Open Reproducible Research Journal Article
In: ISPRS International Journal of Geo-Information, vol. 9, pp. 138, 2020.
Abstract | Links | BibTeX | Tags: Open science, Reproducible research
@article{Zaragozí2020,
title = {Leveraging container technologies in a GIScience project: A Perspective from Open Reproducible Research},
author = {Benito M. Zaragozí and Sergio Trilles-Oliver and José T. Navarro-Carrión},
doi = {https://doi.org/10.3390/ijgi9030138 },
year = {2020},
date = {2020-04-16},
journal = {ISPRS International Journal of Geo-Information},
volume = {9},
pages = {138},
abstract = {Scientific reproducibility is essential for the advancement of science. It allows the results of previous studies to be reproduced, validates their conclusions and develops new contributions based on previous research. Nowadays, more and more authors consider that the ultimate product of academic research is the scientific manuscript, together with all the necessary elements (i.e., code and data) so that others can reproduce the results. However, there are numerous difficulties for some studies to be reproduced easily (i.e., biased results, the pressure to publish, and proprietary data). In this context, we explain our experience in an attempt to improve the reproducibility of a GIScience project. According to our project needs, we evaluated a list of practices, standards and tools that may facilitate open and reproducible research in the geospatial domain, contextualising them on Peng’s reproducibility spectrum. Among these resources, we focused on containerisation technologies and performed a shallow review to reflect on the level of adoption of these technologies in combination with OSGeo software. Finally, containerisation technologies proved to enhance the reproducibility and we used UML diagrams to describe representative work-flows deployed in our GIScience project},
keywords = {Open science, Reproducible research},
pubstate = {published},
tppubtype = {article}
}
Scientific reproducibility is essential for the advancement of science. It allows the results of previous studies to be reproduced, validates their conclusions and develops new contributions based on previous research. Nowadays, more and more authors consider that the ultimate product of academic research is the scientific manuscript, together with all the necessary elements (i.e., code and data) so that others can reproduce the results. However, there are numerous difficulties for some studies to be reproduced easily (i.e., biased results, the pressure to publish, and proprietary data). In this context, we explain our experience in an attempt to improve the reproducibility of a GIScience project. According to our project needs, we evaluated a list of practices, standards and tools that may facilitate open and reproducible research in the geospatial domain, contextualising them on Peng’s reproducibility spectrum. Among these resources, we focused on containerisation technologies and performed a shallow review to reflect on the level of adoption of these technologies in combination with OSGeo software. Finally, containerisation technologies proved to enhance the reproducibility and we used UML diagrams to describe representative work-flows deployed in our GIScience project
2019
Hofer, Barbara; Broman, K. W.; Granell-Canut, Carlos; Graser, Anita; Hettne, K.; Nüst, Daniel; Ostermann, Frank; Sileryte, Rusne; Teperek, M.
Reproducible Publications at AGILE Conferences: Proposed Guidelines for Authors and Reviewers Proceedings Article
In: Kyriakidis, P.; Hadjimitsis, D.; Skarlatos, D.; Mansourian, A. (Eds. ) (Ed.): 22nd AGILE Conference on Geo-information Science: Short Papers and Posters. Cyprus University of Technology 17-20 June 2019, Limassol, Cyprus., Stichting AGILE, 2019, ISBN: 978-90-816960-9-8.
Abstract | Links | BibTeX | Tags: Open science, Reproducible research
@inproceedings{Hofer2019,
title = {Reproducible Publications at AGILE Conferences: Proposed Guidelines for Authors and Reviewers},
author = {Barbara Hofer and K. W. Broman and Carlos Granell-Canut and Anita Graser and K. Hettne and Daniel Nüst and Frank Ostermann and Rusne Sileryte and M. Teperek},
editor = {Kyriakidis, P. and Hadjimitsis, D. and Skarlatos, D. and Mansourian, A. (Eds.) },
url = {https://agile-online.org/images/conference_2019/documents/posters/43_Upload_your_PDF_file.pdf},
isbn = {978-90-816960-9-8},
year = {2019},
date = {2019-06-14},
booktitle = {22nd AGILE Conference on Geo-information Science: Short Papers and Posters. Cyprus University of Technology 17-20 June 2019, Limassol, Cyprus.},
publisher = {Stichting AGILE},
abstract = {This contribution reports on the outcomes of a specialist meeting on reproducible publication guidelines for the AGILE conference series. Reproducibility of research is fundamental for assuring significance and credibility of science and receives increasing attention in computational research fields including geoinformatics. The development of publication guidelines needs to address a series of questions like how reviewers can be rewarded for their efforts to assess the reproducibility or what a reasonable balance is between being specific in the guidelines (e.g. recommending tools) vs. generic (usable for all disciplines represented at AGILE now and in the future). The development of the guidelines is a collaborative effort and this contribution is meant to disseminate results to the AGILE community},
keywords = {Open science, Reproducible research},
pubstate = {published},
tppubtype = {inproceedings}
}
This contribution reports on the outcomes of a specialist meeting on reproducible publication guidelines for the AGILE conference series. Reproducibility of research is fundamental for assuring significance and credibility of science and receives increasing attention in computational research fields including geoinformatics. The development of publication guidelines needs to address a series of questions like how reviewers can be rewarded for their efforts to assess the reproducibility or what a reasonable balance is between being specific in the guidelines (e.g. recommending tools) vs. generic (usable for all disciplines represented at AGILE now and in the future). The development of the guidelines is a collaborative effort and this contribution is meant to disseminate results to the AGILE community
2018
Granell-Canut, Carlos; Nüst, Daniel; Ostermann, Frank; Sileryte, Rusne
Reproducible Research is like riding a bike Journal Article
In: PeerJ, pp. e27216v1, 2018.
Abstract | Links | BibTeX | Tags: Reproducible research, RyC-Granell
@article{Granell-Canut2018,
title = {Reproducible Research is like riding a bike},
author = {Carlos Granell-Canut and Daniel Nüst and Frank Ostermann and Rusne Sileryte},
doi = {https://doi.org/10.7287/peerj.preprints.27216v1 },
year = {2018},
date = {2018-03-29},
journal = {PeerJ},
pages = {e27216v1},
abstract = {Reproducibility is a fundamental pillar in science but it has recently been described as hard and challenging to achieve, as stated in numerous editorials and papers, some of which alert on a “reproducibility crisis”. In this article we outline 1/ the approach taken to put Reproducible Research (RR) in the agenda of the GIScience community, 2/ first actions and initial lessons learned towards the discussion and adoption of RR principles and practices in the workflows and habits of researchers, and finally, we present 3/ our short-term strategy (two years) and specific actions to achieve the main goal of making RR an integral part of scientific workflows of the GIScience community.},
keywords = {Reproducible research, RyC-Granell},
pubstate = {published},
tppubtype = {article}
}
Reproducibility is a fundamental pillar in science but it has recently been described as hard and challenging to achieve, as stated in numerous editorials and papers, some of which alert on a “reproducibility crisis”. In this article we outline 1/ the approach taken to put Reproducible Research (RR) in the agenda of the GIScience community, 2/ first actions and initial lessons learned towards the discussion and adoption of RR principles and practices in the workflows and habits of researchers, and finally, we present 3/ our short-term strategy (two years) and specific actions to achieve the main goal of making RR an integral part of scientific workflows of the GIScience community.
Nüst, Daniel; Granell-Canut, Carlos; Hofer, Barbara; Konkol, Markus; Ostermann, Frank O; Sileryte, Rusne; Cerutti, Valentina
Reproducible research and GIScience: an evaluation using AGILE conference papers Journal Article
In: PeerJ, vol. 6, pp. e5072, 2018, ISSN: 2167-8359.
Links | BibTeX | Tags: AGILE, Data science, GIScience, Open access, Open science, Reproducible research
@article{Granell2018,
title = {Reproducible research and GIScience: an evaluation using AGILE conference papers},
author = {Daniel Nüst and Carlos Granell-Canut and Barbara Hofer and Markus Konkol and Frank O Ostermann and Rusne Sileryte and Valentina Cerutti},
url = {https://doi.org/10.7717/peerj.5072},
doi = {10.7717/peerj.5072},
issn = {2167-8359},
year = {2018},
date = {2018-01-01},
journal = {PeerJ},
volume = {6},
pages = {e5072},
keywords = {AGILE, Data science, GIScience, Open access, Open science, Reproducible research},
pubstate = {published},
tppubtype = {article}
}