On the effect of discussions on pull request decisions

Golzadeh, Mehdi; Decan, Alexandre; Mens, Tom

Download

Paper published in a journal (Scientific congresses and symposiums)

On the effect of discussions on pull request decisions

Golzadeh, Mehdi; Decan, Alexandre; Mens, Tom

2019

Permalink
https://hdl.handle.net/20.500.12907/10391

Files (1)Send to Details Statistics Bibliography Similar publications

Files

Full Text

Golzadeh_BENEVOL19_Effect_of_Discussions.pdf

Publisher postprint (1.32 MB)

Download

All documents in ORBi UMONS are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

[en] pull requests; [en] empirical analysis; [en] software repository mining; [en] collaborative development; [en] discussions

Abstract :

[en] Open-source software relies on contributions from different types of contributors. Online collaborative development platforms, such as GitHub, usually provide explicit support for these contributions through the mechanism of pull requests, allowing project members and external contributors to discuss and evaluate the submitted code. These discussions can play an important role in the decision-making process leading to the acceptance or rejection of a pull request. We empirically examine in this paper 183K pull requests and their discussions, for almost 4.8K Github repositories for the Cargo ecosystem. We investigate the prevalence of such discussions, their participants and their size in terms of messages and durations, and study how these aspects relate to pull request decisions.

Disciplines :

Computer science
Library & information sciences

Author, co-author :

Golzadeh, Mehdi ; Université de Mons > Faculté des Sciences > Service de Génie Logiciel

Decan, Alexandre ; Université de Mons > Faculté des Sciences > Service des Systèmes d'information ; Université de Mons > Faculté des Sciences > Service de Génie Logiciel

Mens, Tom ; Université de Mons > Faculté des Sciences > Service de Génie Logiciel

Language :

English

Title :

On the effect of discussions on pull request decisions

Publication date :

28 November 2019

Event name :

Belgium-Netherlands Software Evolution Workshop

Event place :

Bruxelles, Belgium

Event date :

2019

Research unit :

S852 - Génie Logiciel

Research institute :

R300 - Institut de Recherche en Technologies de l'Information et Sciences de l'Informatique
R150 - Institut de Recherche sur les Systèmes Complexes

Name of the research project :

Automated Assistance for Developing Software in Ecosystems of the Future - Fédération Wallonie Bruxelles

Available on ORBi UMONS :

since 11 December 2019

Statistics

Number of views

1 (0 by UMONS)

Number of downloads

4 (0 by UMONS)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

Bibliography

Laura A. Dabbish, H. Colleen Stuart, Jason Tsay, and James D. Herbsleb. Social coding in GitHub: transparency and collaboration in an open software repository. In Int'l Conf. Computer Supported Cooperative Work, pages 1277-1286, 2012.
Tom Mens, Marcelo Cataldo, and Daniela Damian. The social developer: The future of software development. IEEE Software, 36, January-February 2019.
Georgios Gousios, Martin Pinzger, and Arie van Deursen. An exploratory study of the pull-based software development model. In International Conference on Software Engineering, pages 345-355. ACM, 2014.
G. Gousios, A. Zaidman, M. Storey, and Arie van Deursen. Work practices and challenges in pull-based development: The integrator's perspective. In International Conference on Software Engineering, volume 1, pages 358-368. IEEE, May 2015.
Georgios Gousios, Margaret-Anne Storey, and Alberto Bacchelli. Work practices and challenges in pull-based development: The contributor's perspective. In International Conference on Software Engineering, pages 285-296. ACM, 2016.
Jason Tsay, Laura Dabbish, and James Herbsleb. Let's talk about it: Evaluating contributions through discussion in github. In Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, FSE 2014, pages 144-154, New York, NY, USA, 2014. ACM.
Olga Baysal, Oleksii Kononenko, Reid Holmes, and Michael W. Godfrey. Investigating technical and non-technical factors influencing modern code review. Empirical Software Engineering, 21(3):932-959, Jun 2016.
Mohammad Masudur Rahman and Chanchal K. Roy. An insight into the pull requests of GitHub. In Working Conference on Mining Software Repositories, pages 364-367. ACM, 2014.
Di Chen, Kathryn T. Stolee, and Tim Menzies. Replication can improve prior results: A github study of pull request acceptance. In Proceedings of the 27th International Conference on Program Comprehension, ICPC'19, pages 179-190, Piscataway, NJ, USA, 2019. IEEE Press.
Y. Yu, H. Wang, V. Filkov, P. Devanbu, and B. Vasilescu. Wait for it: Determinants of pull request evaluation latency on GitHub. In Working Conference on Mining Software Repositories, pages 367-371, May 2015.
Jason Tsay, Laura Dabbish, and James Herbsleb. Influence of social and technical factors for evaluating contribution in GitHub. In International Conference on Software Engineering, pages 356-366. ACM, 2014.
Igor Steinmacher, Gustavo Pinto, Igor Scaliante Wiese, and Marco A. Gerosa. Almost there: A study on quasi-contributors in open source software projects. In Proceedings of the 40th International Conference on Software Engineering, ICSE '18, pages 256-266, New York, NY, USA, 2018. ACM.
M. Wessel, I. Steinmacher, I. Wiese, and M. A. Gerosa. Should i stale or should i close? an analysis of a bot that closes abandoned issues and pull requests. In 2019 IEEE/ACM 1st International Workshop on Bots in Software Engineering (BotSE), pages 38-42, May 2019.
Damien Legay, Alexandre Decan, and Tom Mens. On the impact of pull request decisions on future contributions. arXiv e-prints, page arXiv:1812.06269, Dec 2018.
Y. Yu, H. Wang, G. Yin, and C. X. Ling. Reviewer recommender of pull-requests in GitHub. In International Conference on Software Maintenance and Evolution, pages 609-612. IEEE, Sep. 2014.
Y. Yu, H. Wang, G. Yin, and C. X. Ling. Who should review this pull-request: Reviewer recommendation to expedite crowd collaboration. In Asia-Pacific Software Engineering Conference, volume 1, pages 335-342, Dec 2014.
Manoel Limeira de Lima Júnior, Daricélio Moreira Soares, Alexandre Plastino, and Leonardo Murta. Developers assignment for analyzing pull requests. In ACM Symposium on Applied Computing, pages 1567-1572. ACM, 2015.
Jing Jiang, J.-H He, and X.-Y Chen. Coredevrec: Automatic core member recommendation for contribution evaluation. Journal of Computer Science and Technology, 30:998-1016, 09 2015.
Manoel Limeira de Lima Júnior, Daricélio Moreira Soares, Alexandre Plastino, and Leonardo Murta. Automatic assignment of integrators to pull requests: The importance of selecting appropriate attributes. Journal of Systems and Software, 144:181 - 196, 2018.
E. V. D. Veen, G. Gousios, and A. Zaidman. Automatically prioritizing pull requests. In Working Conference on Mining Software Repositories, pages 357-361. IEEE, May 2015.
Ayushi Rastogi, Nachiappan Nagappan, Georgios Gousios, and André van der Hoek. Relationship between geographical location and evaluation of developer contributions in github. In International Symposium on Empirical Software Engineering and Measurement. ACM, 2018.
Josh Terrell, Andrew Kofink, Justin Middleton, Clarissa Rainear, Emerson Murphy-Hill, and Chris Parnin. Gender bias in open source: Pull request acceptance of women versus men. 01 2016.
Felipe Ebert, Fernando Castor, Nicole Novielli, and Alexander Serebrenik. Confusion in code reviews: Reasons, impacts, and coping strategies. pages 49-60, 02 2019.
Vasiliki Efstathiou and Diomidis Spinellis. Code review comments: Language matters. CoRR, abs/1803.02205, 2018.
M. M. Rahman and C. K. Roy. Impact of continuous integration on code reviews. In 2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR), pages 499-502, May 2017.
L. MacLeod, M. Greiler, M. Storey, C. Bird, and J. Czerwonka. Code reviewing in the trenches: Challenges and best practices. IEEE Software, 35(4):34-42, July 2018.
O. Kononenko, O. Baysal, and M. W. Godfrey. Code review quality: How developers see it. In 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE), pages 1028-1038, May 2016.
Eirini Kalliamvakou, Georgios Gousios, Kelly Blincoe, Leif Singer, Daniel M. German, and Daniela Damian. The promises and perils of mining GitHub. In Int'l Conf. Mining Software Repositories, pages 92-101. ACM, 2014.
Jeremy Katz. Libraries.io open source repository and dependency metadata (version 1.4.0) [data set]. http://doi.org/10.5281/zenodo.2536573, 2018.
N. Cliff. Dominance statistics: Ordinal analyses to answer ordinal questions. Psychological Bulletin, 114(3):494-509, 1993. cited By 364.
Jeanine Romano, Jeffrey D Kromrey, Jesse Coraggio, Jeff Skowronek, and Linda Devine. Exploring methods for evaluating group differences on the NSSE and other surveys: Are the t-test and Cohen's d indices the most appropriate choices? In Annual Meeting of the Southern Association for Institutional Research, 2006.
C. Wohlin, P. Runeson, M. Host, M. C. Ohlsson, B. Regnell, and A. Wesslen. Experimentation in Software Engineering - An Introduction. Kluwer, 2000.