Paul Ralph’s research while affiliated with Dalhousie University and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (109)


Teaching Software Metrology: The Science of Measurement for Software Engineering
  • Preprint

June 2024

·

10 Reads

Paul Ralph

·

·

·

While the methodological rigor of computing research has improved considerably in the past two decades, quantitative software engineering research is hampered by immature measures and inattention to theory. Measurement-the principled assignment of numbers to phenomena-is intrinsically difficult because observation is predicated upon not only theoretical concepts but also the values and perspective of the research. Despite several previous attempts to raise awareness of more sophisticated approaches to measurement and the importance of quantitatively assessing reliability and validity, measurement issues continue to be widely ignored. The reasons are unknown, but differences in typical engineering and computer science graduate training programs (compared to psychology and management, for example) are involved. This chapter therefore reviews key concepts in the science of measurement and applies them to software engineering research. A series of exercises for applying important measurement concepts to the reader's research are included, and a sample dataset for the reader to try some of the statistical procedures mentioned is provided.



Teaching Literature Reviewing for Software Engineering Research

June 2024

·

5 Reads

The goal of this chapter is to support teachers in holistically introducing graduate students to literature reviews, with a particular focus on secondary research. It provides an overview of the overall literature review process and the different types of literature review before diving into guidelines for selecting and conducting different types of literature review. The chapter also provides recommendations for evaluating the quality of existing literature reviews and concludes with a summary of our learning goals and how the chapter supports teachers in addressing them.


Creativity, Generative AI, and Software Development: A Research Agenda
  • Preprint
  • File available

June 2024

·

136 Reads

Victoria Jackson

·

·

·

[...]

·

Creativity has always been considered a major differentiator to separate the good from the great, and we believe the importance of creativity for software development will only increase as GenAI becomes embedded in developer tool-chains and working practices. This paper uses the McLuhan tetrad alongside scenarios of how GenAI may disrupt software development more broadly, to identify potential impacts GenAI may have on creativity within software development. The impacts are discussed along with a future research agenda comprising six connected themes that consider how individual capabilities, team capabilities, the product, unintended consequences, society, and human aspects can be affected.

Download


Distributed Scrum: A Case Meta-Analysis

October 2023

·

129 Reads

·

2 Citations

ACM Computing Surveys

Distributed Scrum adapts the Scrum project management framework for geographically distributed software teams. Experimentally evaluating the effectiveness of Distributed Scrum is impractical, but many case studies and experience reports describe teams and projects that used Distributed Scrum. This paper synthesizes the results of these cases using case meta-analysis, a technique for quantitatively analyzing qualitative case reports. On balance, the evidence suggests that Distributed Scrum has no impact, positive or negative on overall project success. Consequently, claims by agile consultants who present Distributed Scrum as a recipe for project success should be treated with great caution, while researchers should investigate more varied perspectives to identify the real drivers of success in distributed and global software development.





Post-pandemic Resilience of Hybrid Software Teams

March 2023

·

440 Reads

Background. The COVID-19 pandemic triggered a widespread transition to hybrid work models (combinations of co-located and remote work) as software professionals' demanded more flexibility and improved work-life balance. However, hybrid work models reduce the spontaneous, informal face-to-face interactions that promote group maturation, cohesion, and resilience. Little is known about how software companies can successfully transition to a hybrid workforce or the factors that influence the resilience of hybrid software development teams. Goal. The purpose of this study is to explore the relationship between hybrid work and team resilience in the context of software development. Method. Constructivist Grounded Theory was used, based on interviews of 26 software professionals. This sample included professionals of different genders, ethnicities, sexual orientations, and levels of experience. Interviewees came from eight different companies, 22 different projects, and four different countries. Consistent with grounded theory methodology, data collection, and analysis were conducted iteratively, in waves, using theoretical sampling, constant comparison, and initial, focused, and theoretical coding. Results. Software Team Resilience is the ability of a group of software professionals to continue working together effectively under adverse conditions. Resilience depends on the group's maturity. The configuration of a hybrid team (who works where and when) can promote or hinder group maturity depending on the level of intra-group interaction it supports. Conclusion. This paper presents the first study on the resilience of hybrid software teams. Software teams need resilience to maintain their performance in the face of disruptions and crises. Software professionals strongly value hybrid work; therefore, team resilience is a key factor to be considered in the software industry.


Citations (74)


... Our LLM-assisted systematic review revealed a significant number of research projects related to review automation with LLM. Indeed, other researchers have noted promising results 15 for LLMs in different areas, such as understanding human language and generating contextually appropriate responses [20][21][22] . ...

Reference:

The emergence of Large Language Models (LLM) as a tool in literature reviews: an LLM automated systematic review
The Promise and Challenges of Using LLMs to Accelerate the Screening Process of Systematic Reviews
  • Citing Conference Paper
  • June 2024

... There are a quite few attempts to discuss ethics around using AI solutions for engineering of software system. One of the most fundamental works in this domain is the Copenhagen manifesto [16]. It revolves around an idea that AI in software engineering must be human-centred and lists 12 principles to guide adoption of AI in software engineering. ...

Generative AI in Software Engineering Must Be Human-Centered: The Copenhagen Manifesto

Journal of Systems and Software

... In other words, the SE field lacks an effective cumulative tradition. For example, there are over 100 case studies on the use of agile methods in distributed development [33]. Through a carefully crafted introduction, many papers over-rely on 'spotting the gap,' i.e., identifying the study that hasn't been done, without aiming to see the forest for the trees. ...

Distributed Scrum: A Case Meta-Analysis
  • Citing Article
  • October 2023

ACM Computing Surveys

... Eco-friendly software solutions consume less energy and fewer resources. Eco-friendly software solutions encourage software developers and other stakeholders to implement social practices that help achieve sustainability objectives [35]. Table 1 presents green IT aspects and their relevance to sustainability factors, based on analysis of the literature. ...

Sustainability is Stratified: Toward a Better Theory of Sustainable Software Engineering
  • Citing Conference Paper
  • May 2023

... For many professionals, this is a chance to keep the exibility gained from remote work, such as dealing with personal responsibilities (e.g., parenting) and avoiding commuting [17,34]. However, for those belonging to underrepresented groups, embracing hybrid work entails breaking down the various barriers they previously faced when working exclusively on-site [11,12]. ...

Benefits and Limitations of Remote Work to LGBTQIA+ Software Professionals
  • Citing Conference Paper
  • May 2023

... Building on our insights on how SEDs are shared (Section 3) and the problems we identi ed (Section 4.1), we want to stress the need for quality controlling an SED that shall be shared. Since we already discussed these problems in detail within the respective sections and other researchers have discussed the general quality of mined SEDs [Bird et al., 2009, Chatterjee et al., 2022, Kalliamvakou et al., 2014, 2016, we now sketch two directions for future research that can help mitigate the problems and that are persisting problems. First, we argue that we need to establish standardized analysis pipelines and frameworks. ...

Empirical standards for repository mining
  • Citing Conference Paper
  • October 2022

... As a consequence of the COVID-19 pandemic, software organizations have undergone a shift from traditional co-located work setups to fully remote (no central location; employees work from home or co-working spaces) and hybrid setups (employees alternate between office and remote work on specific days) (de Souza Santos and Ralph, 2022). As we move beyond the pandemic, software organizations are reevaluating their workplace strategies to align with the changing dynamics of the workforce. ...

A grounded theory of coordination in remote-first and hybrid software teams

... Welcomeness is a construct investigated in the context of the inclusion of minorities in other areas, like, A [37], Education [38,39], Sports [38], International Relations [40], and Healthcare [41]. While there is no previous work specifically focusing on welcomeness in software engineering, it antecedes the sense of belonging [35]-which was the focus on recent studies in software engineering teams context [12,42,43]. ...

What makes effective leadership in agile software development teams?

... More recent methodological guidelines have pointed towards more inclusive definitions of surveys, e.g., [50], [51]. This decision is probably influenced by the increasing interest on human and social aspects of SE [52], [53]. The ACM SIGSOFT Empirical Standards [17] have a dedicated entry for questionnaire surveys describing it as "a study in which a sample of respondents answers a series of (mostly structured) questions, typically through a computerized or paper form." ...

Social science theories in software engineering research