Marcus Ciolkowski

Marcus Ciolkowski
QAware

Dr. rer. nat.

About

72
Publications
16,300
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
1,473
Citations
Additional affiliations
January 2020 - present
QAware
QAware
Position
  • Consultant
January 2017 - December 2019
QAware
Position
  • Consultant
August 2011 - present
QAware
QAware
Position
  • Business Architect

Publications

Publications (72)
Article
Full-text available
Delivering increasingly complex software-reliant systems demands better ways to manage the long-term effects of short-term expedients. The technical debt (TD) metaphor has gained significant traction as a way to understand and communicate such issues. Almost 25 years after the term was coined in 1992 by Ward Cunningham, and more than 10 years after...
Conference Paper
Full-text available
Background: Technical debt is a metaphor for trading software quality for business goals, reminding actors of the deferred cost associated with such trade-offs. The bulk of the literature on technical debt focuses on source code quality debt. Much less research is devoted to other forms of technical debt, such as documentation debt or architecture...
Conference Paper
Full-text available
Existing definitions and metrics of technical debt (TD) tend to focus on static properties of software artifacts, in particular on code measurement. Our experience from software renovation projects is that dynamic aspects-runtime indicators of TD-often play a major role. In this position paper, we present insights and solution ideas gained from num...
Chapter
Full-text available
Important and critical aspects of technical debt often surface at runtime only and are difficult to measure statically. This is a particular challenge for cloud applications because of their highly distributed nature. Fortunately, mature frameworks for collecting runtime data exist but need to be integrated. In this paper, we report an experience...
Conference Paper
Full-text available
Due to cost and time constraints, software quality is often neglected in the evolution and adaptation of software. Thus, maintainability suffers, maintenance costs rise, and the development takes longer. These effects are referred to as “technical debt”. The challenge for project managers is to find a balance when using the given budget and schedul...
Conference Paper
Full-text available
Context/Background: To achieve high software quality , particularly in the context of agile software development, organizations need tools to continuously analyze software quality. Several quality management (QM) tools have been developed in recent years. However, there is a lack of evidence regarding the quality of QM tools, standardized definitio...
Conference Paper
Full-text available
Continued development and maintenance of software requires understanding its design and behavior. Software at runtime creates a complex network of call--callee relationships that are hard to determine but that developers need to understand to optimize software performance. Existing tools typically focus on static aspects (e.g., Structure101 or Sona...
Presentation
Full-text available
Kontinuierliche Beurteilung der Qualitätsschulden beflügelt die Qualität von Softwareprojekten, für Sanierungsprojekte ebenso wie für Projekte auf der „grünen Wiese“. Wichtig sind die agilen Prinzipien kontinuierliches Feedback und Vermeidung von Broken Windows. See also: https://www.slideshare.net/QAware/bewertung-von-qualittsschulden-mit-dynamisc...
Conference Paper
Full-text available
Die Herausforderung in vielen Big-Data-Projekten ist die Analyse und Modellierung von Datenlandschaften. Es gibt Datenlandschaften aus sehr vielen potenziellen Datenquellen, in denen Daten teilweise redundant und leicht abweichend abgelegt sind. Das Ziel: heterogene Datentöpfe in einen homogenen Datenbestand überführen, der sich dann integriert dur...
Thesis
Empirical studies are necessary to gain reliable insights into the effects of software engineering technologies and to allow controlling risks associated with their usage. //Recently, many empirical studies have been run in many software engineering areas (e.g., inspections). However, in order to be useful for decision-making, synthesis is required...
Conference Paper
Full-text available
Within the framework of a project, a variety of known and unknown problems and difficulties in collaboration may occur, which affect how the success of a project is perceived. The goal of our research is to identify factors that influence the perceived success of a project in order to be able to take early countermeasures if project success is thre...
Conference Paper
Full-text available
The role of software quality is constantly increasing in industry. As a consequence, many techniques have been applied to assess, predict and improve quality. For ex-ample, in early development phases, design complexity metrics are considered use-ful indicators of software reliability. Although many studies investigate the rela-tionship between com...
Article
This article demonstrates the benefits of employing Open Source Software (OSS) in compliance with GAMP for the validation of computerized pharmaceutical applications.
Conference Paper
One of the main challenges in empirical software engineering today lies in the aggregation of evidence. Existing summaries often use qualitative narrative approaches or ad-hoc quantitative methods, such as box plots. With these, information important for decision makers, such as existence and magnitude of a technology's effect, is hard to obtain ob...
Conference Paper
Full-text available
Open Source Software (OSS) has an increasing importance for the software industry. Similar to traditional (closed) software acquisition, OSS acquisition requires an assessment of whether its quality is sufficient for the intended purpose, and whether the chances of being maintained and supported in the future, as well as of keeping certain quality...
Conference Paper
Full-text available
For traditional software development, process maturity models (CMMI, SPICE) have long been used to assess expected product quality and project predictability. For the case of OSS, however, these models are generally perceived as inadequate. In practice, though, many OSS communities are well-organized, and there is evidence of varying levels of proc...
Article
Full-text available
Free and Open Source Software (F/OSS) has an increasing importance for the software industry. Similar to traditional (closed) software acquisition, F/OSS acquisition requires an assessment of whether its quality is sufficient for the intended purpose, and of whether the chances of being maintained and supported in the future, as well as of keeping...
Chapter
Full-text available
Open Source Software (OSS) has an increasing importance for the software industry. Similar to traditional (closed) software acquisition, OSS acquisition requires an assessment of whether quality is sufficient for the intended purpose. This includes assessing a software component’s intrinsic quality, as well as its supplier’s maturity (i.e., ability...
Article
Software inspections, reviews, and walkthroughs have become a standard process component in many software development domains. Maturity level 3 of the CMM-I requires establishment of peer reviews [12] and substantial sustained improvements in quality and productivity have been reported as a result of using reviews ([16], [21], [22], [27]). The NSF...
Article
Software inspections, reviews, and walkthroughs have become a standard process component in many software development domains. Maturity level 3 of the CMM-I requires establishment of peer reviews [12] and substantial sustained improvements in quality and productivity have been reported as a result of using reviews ([16], [21], [22], [27]). The NSF...
Conference Paper
For traditional software development, process maturity models (CMMI, SPICE) have long been used to assess product quality and project predictability. For OSS, on the other hand, these models are generally perceived as inadequate. In practice, though, many OSS communities are well-organized, and there is evidence of process maturity in OSS projects....
Conference Paper
Full-text available
Software project control is an essential component for project success. The basis of all control approaches is roughly the same: the collection and effective usage of measurement data to allow for quantitative decision making. But many organizations have problems with establishing project control mechanisms. On the one hand, this has something to d...
Article
The enormous changes in software engineering practice make it prudent to consider the interplay between software engineering research and practice. Toward that end, the authors provide an overall view of the motivations behind the Impact Project, the research methodology followed, and the project's development plan. They also explore more specific...
Conference Paper
In order to successfully conduct global development projects, one crucial success factor is the existence of well-specified and coordinated distributed development processes. Therefore, it is necessary to have efficient management and controlling mechanisms in place. Many companies are currently establishing so-called software cockpits for systemat...
Conference Paper
One means for institutionalizing project control, systematic quality assurance, and management support on the basis of measurement and explicit models is the establishment of so-called Software Project Control Centers. Nowadays many companies develop their own dashboards for project control or use off-the-shelf tools that provide a predefined funct...
Chapter
Full-text available
Background: One major problem for integrating study results into a common body of knowledge is the heterogeneity of reporting styles: (1) It is difficult to locate relevant information and (2) important information is often missing. Objective: A guideline for reporting results from controlled experiments is expected to support a systematic, standar...
Conference Paper
Full-text available
This paper studies various sources of information to identify factors that influence the evolvability of Free and Open-Source Software (FIOSS) endeavors. The sources reviewed to extract criteria are (1) interviews with FIOSS integrators, (2) the scientific literature, and (3) existing standard, norms as well as (4) three quality assessment methodol...
Conference Paper
Full-text available
A systematic approach to decision making in software engineering is required, for instance, if an organization aims at achieving CMMI level three. Rational decision making regarding the selection and introduction of SE technologies requires adequate information about their suitability for the intended organizational context. Research is often unabl...
Conference Paper
Full-text available
Many software development organizations still lack support for detecting and reacting to critical project states in order to achieve planned goals. One means to institutionalize project control, systematic quality assurance, and management support on the basis of measurement and explicit models is the establishment of so-called software project con...
Conference Paper
SOFTPIT 2007 is the first workshop on Measurement-based Cockpits for Distributed Software and Systems Engineering Projects. Its goal is to discuss technical and societal challenges for software cockpits in global software development projects.
Conference Paper
The workshop addresses practitioners and/or researchers who are interested in empirical software engineering, software process improvement, and quality management.Practitioners are being addressed specifically, since this workshop is also intended to find out what kind of information practitioners need, which kind of support they expect from resea...
Chapter
Full-text available
The increasing number of high quality open source software (OSS) components lets industrial organizations seriously consider integrating them into their software solutions for critical business cases. But thorough considerations have to be undertaken to choose the "right" OSS component for a specific business case. OSS components need to fulfill sp...
Chapter
Full-text available
The increasing number of high quality open source software (OSS) components lets industrial organizations seriously consider integrating them into their software solutions for critical business cases. But thorough considerations have to be undertaken to choose the “right” OSS component for a specific business case. OSS components need to fulfill sp...
Conference Paper
In today’s software development organizations, methods and tools are employed that frequently lack sufficient evidence regarding their suitability, limits, qualities, costs, and associated risks. For example, in Communications of the ACM (Communications of the ACM May 2004/Vol. 47, No. 5) Robert L. Glass, taking the standpoint of practitioners, ask...
Conference Paper
Full-text available
One of the most important challenges in empirical software engineering today is to better integrate empirical studies with decision support, and to collect appropriate data and experiments. The required steps are to identify the information needed, to collect appropriate studies, and to (objectively) aggregate (i.e., summarize) their results. To be...
Article
In this paper, we report the experiences of a working group who met, as part of the 2006 Dagstuhl Seminar on Empirical Software Engineering, to discuss the teaching of empirical methods to undergraduate students. The nature of the discussion meant that the group also indirectly considered teaching empirical methods to postgraduate students, mainly...
Article
Commonly agreed roadmaps are an indicator for mature research fields. This also implies that roadmaps are revised and updated on a regular basis. During the Dagstuhl seminar, four parallel working groups addressed this issue. This chapter summarizes the results of one discussion group. Instead of looking at the initial roadmap in its breadth, we de...
Article
The session was structured into fours parts: 1 Two presentations, which addressed the use of empirical validation in software engineering. 1 Two presentations about exploratory versus confirmatory experiments. 1 A working session, which addressed questions that arose from the presentations and which involved splitting into three working groups to...
Article
Full-text available
Understanding the effects of software engineering techniques and processes under varying conditions can be seen as a major prerequisite towards predictable project planning and guaranteeing software quality. Evidence regarding the effects of techniques and processes for specific contexts can be gained by empirical studies. Due to the fact that soft...
Conference Paper
Full-text available
Understanding the effects of software engineering techniques and processes under varying conditions can be seen as a major prerequisite towards predictable project planning and guaranteeing software quality. Evidence regarding the effects of techniques and processes for specific contexts can be gained by empirical studies. Due to the fact that soft...
Conference Paper
Full-text available
Scenario-based reading (SBR) techniques have been proposed as an alternative to checklists to support the inspectors throughout the reading process in the form of operational scenarios. Many studies have been performed to compare these techniques regarding their impact on the inspector performance. However, most of the existing studies have compare...
Conference Paper
Full-text available
The aggregation of studies is of growing interest for the empirical software engineering community, since the numbers of studies steadily grow. We discuss challenges with the aggregation of studies into a common body of knowledge, based on a quantitative and qualitative evaluation of experience from the Experimental Software Engineering Network, ES...
Conference Paper
Full-text available
Inspections are an established quality assurance technique. In order to optimize the inspection performance, different reading techniques, such as checklist-based reading and scenario-based reading have been proposed. Various experiments have been conducted to evaluate which of these techniques produces better inspection results (i.e., which finds...
Conference Paper
Full-text available
Inspections are an established quality assurance technique. In order to optimize the inspection approach, different reading techniques, such as checklist -based reading and scenario-based reading have been proposed. Various experiments have been performed to evaluate which of these techniques produces better inspection results (i.e., finds more def...
Conference Paper
This paper first reasons on understanding software frameworks for defect detection, and then presents an experimental research for comparing the effectiveness and defect detection rate of code-reading techniques, once applied to C++ coded object-oriented frameworks. We present and discuss the functionality-based approach to framework understanding....
Conference Paper
Software process improvement needs sound empirical data gathered from a range of empirical studies such as controlled experiments or case studies. However, conducting empirical studies is often cost-intensive; in particular in industrial environments. Therefore, we need to find a way to balance cost and value of empirical findings. In This work, we...
Article
Full-text available
A survey investigating the practices used in the software industry to carry out software reviews is presented. Software review is the examination of software products that focuses on finding defects in software which is conducted by developers and must be conducted as a part of development process. It was concluded that for the software development...
Conference Paper
In the embedded systems domain, statecharts have become an important technique to describe the dynamic behavior of a software system. In addition, statecharts are an important element of object-oriented design documents and are thus widely used in practice. However, not much is known about how to inspect them. Since their invention by Pagan in 1976...
Conference Paper
A survey is an empirical research strategy for the collection of information from heterogeneous sources. In this way, survey results often exhibit a high degree of external validity. It is complementary to other empirical research strategies such as controlled experiments, which usually have their strengths in the high internal validity of the find...
Conference Paper
One purpose of empirical software engineering is to enable an understanding of factors that influence software development. Surveys are an appropriate empirical strategy to gather data from a large population (e.g., about methods, tools, developers, companies) and to achieve an understanding of that population. Although surveys are quite often perf...
Article
Full-text available
For a growing population of researchers in software engineering, empirical studies have become a key approach of research. Empirical studies may be used, for example, to evaluate technologies and help to direct further research by revealing what problems and difficulties people have in practice. Without empirical studies, we have to rely only on in...
Conference Paper
Full-text available
Presents some of the history of software inspections, walkthroughs and reviews. This shows that inspections are related to research efforts back in the 1970s. An example success story is briefly described to illustrate how research has impacted industrial software development practice in this area. The success story was the result of researchers an...
Conference Paper
Software inspections are commonly used throughout the software industry, but there are still open questions about the relationship between inspection processes and inspection effectiveness. For example, which techniques work best in various environments? Are requirements specifications inspections and code inspections different in terms of effectiv...
Article
Die bisherigen Forschungsarbeiten im Bereich Software Engineering befassten sich überwiegend mit der Entwicklung von neuen Techniken, Methoden, und Werkzeugen zur Lösung von Problemen in der Softwareentwicklung. Das Ergebnis dieser Arbeiten ist eine Vielzahl von Technologien, deren Vor- und Nachteile nur in den seltensten Fällen mit Hilfe von empir...
Article
Full-text available
Abstract The growing,pervasiveness of software increases the pressure for companies,to ensure the quality of their developed,products. Although,quality assurance,ac- tivities are increasingly gaining momentum in the software industry, it is esti- mated,that 30 to 50% of total software project costs are spent for (unsystem- atic) defect detection an...
Chapter
In the long run, high quality of software is prerequisite for software companies to survive. Inspections of software products help to detect and remove errors in software development early and cost-effectively. Thus, they help to enhance the quality of software products. One main goal in practice is, for a given situation, to select a suitable insp...
Technical Report
Full-text available
Inspection is considered a powerful method to detect defects in a software artifact. It is reported that savings are particularly high if inspections are used in early phases of the software development process, i.e. in the requirements definition phase. However, only few systematic techniques exist to support defect detection in requirements docum...
Article
Full-text available
Agile methods are becoming more and more popular. Most well known among them is probably Extreme Programming (XP) [2]. One key practice of XP is Pair Programming (PP), where two developers work simultaneously on a programming task. However, despite their popularity, few is known about limitations of these methods in terms of empirical knowledge. So...
Article
Full-text available
This paper studies various sources of information to identify factors that influence the evolvability of Free and Open-Source Software (FlOSS) endeavors. The sources reviewed to extract criteria are (1) interviews with FlOSS integrators, (2) the scientific literature, and (3) existing standard, norms as well as (4) three quality assessment methodol...

Network

Cited By

Projects

Projects (4)
Archived project
Archived project
Archived project