Conference PaperPDF Available

Implementing Process Improvement in Very Small Enterprises with ISO/IEC 29110 - A Multiple Case Study Analysis

Authors:

Abstract and Figures

This paper outlines the details of nine case studies involving the pilot usage of the new ISO/IEC 29110 Lifecycle Profiles for Very Small Entities standards and guides, which were specifically designed to address the standardization needs of Very Small Entities. The purpose of this paper is to disseminate the early success stories from pilot trials of this new and emerging standard. The lessons learnt from these case studies should assist the adoption of this new standard in an industrial setting.
Content may be subject to copyright.
QUATIC 2016, Lisbon, Portugal, September 6-9, 2016
Implementing Process Improvement
in Very Small Enterprises with ISO/IEC 29110
A Multiple Case Study Analysis
Claude Y. Laporte
Department of Software and IT Engineering
École de technologie supérieure
Montréal, Canada
Claude.Laporte@etsmtl.ca
Rory V. O’Connor
School of Computing
Dublin City University
Dublin, Ireland
Rory.OConnor@dcu.ie
Abstract This paper outlines the details of nine case studies
involving the pilot usage of the new ISO/IEC 29110 Lifecycle
Profiles for Very Small Entities standards and guides, which
were specifically designed to address the standardization needs of
Very Small Entities. The purpose of this paper is to disseminate
the early success stories from pilot trials of this new and
emerging standard. The lessons learnt from these case studies
should assist the adoption of this new standard in an industrial
setting.
Keywords—ISO Standards, ISO/IEC 29110, VSE
I. INTRODUCTION
In terms of software development, small and very small
companies typically have the challenge of handling multiple
small-scale, fast-moving projects, which allow little room for
heavy-weight management processes, but still requiring an
efficient and straightforward monitoring process [1]. Moreover,
due to the small number of people involved in the project and
the organization, most of the management processes are
performed through an informal way [2] and less documented
[3]. Furthermore there is an acknowledged lack of adoption of
standards in small and very small companies (for example see
studies such as [4]) as the perception is that they have been
developed for large software companies and not with the small
organisation in mind [5]. The perception of heavyweight
processes, especially in terms of documentation, cost and
nonalignment with current development process, are among the
reasons why many companies do not plan to adopt a lifecycle
standard in the short to medium term [6].
Industry recognizes the value of Very Small Entities
(VSEs), i.e., enterprises, organizations (e.g. government
agencies and non-profit organizations), departments or projects
with up to 25 people, in contributing valuable products and
services. A large majority of enterprises worldwide are VSEs.
The term VSE has been defined as being “an enterprise,
organization, department or project having up to 25 people
[7]. Accordingly, the new standard ISO/IEC 29110 “Lifecycle
profiles for Very Small Entities” is aimed at meeting the
specific needs of VSEs [8]. The overall objective of this new
standard is to assist and encourage very small software
organization in assessing and improving their software process.
The approach [9] used to develop ISO/IEC 29110 started with
the pre-existing international standards, such as the systems
and software life cycle standards ISO/IEC/IEEE 15288 and
ISO/IEC/IEEE 12207 and the documentation standard
ISO/IEC/IEEE 15289.
The ISO/IEC working group behind the creation of this
ISO/IEC 29110 is encouraging the use of pilot projects as a
mean to accelerate the adoption of the standard by VSEs [10,
11]. To date a series of individual pilot projects (such as [12,
13]) have been completed in several countries, however this
paper brings together a series of 9 case studies of ISO/IEC
29110 implementations in a Canadian context in a more
comprehensive case study setting.
II. THE ISO/IEC 29110 STANDARD
A. Background history of ISO/IEC 29110
The overall approach [14] followed by the ISO/IEC JTC1
SC7 working group 24 mandated to develop the new set of
standards and guides for VSEs.
The basic requirements of a software development process
are that it should fit the needs of the project and aid project
success [15, 16]. And this need should be informed by the
situational context where in the project must operate and
therefore, the most suitable software development process is
contingent on the context [17, 18]. The core situational
characteristic [19] of the entities targeted by ISO 29110 (ISO
29110 hereon) is size.
At the core the Basic Profile of this standard is a
Management and Engineering Guide, officially know as
ISO/IEC TR 29110-5-1-2 [20], which focuses on Project
Management and Software Implementation as illustrated in
Figure 1. The purpose of the Basic Profile is to define Software
Implementation (SI) and Project Management (PM) processes
from a subset of ISO/IEC/IEEE 12207 and artefacts from
ISO/IEC/IEEE 15289 appropriate for VSEs. The main reason
to include project management is that the core business of
VSEs is software development and their financial success
depends on successful project completion within schedule and
on budget, as well as on making a profit.
QUATIC 2016, Lisbon, Portugal, September 6-9, 2016
As illustrated in figure 1, the customer’s statement of work
(SOW) is used to initiate the PM process. The project plan will
be used to guide the execution of the software requirements
analysis, software architectural and detailed design, software
construction, and software integration and test, and product
delivery activities. Verification, validation, and test tasks are
included in the SI process.
Fig. 1. ISO 29110 Basic profile processes and activities
The PM process closure activity will deliver the Software
Configuration (i.e. a set of software products such as
documentation and code) and will obtain the customer’s
acceptance to formalize the end of the project.
B. Deployment Assistance
A novel approach taken to assist VSEs with the deployment
of ISO 29110 and to provide guidance on the actual
implementation of the Management and Engineering Guides in
VSEs, a series of Deployment Packages (DPs) have been
developed to define guidelines and explain in more detail the
processes defined in the ISO 29110 profiles [21]. The elements
of a typical DP are: description of processes, activities, tasks,
steps, roles, products, templates, checklists, examples,
references and mapping to standards and models, and a list of
tools. The mappings show that a deployment package has
explicit links to standards, such as ISO/IEC/IEEE 12207, or
models, such as the CMMI® for Development (CMMI-DEV).
Hence by implementing a DP, a VSE can see its concrete step
to achieve or demonstrate coverage [22].
DPs were designed such that a VSE can implement its
content, without having to implement the complete ISO/IEC
29110 framework, i.e. of all the management and engineering
activities, at the same time. A set of nine DPs have been
developed in English, translated in Czech and Spanish, to date
and are freely available from [23].
III. IMPLEMENTATION CASE STUDIES
In this section we will present a brief review of 9 case
studies of ISO 29110 implementations in a Canadian context.
The purpose of these case studies was to disseminate the early
success stories from pilot trials of this new and emerging
standard. The lessons learnt from these case studies should
assist the adoption of this new standard in an industrial setting.
A. Case 1: An IT Start-up
An implementation project has been conducted in an IT
start-up VSE by a team of two developers [24]. Their web
application allows users to collaborate, share and plan their
trips simply and accessible to all. The use of the Basic profile
of ISO 29110 has guided the start-up to develop an application
of high quality while using proven practices of ISO 29110. The
total effort of this project was nearly 1000 hours expending
only 13 percent of the total project effort on rework (i.e.,
wasted effort). The two members of the team were assigned
roles and activities of ISO 29110.
This project has demonstrated that, by using ISO 29110, it
was possible to properly plan the project and develop the
software product using proven software practices documented
in standards as well as not interfering with the creativity during
the development of their web site. People who think that
standards are a burden, an unnecessary overhead and a threat to
creativity should look at this start-up project and revisit their
results.
B. Case 2: A Canadian/Tunisian IT start-up
Metam is a company founded in 2013 by a software
engineering graduate student of ÉTS [25]. The company has
one site in Canada and one site in Tunisia. Its business domains
are software development services, web solutions, mobile
applications as well as consulting services to implement ERP
solutions. The Basic profile of ISO 29110 was used as the
framework for the company’s software processes. It was also
used as a foundation to start the implementation of CMMI-
DEV level 2 practices since it is requested by some military
contracts. In 2016, the VSE had 20 employees (18 employees
working in Tunisia). The VSE is planning to conduct an
independent ISO 29110 audit in 2016.
C. Case 3: A large IT consulting firm
A department of 9 people, of a large consulting firm of
about 1,000 employees with 7 offices in Canada and one office
in France, implemented the Basic profile. The company
specializes in the design, implementation, integration, and
support of management and accounting solutions, and in the
development of e-business operations. Once a decision has
been made to implement the Basic profile in a division, an
informal assessment of the practices in used against the Basic
profile was performed.
The division decided to focus its efforts in the software
implementation process the Basic profile of ISO 29110. On a
part-time basis, a few employees developed and implemented a
series of templates and tools using mainly Jira and Sharepoint.
It took about 180 hours of effort, on a part-time basis, over a
period of 8 months to develop and deploy the updated
processes. The new tasks have been implemented gradually
over a period of 3 months. Since January 2015, all employees
of the division must use the updated processes. The division is
also looking to obtain an ISO 29110 certification.
D. Case 4: A large Canadian financial institution
The Cash Management IT department, of a large Canadian
financial institution, is responsible for the development and
maintenance of software tools used by traders. The software
Implementation
Process
Initiation
Analysis
Design
Construction
Integration
andtests
Delivery
Software
Configuration
Statementof
Work
Customer
OrganizationalManagement
Planning
ProjectManagementProcess
Evalu atio n
Closure
Execution
QUATIC 2016, Lisbon, Portugal, September 6-9, 2016
team is composed of 6 people. Each year, the division is faced
with an increase in the numbers of requests to add, correct or
modify features related to supported applications. Before the
implementation of the ISO 29110-agile process, customers had
a series of complaints. In response to this problem, their
software process was evaluated by comparing the activities of
the maintenance process to those of the software Basic profile
of the ISO 29110. Some shortcomings were found in the
project management process and in the software
implementation process.
The new agile process, using the Basic profile of the ISO
29110, has been tested on three pilot projects. In this
organisation, an incident is classified as minor or major using a
set of criteria such as the number of impacted systems, the
severity, number of customers impacted and criticality of the
impact.
The new ISO 29110-agile process has been tested on three
pilot projects. The new process helped to significantly reduce
the number of major incidents caused by changes to the tools
of the traders. In this financial organisation, an incident is
classified as minor or major using a set of criteria such as the
number of impacted systems, the severity, number of
customers impacted and criticality of the impact. The criticality
is evaluated on a 1 (low impact) to 5 (high impact) scale [26].
Figure 2 illustrates the decrease in the numbers of systems
impacted as well as in the total criticality level.
Fig. 2. Reduction of the number of monthly incidents (Translated from
[26])
The users of the new process are delighted with the new
agile planning and control approach, which allows them to
better manage their priorities and to always know the status of
their requests. The maintenance team was also very pleased to
see an improvement in the quality of the change requests,
resulting in a noticeable decrease in the number of defects in
the software tools handed to traders.
E. Case 5: A division of a large Engineering Enterprise
A Canadian division of a large American engineering
company, the Transmission & Distribution of electricity
division, has implemented a program to define and implement
project management processes for their small-scale and
medium-scale projects [27]. The division, composed of about
15 project managers, already had a robust and proven process
to manage their large-scale projects. The objectives of this
process improvement project were to reduce cost overruns and
project delays, standardize practices to facilitate the integration
of new managers, increase the level of customer satisfaction
and to reduce risk-related planning deviations.
Pilot projects have been conducted to test the project
management processes and associated support tools (e.g.
templates, checklists). The pilot projects consisted of running
three different projects where project managers implemented
the process and the associated tools. Managers then evaluated
the proposed processes, identified problems and potential
improvements. The lessons learned sessions conducted at the
end of the pilot projects have identified minor adjustments to
the processes and tools.
The engineering enterprise estimated that, over a three-year
timeframe, savings of about 780,000$ CAD would be realized
due to the implementation of project management processes
using the ISO 29110. The engineering firm is planning to
document and implement their systems engineering (SE)
processes with ISO 29110.
F. Case 6: An Automotive Enterprise
TM4 is a Canadian company of 140 people (14 software
engineers), designs and sells electric powertrain systems in the
automotive field. Their products are embedded software that
controls the operation of engines in real time and software that
controls the interactions between the components of a vehicle.
ISO 29110 was used in this effort to improve its processes.
A coverage analysis was conducted to establish the difference
between the practices in place and those proposed by the ISO
29110. A pilot project has been successfully completed in May
2015. New projects use the ISO 29110-based processes.
An economic impact assessment of the implementation of
ISO 298110 was conducted using the methodology developed
by ISO [28].
G. Case 7: A large electricity provider
The IT division of a large Canadian electricity provider
already has implemented process areas of the CMMI-DEV. A
small department within the IT division, the Mobility and
Georeferenced Solutions department, is composed of 6
developers and 3 analysts, an architect and a manager. Typical
projects of the department are requests from internal customers
to improve a few applications. Due to the increased area of
mobility, the small department was required to develop
applications more quickly, and with very different
technologies. Increasingly, the department had to develop
proof of concepts. The problem was that the deliverables
requested by the current methodology for typical projects of the
IT division were too numerous, the level of documentation
required was not suitable for small projects and small teams.
A project was launched within the small department to
tailor ISO 29110 to their needs and adapted to a Scrum
approach. A pilot project, involving the creation of a web
application for property management, has been conducted. This
application greatly facilitated geographic data consultation.
The use of ISO 29110 gave the team short and long-term
benefits. The use of proven practices quickly improved the
QUATIC 2016, Lisbon, Portugal, September 6-9, 2016
quality and quantity of the software application developed. By
centralizing the data of geographical maps, their customers no
longer have to update them. In addition, geographical
information is more uniform across the enterprise. The ISO
29110 pilot project allowed the small department of 11 people
to shine within the IT division, as it became a model for future
small IT projects. About 9.6% of the 1,500-hour project has
been expended on rework. For a large IT division, of close to
2000 people, the benefits of the ISO 29110 implementation are
always welcomed for a public utility provider.
H. Case 8: A medical R&D VSE
A project has been conducted to develop and implement a
quality management system for a medical R&D company of 15
employees. The VSE manufactures a family of neuronavigation
products which are used in over 400 laboratories around the
world in the fields of cognitive neuroscience, rehabilitation
research and veterinary sciences. This project improved the
business processes and implemented a quality management
system in accordance with the ISO 13485 medical standard.
This project used the ISO 29110 systems engineering Basic
profile to facilitate the implementation of ISO 13485. ISO
29110 has guided the VSE in the development of tools, guides
and templates. During this project, totalling more than 1,000
hours of effort, the implementation of the quality system was
planned; processes, guides and templates were defined in
collaboration with key resources of the company. A pilot
project was conducted to validate the adequacy of the
established process. The use of ISO 29110 systems engineering
Basic profile facilitated the implementation and the adaptation
of a standard such as ISO 13485 for a VSE.
I. Case 9: A young transportation company
This project was created to define and implement project
management and SE processes at CSinTrans Inc. (CSiT), a
Canadian company, created in 2011 [29]. The company
specializes in the integration of interactive systems,
communication and security in the field of public transport
such as trains, subways and buses and railway stations, and
stations bus stops. ISO 29110 standards and guides for SE have
been used as the main reference for the development of the
processes [30]. Systems, in the context of ISO 29110, are
typically composed of hardware and software components.
ISO 29110 standard has helped raise the maturity of the
young organization by implementing proven practices and
developing uniform work products. ISO 29110 was a good
starting point to align processes with selected level 2 and 3
practices of the CMMI model. Table 1 illustrates the percent of
coverage of CSiT’ processes to CMMI-DEV.
TABLE I. COVERAGE OF CSIT PROCESSES TO CMMI-DEV
CMMI Level 2 Process Areas Percentage of Coverage
Configuration Management 50-70%
Measure and Analysis 20-40%
Project Monitoring and Control 70-90%
Project Planning 70-90%
Process and Product Quality Assurance 45-65%
Requirements Management 90-100%
Supplier Agreement Management 70-90%
Compliance with the ISO standard allowed CSiT to be
recognized as producing quality products. ISO 29110 has also
helped in developing lightweight processes allowing the VSE
to remain flexible as well as its ability to react quickly to its
customers.
Recently, the processes of CSiT, based on the Basic Profile
of the ISO 29110, have been successfully audited by a third-
party audit composed of 2 independent auditors. One member
of the audit team was a SE domain expert. In 2016, CSiT had
10 employees.
J. Additional case studies
Table II lists organizations involved in additional
completed ISO 29110 implementation activities in Canada.
TABLE II. ADDITIONAL CANADIAN PROJECTS
Description of
organization Project Description
An enterprise specialized
in industrial process
control.
A department of 13 employees
ISO 29110 Entry profile was used to
assess practices in use
The management of requirements
was the focus of the project
An IT start-up involved in
the development of web
traffic surveillance.
A start-up of 4 employees
Documentation of the software
development process using the Basic
p
rofile of ISO 29110
A large civil engineering
and construction firm.
A department of 15 people
responsible for the development and
maintenance of software for the
other units of the company.
After an analysis of current practices
using the Entry profile of ISO
29110, the firm implemented a
change request management process
IV. LESSONS LEARNED AND RECOMMENDATIONS
A few lessons have been learned as a result of the
implementation of ISO 29110 in VSEs.
A one-person VSE can learn from ISO 29110 to better
organize work and produce quality software. But, it would be
a bit premature to implement both processes of ISO 29110. It
would be better to implement first the Software
Implementation process of the Entry profile.
Many VSEs have never collected process or product
measures. The ISO 29110 management and engineering
guides of the Entry and Basic profiles list the tasks associated
to the collection and use of measures (e.g. resource, cost,
time). Unfortunately, the Entry and Basic profile guides do not
provide information about how to collect and analyze
measures.
The Entry and Basic profiles present a project management
process and development process using a waterfall lifecycle
notation. A few VSEs that were using agile approaches
complained about the notation used. The new ISO 29110
guides indicate that they do not require the waterfall lifecycle,
leaving VSEs to use the lifecycle that best suits their needs.
QUATIC 2016, Lisbon, Portugal, September 6-9, 2016
The addition of an annex in the guides describing agile
approaches should facilitate its implementation.
For VSEs that are developing systems, i.e. where hardware
components must be purchased and integrated, the SE Basic
profile does not provide an acquisition process. Such a process
is included in the Intermediate and Advanced profiles. This
deficiency has been reported to the ISO WG24. The second
edition of the SE Basic profile will correct this deficiency.
Most young VSEs are usually staffed with competent
technical people. Unfortunately, technical people are usually
not well trained in the management of projects. As illustrated
in one case, a VSE may start the implementation of ISO 29110
by first deploying the project management process. Since all
tasks are targeted at the project manager, developers could
keep doing their technical tasks without having to do the
management tasks of ISO 29110.
VSEs are often intimidated by the list of work products of
the management and engineering guides. A VSE may select to
combine work products (e.g. verification results and validation
results) in one document.
For many VSEs, it could be difficult to transition from an
environment where processes are often improvised and not
documented, to an environment where activities, tasks, roles
and content of work products are defined. Sometime,
employees do not understand the need to work according to
the company's process, thinking that it may burdening their
tasks and slowdown their projects. Without a strong leadership
and commitment of management, the transition will not
happen by itself.
The implementation of ISO 29110 on an ongoing project
may create confusion amongst developers and managers.
Since a majority of projects conducted by VSEs are not very
long, a better approach would be to let a project reach
completion. Only new projects will be using ISO 29110.
Before implementing ISO 29110 in a project, a VSE
should adapt the terminology (e.g. work product, role) of the
selected management and engineering guide to fit to the
terminology currently used by the VSE.
V. DISCUSSION
The pilot case studies presented in this paper have
demonstrated that by using ISO 29110, it was possible to
properly plan and execute projects and develop products or
conduct projects using proven system or software engineering
practices, thus proving wrong the perception that a process
standard interfere with the creativity of software developers.
The relationship between the success of a software company
and the software process it utilized has been investigated [31,
32] showing the need for all organizations, not just VSEs to
pay attention to software process practices such as ISO
standards.
Work currently underway on audit and assessment
mechanisms for ISO 29110, a clear niche market need is
emerging which may force the process assessment community
to change their views on how process assessments are carried
out for VSEs. It is clear that the process assessment community
will have to rethink process assessment, new methods and
ideas for assessing processes in VSEs.
In 2009, it was proposed by the project editor of ISO 29110
to establish an informal interest group about education. Its
main objective is to develop a set of courses for software
undergraduate and graduate students such that students learn
about the ISO standards for VSEs before they graduate.
One way to develop standards professionals is by having
professional graduate students involved in the application and
improvement of international standards. At the École de
technologie supérieure, a 10,000-student engineering school of
Montréal, International Software Engineering Standards are
introduced and used in Software Quality Assurance and
Software Process Improvement courses and industrial projects
conducted by graduate professional software engineering and
IT students [32].
The role of education is a significant issue in ensuring that
the next generation of software project managers and software
process engineers are both familiar with the benefits of
standards, specifically in VSEs and the role of ISO 29110 in
particular. Such education programmes may assist with
addressing the perceived issues with standards adoption and the
lack of managerial commitment in adopting VSE standards. In
2016, over 15 countries are teaching ISO 29110. As an
example, ISO 29110 is taught in 10 universities of Thailand as
well as in undergraduate and graduates courses in Canada.
As ISO 29110 is an emerging standard there is much work
yet to be completed [33]. The main remaining work item is to
finalize the development of the remaining two software profiles
of the Generic Profile Group: (a) Intermediate - targeted at
VSEs involved in the management of more than one project in
parallel with more than one work team (should be published by
ISO in 2016) and (b) Advanced - targeted at VSEs which want
to sustain and grow as an independent competitive system
and/or software development business. Once these software
profiles are ready, WG24 will develop matching SE profiles for
VSEs.
Similar to the existing set of software ISO 29110 TRs, the
systems engineering Management and Engineering Guides are
also available at no cost by ISO in English and French. A set of
systems engineering DPs and its application in a low-cost
autonomous rover has started [34]. In addition, Japanese,
Portuguese, Spanish and Check ISO 29110 documents are
available on Internet. A German version of the Basic profile
will be published by DIN next year.
ADDITIONAL INFORMATION:
The following Web site provides more information, as well
as articles by WG24 members and deployment packages for
software and systems engineering:
http://profs.logti.etsmtl.ca/claporte/English/VSE/index.html
REFERENCES
[1] Coleman, G., & O'Connor, R. V. (2008). An investigation into software
development process formation in software start-ups. Journal of
Enterprise Information Management, 21(6), 633-648.
QUATIC 2016, Lisbon, Portugal, September 6-9, 2016
[2] Basri, S., & O'Connor, R. V. 2010. Evaluation on knowledge
management process in very small software companies: a survey, 5th
Knowledge Management International Conference, Terengganu,
Malaysia, May 2010.
[3] O’Connor, R. V., & Laporte, C. Y., 2012. Software project management
in very small entities with ISO/IEC 29110 (pp. 330-341). Springer
Berlin Heidelberg
[4] Larrucea, X, O'Connor, R.V., Colomo-Palacios, R. and Laporte. C.,
"Software process improvement in very small organizations." IEEE
Software 33, no. 2 (2016): 85-89.
[5] O'Connor R. and Coleman G., Ignoring ‘Best Practice': Why Irish
Software SMEs are rejecting CMMI and ISO 9000, Australasian Journal
of Information Systems, Vol. 16, No. 1, 2009.
[6] Mora, M., O'Connor, R., Raisinghani, M., & Macías-Luévano, J. 2011.
An IT service engineering and management framework (ITS-EMF).
International Journal of Service Science, Management, Engineering, and
Technology, 2(2), 1-15.
[7] Laporte, C.Y., Alexandre, S., and O'Connor, R. A Software Engineering
Lifecycle Standard for Very Small Enterprises, R.V. O'Connor et al
(Eds) Proceedings of EuroSPI Springer-Verlag, CCIS Vol. 16, pp. 129-
141, 2008.
[8] O'Connor, R. and Laporte, C.Y., Deploying Lifecycle profiles for Very
Small Entities: An Early Stage Industry View, Proceedings of 11th
International SPICE Conference on Process Improvement and Capability
dEtermination, CCIS Vol. 155, Springer-Verlag, May 2011
[9] O'Connor, R. and Laporte, C.Y., Using ISO/IEC 29110 to Harness
Process Improvement in Very Small Entities, Workshop on SPI in
SMEs, 18th European Software Process Improvement Conference, CCIS
Vol. 172, Springer-Verlag, 2011.
[10] O'Connor R. and Laporte, C.Y., Towards the provision of assistance for
very small entities in deploying software lifecycle standards. In
Proceedings of the 11th International Conference on Product Focused
Software (PROFES '10). ACM, (2010)
[11] Laporte, C.Y., O'Connor, R., Fanmuy, G., International Systems and
Software Engineering Standards for Very Small Entities, CrossTalk -
The Journal of Defense Software Engineering, May/June 2013, Vol. 26,
No 3, pp 28-33
[12] O’Connor, R.,: Evaluating Management Sentiment Towards ISO/IEC
29110 in Very Small Software Development Companies. In: Mas, et al.
(eds.) Software Process Improvement and Capability Determination.
CCIS, vol. 290, pp. 277–281. Springer-Verlag, Heidelberg (2012).
[13] Ribaud, V., Saliou, P., O’Connor, R., Laporte, C.: Software Engineering
Support Activities for Very Small Entities. In: Riel, et al. (eds.) Systems,
Software and Services Process Improvement. CCIS, vol. 99, pp. 165–
176. Springer-Verlag, Heidelberg (2010).
[14] O'Connor, R. V. and Laporte, C. Y., 2014. An Innovative Approach to
the Development of an International Software Process Lifecycle
Standard for Very Small Entities, International Journal of Information
Technology and the Systems Approach, Vol. 7, No. 1, pp. 1-22.
[15] Clarke, P., O'Connor, R.V. 2011. The Meaning of Success for Software
SMEs: An Holistic Scorecard Based Approach. Systems, Software and
Services Process Improvement (EuroSPI 2011), CCIS, vol. 172, pp. 272-
83. Springer-Verlag, Heidelberg.
[16] O'Connor, Rory and Paul, Clarke (2015) Software process reflexivity
and business performance: initial results from an empirical study. In:
International Conference on Software and System Process (ICSSP
2015), 24-26 Aug 2015
[17] Clarke, P., O’Connor, R. V., Leavy, B., & Yilmaz, M. (2015). Exploring
the Relationship between Software Process Adaptive Capability and
Organisational Performance. Software Engineering, IEEE Transactions
on, 41(12), 1169-1183.
[18] Jeners, S., Clarke, P., O’Connor, R. V., Buglione, L., and Lepmets, M.
Harmonizing Software Development Processes with Software
Development Settings – A Systematic Approach, In McCafery, F.,
O'Connor, R.V. and Messnarz R. (Eds), Systems, Software and Services
Process Improvement, CCIS 364, Springer-Verlag, 2013
[19] Clarke, P. and O’Connor, R.V., 2012. The situational factors that affect
the software development process: Towards a comprehensive reference
framework. Information and Software Technology, 54(5), pp.433-447.
[20] ISO/IEC TR 29110-5-1-1:2011 – Software engineering – Lifecycle
Profiles for Very Small Entities (VSEs) –Part 5-1-1: Management and
engineering guide: Generic profile group: Entry profile, International
Organization for Standardization/International Electrotechnical
Commission: Geneva, Switzerland. Available at no cost from ISO at:
http://standards.iso.org/ittf/PubliclyAvailableStandards/index.html
[21] Laporte, C., O'Connor, R., Garcia Paucar, L., & Gerancon, B. (2015).
An innovative approach in developing standard professionals by
involving software engineering students in implementing and improving
international standards. Standards Engineering: The Journal of SES (The
Society for Standards Professionals), 67(2), 2-9.
[22] Laporte, C.Y., Palza Vargas, E., The Development of International
Standards to facilitate Process Improvements for Very Small
Enterprises, Book: “Software Process Improvement and Management:
Approaches and Tools for Practical Development” IGI Global Publisher.
USA. 2012, p 34-61.
[23] ISO/IEC 29110 Deployment Packages, available at
http://profs.logti.etsmtl.ca/claporte/English/VSE/index.html
[24] Laporte, C.Y., Hébert, C. and Mineau, C., 2014. Development of a
social network website using the new ISO/IEC 29110 standard
developed specifically for very small entities. Software Quality
Professional, 16(4).
[25] Jeljeli, H., Laporte, C.Y., Mise en oeuvre de processus logiciels à l'aide
de la norme ISO/CEI 29110 dans une grande entreprise en démarrage,
Revue Génie logiciel, Number 117, June 2016, pp. 34-41
[26] Plante, F., Développement et mise en oeuvre d’un processus de type
agile au sein de la direction solution trésorerie du mouvement
Desjardins, Rapport de projet de maitrise, École de technologie
supérieure, April 2015 [in French].
[27] Laporte, C. Y., Chevalier, F. (2016). An Innovative Approach to the
Development of Project Management Processes for Small-Scale Projects
in a Large Engineering Company. In K. Jakobs (Ed.), Effective
Standardization Management in Corporate Settings (pp. 123-160).
Hershey, PA
[28] Economic Benefits of Standards Methodology Handbook, International
Organization for Standardization, Geneva, Switzerland, 2010. Available
at no cost from ISO at:
http://www.iso.org/iso/home/standards/benefitsofstandards/benefits-
detail.htm?emid=6
[29] Laporte, C.Y., Tremblay, N., Menaceur, J., Poliquin, D., Houde, R.,
Developing and implementing systems engineering and project
management processes at CSIT - A small Canadian company in public
transportation, 26th Annual International Symposium of INCOSE
(International Council on Systems Engineering), Edinburgh, UK, July
18-21, 2016.
[30] ISO/IEC TR 29110-5-6-2:2014 - Systems Engineering – Lifecycle
Profiles for Very Small Entities (VSEs) – Part 5-6-2: Systems
engineering - Management and engineering guide: Generic profile
group: Basic profile, International Organization for
Standardization/International Electrotechnical Commission: Geneva,
Switzerland. Available at no cost from ISO at:
http://standards.iso.org/ittf/PubliclyAvailableStandards/
[31] O'Connor, R. V., and Basri, S. 2014. Understanding the role of
knowledge management in software development: a case study in very
small companies, International Journal of Systems and Service-Oriented
Engineering, Vol. 4, No. 1, pp. 39-52
[32] Laporte, C.Y., O'Connor, R, Software Process Improvement in Graduate
Software Engineering Programs, in: O’Connor, R.V., Mitasiunas, A. and
Ross, M. (Eds), Proceeding of the 1st International Workshop on
Software Process Education, Training and Professionalism (SPETP
2015), CEUR Electronic Workshop Proceedings, Vol. 1368, 2015, pp.
18–24.
[33] Laporte, C.Y., O’Connor, R.V., Systems and Software Engineering
Standards for Very Small Entities: Accomplishments and Overview,
IEEE Computer, Vol. 49, Issue 8, pp. 40-43.
[34] Houde, R., Laporte, C.Y., ISO/IEC 29110 Deployment Packages and
Case Study for Systems Engineering: The "Not-So-Secret" Ingredients
That Power the Standard, 26th Annual International Symposium of
INCOSE (International Council on Systems Engineering), Edinburgh,
UK, July 18-21, 2016.

Supplementary resource (1)

... Aware of the importance of VSE for the global economy, the ISO and the Joint Technical Committee for Standards of T.I (JTC1), define the ISO / IEC 29110 standard (Hereafter ISO 29110) [6]. ISO 29110 defines a set of good practices to be followed by the VSEs to guarantee a quality development process. ...
... Some works [6] [7] describe ISO 29110 implementations. However, few approaches describe guidelines for implementing these standards in specific environments. ...
Chapter
In today's globalized world, very small entities (VSE) are forced to guarantee process quality. This implies complying with international standards that offer guidelines for improving software processes and products. However, requirements of these standards are difficult to comply with for VSE. Previous works have described ISO 29110 implementations. However, few approaches describe guidelines for implementing these standards in specific environments. This paper describes a model approach for the implementation of good practices to the specific context of the Valle del Cauca region in Colombia.
... However, Very Small Entities (VSEs) that develop software frequently have problems to relate standards such as the ISO/IEC 29110 series to their business needs. VSEs often assume that implementing standards is costly, is intended for big organisations, requires the development of many documents, requires lot of time and human resources, which is not always the case [2] [3]. ...
... One entry condition for the use the ISO 29110 guides is that a project team, including project manager, is assigned and trained. Hence, there is a need to improve the software curriculum of university careers including the study of the norm ISO/IEC 29110, as proposed in [2]. Besides, it is highly recommended to also include the topic of traceability in the software curriculum of university careers and strengthen the development of traceability records in capstone projects. ...
... Three primary studies that have identified software engineering management are [73,56,74]. However, these papers primarily focus on software engineering processes [73,56] and software quality [74]. ...
... Three primary studies that have identified software engineering management are [73,56,74]. However, these papers primarily focus on software engineering processes [73,56] and software quality [74]. Although the Hunter-gatherer cycle presented by Nguyen-Duc et al. ...
Article
Full-text available
Software startups have long been a significant driver in economic growth and innovation. The on-going failure of the major number of startups calls for a better understanding of state-of-the-practice of startup activities. With a focus on engineering perspective, this study aims at identifying the change in focus of research area and thematic concepts operating startup research. A systematic mapping study on 74 primary papers (in which 27 papers are newly selected) from 1994 to 2017 was conducted with a comparison with findings from previous mapping studies. A classification schema was developed, and the primary studies were ranked according to their rigour. We discovered that most research has been conducted within the SWEBOK knowledge areas software engineering process, management, construction, design, and requirements, with the shift of focus towards process and management areas. We also provide an alternative classification for future startup research. We find that the rigour of the primary papers was assessed to be higher between 2013-2017 than that of 1994-2013. We also find an inconsistency of characterizing startups. Future work can focus on certain research themes, such as startup evolution models and human aspects, and consolidate the thematic concepts describing software startups.
... This was followed by an influx of research that also organised practice in the areas covered by the framework/standard. This is evidenced in literature with success factors with the VSE [72], [102], [117], [127] in which software development has become successful for general software and game development in different places, including Canada, Peru, Mexico and Finland. Although the dominance of software development and project management as knowledge areas most covered in literature is very important for software development efficiency in SSCs, it is also significant that equal attention is given to the other knowledge areas, including requirements engineering, software testing, and software maintenance. ...
Article
Full-text available
Small software companies face numerous challenges of complexity, unstructured software development processes and scarce resources. This notwithstanding, the companies have dominated the software market by 80 percent. The practice and products of these companies are still persistently marred by quality issues arising from the processes, with evidence indicating that process tools do not fit the unique contexts in which they operate. Significant strides have been made in transforming software development practice; however, the challenges are still evidently apparent. Hence the need to establish how knowledge areas are applied in process practice, understand the context of software development and its implication in practice, how process tools are utilised in practice and evaluate quality of research in software literature The researchers undertook a systematic mapping study to determine the state of practice in empirical literature on software engineering of SSCs by examining and classifying 1096 publications. Other than the finding that research quality was low and affecting generalisation and transferability, the results also revealed interesting findings which we finally consolidated and integrated to develop two contributions (i) a software development process adoption theoretical framework which provides new insights of understanding software development and (ii) a 3-point guideline for research quality.
... Although, for this to happen, in many countries it's necessary to certificate software quality process according to some standard. The ISO/IEC 29110 is a standard created to improve the competitiveness and global inclusion of companies dedicated to software development, especially small entities, organizations with 25 employees or less [2]. This standard defines the set of practices and minimum documentation for VSE in the process of software development life cycle [3]. ...
... Como resultado, se analizaron 111 estudios de caso, los cuales fueron descritos a través de 7 estudios primarios (Laporte & O'Connor, 2016), (Larrucea & Santamaria, 2016), (Muñoz, Mejía, & Laporte, 2019), (Wongsai, Siddoo, & Wetprasit, 2015), (Laporte & O'Connor, 2017), (Muñoz, Mejía, & Lagunas, 2018), (Muñoz, Mejía & Laporte 2018) (listados en la Tabla 1). En ellos, se identificaron 5 debilidades, como se muestra en la Figura 1. ...
Article
Full-text available
Due to the importance of Very Small Entities in the software industry, today, organizations such as ISO, are focused on the development of standards that push their competitiveness, reinforcing the use of proven software engineering practices, and being adequate to the specific characteristics of this type of organizations, such as the ISO/IEC 29110 series of standards. However, Very Small Entities have shown weaknesses in the implementation of this series. This article makes a comparison between the state of the art and the state of practice concerning the implementation of the ISO/IEC 29110 standard in very small entities. The results show that the main weaknesses are related to the lack of execution of verification and validation activities, and the development and/or documentation of cases and test procedures.
Chapter
While the quality of products is a competitive advantage for very small software development organizations, the usage of Software and Systems Engineering standards amongst such very small organizations is extremely low. A key factor in the literature explaining this lack of quality standards adoption is the perception by small and very small organizations that such standards have been developed for large multi-national companies and not with small and very small organizations in mind. The ISO/IEC 29110 standard is unique amongst software and systems engineering standards, in that the working group (ISO/IEC JTC1/SC7 WG 24) mandated to develop a new standard approached industry to conduct a needs assessment and gather actual requirements for a new standard as part of the standards development process. This paper presents a historical perspective behind the development of the ISO/IEC 29110 systems and software engineering standard and its constituent components, including the rationale behind its development and the innovative design of implementation guides to assist very small companies in adopting the standards. Further this paper will present an overview of the various parts of the ISO/IEC 29110 family and briefly present the plans for the future evolution of this series of standards.
Article
Full-text available
Paper concentrates on the ISO/IEC 29110 standard aimed at improving systems and software engineering life cycle processes in very small entities, which has been recently developed and started to be implemented worldwide. With the purpose to facilitate development and maintenance of this standard and its implementation in very small entities utilization of ArchiMate is proposed. The ArchiMate is a widely accepted open standard for modeling Enterprise Architecture supported by a variety of modeling tools, which was also successfully used beyond Enterprise Architecture domain. The contribution of this paper lies in (1) the development of the ISO/IEC 29110 Basic Profile Metamodel; (2) the definition of the mapping between the ISO/IEC 29110 Basic Profile Metamodel and ArchiMate; (3) its evaluation using the Bunge-Wand-Weber (BWW) model; (4) the application of the mapping resulting in the development of the ISO/IEC 29110 Basic Profile ArchiMate Model being implemented in a modeling tool that is freely available and can be used by VSEs, assessors and standard developers.
Experiment Findings
Full-text available
Overview of the accomplishments of the members of the ISO working group responsible for the development of the ISO/IEC 29110 series of standards and guides developed specifically for Very Small Entities (VSEs), i.e. enterprises, organizations (e.g. government agencies or non-profit organizations), departments or projects with up to 25 people developing software or systems. This text is divided in 3 sections: in section 2 we present the history of WG24 since the activities in 2004 that led to its establishment in 2005, the activities and document produced by WG24 up to 2015. In section 3, we briefly present ISO/IEC 29110 activities conducted in different countries. In section 4, we present detailed descriptions of ISO/IEC 29110 activities in a few countries (Belgium, Canada, Japan, Mexico, Peru and in Thailand).
Presentation
Full-text available
Very small entities (VSEs), organizations with up to 25 people, are very important to the worldwide economy. However, such organizations often do not utilize existing engineering and management standards and frameworks. To address the needs of Very Small Entities, a set of international standards and guides, the ISO/IEC 29110 series, has been developed using the systems and software engineering lifecycle standards ISO/IEC/IEEE 15288 and ISO/IEC/IEEE 12207 as the main frameworks. In addition, a series of deployment packages, developed by members of the INCOSE VSE WG, to facilitate the implementation of the ISO/IEC 29110, are discussed. Pilot projects, using the ISO/IEC 29110 freely available management and engineering guides, are presented as well as a cost and savings analysis. Finally, a certification scheme is discussed as well as the future developments.
Conference Paper
Full-text available
A project was created to define and implement project management and systems engineering processes at CSinTrans Inc. (CSiT), a Canadian company, founded in 2011. CSiT specializes in the integration of communication and security systems in transit industry such as trains, subways and buses as well as railway stations, subway stations and bus stops. ISO/IEC 29110 standard and guides for systems engineering have been used as the main reference for the development of these processes. The project's history, purpose and rationale that prompted CSiT to adopt this recently published standard are presented. The implementation of the standard is described. The reflections and decisions made during the implementation are presented. The lessons learned are discussed. Recommendations and advice for organizations wanting to implement ISO/IEC 29110 are described. ISO 29110 has helped raise the maturity of the organization by implementing proven practices and developing consistent work products from one project to another. ISO/IEC 29110 was a good starting point to align processes with specific practices of CMMI ® Maturity Levels 2 and 3. ISO/IEC 29110 has also helped CSiT with developing light processes as well as remaining flexible and quick in its ability to respond to its customers.
Article
Full-text available
L’Organisation internationale de normalisation (ISO) a développé la série de normes et de guides ISO/CEI 29110 afin d’aider les très petits organismes (TPO) à être plus efficaces et à produire des logiciels et des systèmes comportant du matériel de meilleure qualité. Depuis la publication de la norme en 2011, plusieurs projets d’implantation ont été effectués et ont abouti à l’adoption et à la mise en œuvre de la norme par plusieurs TPO à travers le monde. En plus des guides de gestion et d’ingénierie de l’ISO 29110, des trousses de déploiement, visant à faciliter la mise en œuvre de l’ISO 29110, ont été développées et sont disponibles sur internet. Cependant, il n’existe aucune recommandation spécifiant la façon d’aborder un projet d’implantation de la norme ni la séquence des activités à effectuer pour réussir un projet d’implantation de l’ISO 29110 dans un TPO. Le but de ce projet était, d’une part, de s’assurer que la norme est applicable, peu importe la taille de l’organisme, sa maturité ou son stade de développement. D’autre part, nous voulions formuler des recommandations visant à aider les TPO à mieux réussir des projets d’implantation de la norme. Pour ce faire, nous avons accompagné quatre entreprises à implanter l’ISO/CEI 29110. Ces entreprises sont de différentes tailles et elles utilisent des processus différents. Elles sont à des étapes différentes de leurs cycles de vie allant d’une entreprise en démarrage de 1 employé à une société de plus de 1,000 employés. Cet article relate le déroulement de chacune des expérimentations et se termine par la présentation de recommandations rédigées suite aux multiples observations faites durant l’implémentation dans les TPO de notre projet.
Conference Paper
Full-text available
Very small entities (VSEs) play an increasingly important role in the global economy. The products they develop are often integrated into products made by larger enterprises. Clients, furthermore, demand of the VSEs that they assume a much broader role, spanning the entire development life-cycle of the product instead of being limited to a " build-to-print " approach. The ISO/IEC 29110 systems engineering management and engineering guides were developed mainly from ISO/IEC/IEEE 15288 to address this new reality, to exploit the lean and efficient nature of VSEs and to adapt to their typical budget and resource constraints. By design, the management and engineering guide is supported by Deployment Packages (DP), the development of which was taken on by the INCOSE VSE Working Group. A DP is a set of artefacts designed to facilitate the implementation of the management and engineering guides of ISO/IEC 29110 by VSEs. In tune with the need for low cost and flexibility, Open Source software tools are emerging to support VSEs and provide a bridge with " Big League " development life-cycle toolsets. Finally, to make the deployment of ISO/IEC 29110 possible in VSEs, training packages, supported by relevant pilot projects help VSE personnel learn how to apply all of the above. This paper describes the Systems Engineering DP for Requirements Engineering (RE DP) and shows how it can be applied using the Autonomous Rover Case Study developed under the Eclipse Foundation Polarsys project.
Article
Full-text available
A large majority of organizations very small entities (VSEs)—commercial, government, or not-for-profit organizations; departments; or projects with up to 25 people who develop systems with hardware and software components and/or software products. Their products are sold to their customers directly or are integrated into those developed by larger organizations, possibly distributed to thousands of users worldwide, as illustrated in Figure 1. A supply chain of large products often has a pyramidal structure composed of many first, second and third level suppliers. If an undetected defect is left in a low level component, once this component is integrated in a higher level component, the defect may still be undetected. This defective component, once integrated in the final product, could result in a loss of millions of dollars by the manufacturer.
Article
Full-text available
Software process improvement (SPI) offers obstacles and opportunities for very small entities (VSEs), which are organizations with 25 or fewer employees. To help with this, the International Organization for Standardization and the International Electrotechnical Commission jointly developed ISO/IEC 29110 as SPI guidelines for VSEs.
Article
Full-text available
Software and systems engineering is distinct from other forms of engineering as it deals with an intangible product, where the progress in construction is not explicitly visible and team members often rely on the documentation of others to follow and review progress. Furthermore unlike traditional engineering disciplines, there is no single standardized unified process. The role of knowledge management in the software engineering literature is becoming more evident, as the software development activity is essentially a human knowledge intensive activity and is seen by many as a key factor. This paper discusses the role of software development knowledge management within software development process and specifically how software development knowledge is managed in software development in order to support software process improvement and the role of knowledge management in this. The authors present the results of a study of knowledge management process practices in very small software companies and discusses these under the major identified issues of: Communication; Learning and sharing; Documentation and Knowledge management process and commitment. The findings in this study give an insight towards knowledge management practices as they relate to software development process practices in very small companies and the important factors that must be considered to preserve knowledge and quality software.
Article
Full-text available
For very small software development companies, the quality of their software products is a key to competitive advantage. However, the usage of Software Engineering standards is extremely low amongst such very small software companies. A primary reason cited by many such companies for this lack of quality standards adoption is the perception that they have been developed for large multi-national software companies and not with small and very small organizations in mind and are therefore not suitable for their specific needs. This paper describes an innovative systematic approach to the development of the software process lifecycle standard for very small entities ISO/IEC 29110, following the Rogers model of the Innovation-Development process. The ISO/IEC 29110 standard is unique amongst software and systems engineering standards, in that the working group mandated to develop a new standard approached industry to conduct a needs assessment and gather actual requirements for a new standard as part of the standards development process. This paper presents a unique insight from the perspective of some of the standards authors on the development of the ISO/IEC 29110 standard, including the rationale behind its development and the innovative design of implementation guides to assist very small companies in adopting the standards, as well outlining a pilot project scheme for usage in early trials of this standard.
Chapter
Full-text available
A 400-employee Canadian division of a large American engineering company has developed and implemented project management processes for their small-scale and medium-scale projects. The company was already using a robust project management process for their large-scale projects. The objectives of this project were to reduce cost overruns and project delays, standardize practices to facilitate the integration of new managers, increase the level of customer satisfaction and to reduce risk-related planning deviations. For this project, the engineering organization used the ISO/IEC 29110 standards developed specifically for very small entities, i.e. organizations, having up to 25 people. An analysis of the cost and the benefits of the implementation of small and medium scale project management processes was performed using the ISO economic benefits of standard methodology. The engineering enterprise estimated that, over a three-year timeframe, savings of about 780,000$ would be realized due to the implementation of project management processes using the ISO/IEC 29110 standard.
Chapter
There is a rich amount of literature on services from Information Technology (IT) (Management view) and IT System Engineering (ITSE) (Engineering view) domains. However, such a variety has produced disparate views. Furthermore, given that IT and ITSE service-based systems must be linked to business services (the User view), conceptual interrelationships are increased, causing yet more diversity. This paper identifies that this generates a lack of theoretical conceptual cohesion and leads to multiple practical confusions. To address these issues and to reduce such conceptual gaps, an IT Service Engineering and Management Framework (ITS-EMF) is proposed. ITS-EMF is generated by careful review and examination of the main conceptualizations on IT, ITSE and business services. The paper claims that ITS-EMF is useful for: (1) mapping services concepts from disparate IT literature, (2) reducing service conceptual confusion from the multiple available sources, and (3) providing conceptual links between service constructs used in business services and IT and ITSE services layers. It concludes with the implications, both academic and practical, for engineering and managing IT services in business organizations.