ArticlePDF Available

The innovation journey: you can't control it, but you can learn to maneuver it

Authors:

Abstract

Our Minnesota Innovation Research Program and other studies have found that a common set of issues are encountered while the innovation journey unfolds in the development of a wide variety of new technologies, products, programs, and services. These issues challenge the belief that managers or entrepreneurs can control the innovation journey. However, managers and entrepreneurs can increase their odds of success by developing and practicing skills in learning, leading, relating, and cycling through the innovation journey.
"The Innovation Journey: You can't control it,
But you can learn to maneuver it."
Prof. Andrew H. Van de Ven
Carlson School of Management, Univ. of Minnesota
Essay for Innovation: Organization and Management Journal
Draft August 30, 2016
While innovations, by definition, are unique new ideas that are implemented, the process of
developing innovations from concept to implementation follows a remarkably similar pattern. It reflects a
nonlinear cycle of divergent and convergent activities that may repeat in unpredictable ways over time.
This process, illustrated in Figure 1, was found in the development of a wide variety of new technologies,
products, programs, and services in business, government, and non-profit organizations by our Minnesota
Innovation Research Program (Van de Ven, Polley, Garud & Venkataraman, 199; 2008) and other studies
reviewed in Garud, Tuertscher & Van de Ven, 2013). T It challenges the commonplace view that
managers can control the innovation process, and that they are responsible for innovation success.
Instead, the findings suggest that innovation managers should be held accountable for increasing their
odds of success by developing and practicing skills in learning, leading, relating, and cycling through the
innovation journey.
-- Insert Figure 1 about here. --
In summary, this innovation journey tends to unfold in the following ways. In the beginning, a set
of seemingly random coincidental events occur that set the stage for diverging into a new innovative
direction. Some of these gestating events are sufficiently large to “shock” certain attentive entrepreneurs
to launch an innovative venture by developing a proposal and obtaining funding for it. Soon after work
begins to develop the venture in an initially planned convergent direction, the process proliferates into a
divergent cycle of exploring new directions, changing goals, learning by discovery, pluralistic leadership,
and building new relationships. Problems, mistakes, and resource constraints frequently occur as these
divergent paths are pursued. They lead innovators into a convergent cycle of exploiting a given direction,
learning by testing, executing relationships with unitary leadership and goal consensus. This cycle of
convergent behavior may diverge again with further exploration of a chosen direction and if additional
resources permit. This innovation journey ends either in a convergent pattern of innovation
implementation, or the divergent behavior is terminated when resources run out or when political
opposition prevails to terminate the developmental effort.
While these processes are more pronounced in complex innovations, they are present in all the
innovations that we studied. These messy and complex processes require us to reconceptualize the
process of innovation, because the observed processes cannot be reduced to a simple sequence of stages
or phases as implied with the stage gate model that is used in many organizations for managing the
innovation process. Instead, Cheng and Van de Ven (1996) and Dooley and Van de Ven (1999; 2017)
present empirical evidence indicating that the innovation journey consists of a nonlinear cycle of
divergent and convergent activities that may repeat in unpredictable ways over time. The dimensionality
or complexity of this nonlinear cycle of divergent and convergent behavior dampens for the innovations
that ultimately get implemented. Thus, the innovation development journey begins in random, transitions
to chaotic, and ends in orderly patterns of behavior.
These findings suggest that entrepreneurs and managers cannot control innovation success, only
its odds by developing and practicing skills for traversing the obstacles encountered in divergent and
1
convergent cycles of the journey. A useful analogy may be to imagine that the innovation journey is like
an uncharted river.
Most people cling to the river bank, afraid to let go and risk being carried along
by the river’s current. At a certain point, some people are willing to jump in and trust that
they can maneuver the river. While going with the flow of the river, they begin to look
ahead and guide their course onward, deciding where the course looks best, steering
around boulders and snags, and choosing which of the many channels and branches of the
river they prefer to follow. Because some have developed skills and practiced traversing
various river currents, falls, and obstacles, they maneuver the river better than others who
have not learned to swim. While this increases their odds of success, no one controls the
river.
This metaphor is helpful to make a few concluding observations. First, like a river the journey
entails maneuvering through stretches of divergent and convergent waters. In divergent waters the river
branches and expands in multiple dimensions and flows in chaotic or random patterns. Maneuvering
these stretches entails divergent search, learning by discovery, pluralistic leadership, and running in packs
with others to create new relationships and institutions for collective survival. Occasionally the river
converges in a particular direction, and flows in a more orderly periodic pattern. Many familiar principles
of rational management are useful for maneuvering and exploiting these stretches, including
implementing strategic goals, trial-and-error learning, unitary leadership, and executing agreements
within established institutions for competitive advantage.
Maneuvering transitions between divergent and convergent flows are particularly problematic for
two reasons. First, just when people gain some comfort and skill in going with a convergent flow, the
innovation river may transition again into a divergent pattern that requires very different managerial
skills. As a result, maneuvering the entire innovation journey requires developing ambidextrous
management skills. Second, like a river, the paths of these transitions are often unpredictable and beyond
the control of those floating down the uncharted river. However, unlike a river, innovation leaders can
intervene and place boundaries on divergent and convergent patterns with their resource investments,
organizational structuring, and selecting participants who have honed their skills in maneuvering the
obstacles in the innovation journey.
Finally, one of the more tragic findings from our studies is that entrepreneurs of innovations that
failed were not given opportunities to lead future innovations within their organizations. If innovation
success or failure is recognized to be a probabilistic process then it would more often be attributed to
factors beyond the control of innovators. This, in turn, would decrease the likelihood that the careers of
innovators in organizations will be stigmatized if their innovation fails, and increase the likelihood that
they will be given another chance to manage an organization’s future innovations. After all, one cannot
become a master or professional at anything if only one trial is permitted. Repeated trials over many
innovations are essential for learning to occur and for applying these learning experiences to subsequent
innovations. It is primarily through repeated trials and the accumulation of learning experiences across
these trials that an organization can build its repertoire of competencies to progressively increase its odds
of innovation success.
We need to develop ways to let managers practice innovation skills in relatively safe
environments. Management educators could act on this idea by developing training programs, possibly
with simulation exercises and cases, for managers to take before they embark on the innovation journey.
Innovation managers should have opportunities to hone their skills on “beginner slopes” by launching
small and inexpensive innovations before they strike out “on the Alps” by directing major and expensive
innovations that are central to the future viability of their organizations.
2
References
Cheng, Y. & Van de Ven, A.H. 1996. Learning the i9nnovation journey: Order out of chaos? Organization
Science, 7, 6: 593-614.
Dooley, K. & Van de Ven, A.H. 1999. Explaining complex organizational dynamics. Organization
Science, 10, 3: 358-372.
Dooley, K. & Van de Ven, A.H. 2017. Cycles of divergence and convergence: Underlying processes of
organizational change and innovation, Chapter 36 in H. Tsoukas and A. Langley, The Sage
Handbook of Process Organization Studies, Sage LPublications (forthcoming).
Garud, R., Tuertscher, P. & Van de Ven, A.H. 2013. Perspectives on Innovation Processes, The Academy
of Management Annals, 7, 1: 773-817.
Van de Ven, A.H., Poolley, D.E., Garud, R. & Venkataraman, S. (1999; 2008). The Innovation Journey,
New York: Oxford Univ. Press.
3
4
... Исследования будущего становятся важнейшим навигационным инструментом в современном стремительно меняющемся мире с высоким уровнем неопределенности и нехваткой ресурсов (Richter et al., 2018;Brem, Utikal, 2019;Walsh, Winsor, 2019;Van de Ven, 2017). Сложная природа бизнес-среды требует инновационных подходов и методов разработки стратегий для реагирования на потенциальные угрозы и поиска возможностей достижения успеха (Renwick et al., 2019;Goldsby, Zinn, 2016;Kieser et al., 2015). ...
Article
Full-text available
Внушительные запасы нефти и газа и стратегическое расположение Ирана открывают большие перспективы перед нефтехимической промышленностью страны. Вместе с тем, быстрые и сложные политико-экономические, технологические и правовые перемены порождают серьезные вызовы для будущего отрасли. Для изучения возможных вариантов развития событий в исследовании представлены результаты Форсайт-анализа иранской нефтехимической индустрии, выполненного совместно с профильными торгово-промышленными палатами по методологии сценарного планирования Глобальной бизнес-сети (Global Business Network, GBN). Первичные и вторичные данные для исследования были собраны с применением различных методов, включая углубленный анализ литературы, межстрановый сравнительный анализ и подробные интервью с экспертами. Данный подход позволил выявить ключевые факторы, определяющие траекторию развития отрасли, которые были классифицированы по уровню неопределенности и значимости для ее развития. Результаты анализа легли в основу четырех сценариев, отражающих полный спектр потенциальных траекторий развития нефтехимической отрасли Ирана: «Феникс» (потенциальное возрождение), «Проблески» (умеренный рост), «Застой» (отсутствие динамики) и «Амфибия» (борьба за выживание). Кроме того, были выявлены индикаторы реализации каждого из сценариев. Исследование не ограничивается простым описанием возможных вариантов будущего: участие в сценарном планировании руководителей отрасли позволило определить ключевые возможности и угрозы, соответствующие каждой из выявленных траекторий. Подобный комплексный подход обеспечил более глубокое понимание эволюции отрасли, чтобы заинтересованные стороны могли разрабатывать обоснованную политику и предлагать стратегии достижения успеха в постоянно меняющемся мире.
... Indeed, in the face of worldwide competition, corporations' long-term strategies make innovation a priority [32]. Managing innovation, alternatively, is a difficult task and it is much more difficult while developing, as well as designing and managing, an innovation culture that is closely linked to the wide range of goals that such a plan entails [33][34][35]. The act or practice of innovation is defined as anything new, such as a different technique, practice, gadget, or modification in the way things are conducted [36]. ...
Article
Full-text available
This study aims to investigate how international competition impacts innovation activities in the high-technology industry in China. A panel data analysis was conducted using a representative sample of high-tech industries in China from 2010 to 2017. Econometric methods were used to identify patterns and trends in the data, and quantile regression was utilized to explore the delicate connection between international competition and innovation efforts. The statistical analysis indicates that the effect of international competition on innovation activities differs through dependent quantiles of the innovation range; this effect was neglected by a standard linear regression model. The study found a U-shaped connection between foreign competition and innovation, except for at the quantile (Q = 0.01), which was negative. Foreign competition was found to be a critical factor influencing the strength of innovation activities in the high-tech industry in China. This research suggests that the extent of foreign competition has a bearing on the industry’s capacity to lead in innovation. This study is unique in that it addresses the influence of international competition on industry-level innovation accomplishments in a big rising country, such as China. The study also highlights the importance of evaluating the quantile effect of the variable on innovative activities, which was more informative than estimating the mean effect. The study’s limitation lies in the reliance on secondary data sources, which may not be as comprehensive as primary data. The research’s implications suggest that policymakers should pay attention to the impact of foreign competition on innovation activities and implement policies that foster innovation in the high-tech industry in China.
... Indeed, in the face of worldwide competition, corporations' long-term strategies make innovation a priority [32]. Managing innovation, alternatively, is a difficult task and it is much more difficult while developing, as well as designing and managing, an innovation culture that is closely linked to the wide range of goals that such a plan entails [33][34][35]. The act or practice of innovation is defined as anything new, such as a different technique, practice, gadget, or modification in the way things are conducted [36]. ...
... The success/failure of firms is not determined only by their competitive structures and diversification patterns. Instead, it is mainly determined by the top management's evolution and the ability to acquire new skills (Augier and Teece, 2009;Martin, 2011;Van de Ven, 2017). Adner and Helfat (2003) presented DMC and defined it as "the capabilities with which managers build, integrate and reconfigure organizational resources and competencies" (p. ...
Article
Full-text available
Purpose Using the upper echelons theory, this study aims to investigate the moderating effect of managerial discretion (MD) on the impact of dynamic managerial capabilities (DMCs) on established firms’ (EFs) response strategies to disruptive innovation (RStDI). Design/methodology/approach A cross-sectional study was conducted using an online questionnaire to collect data from senior management of sample firms, targeting the population of professional service firms (PSFs) operating in the Emirate of Dubai. After receiving 491 responses, data was analyzed using IBM packages (SPSS and Amos) through a covariance-based structural equation modeling technique. Findings As proposed, the underpinnings of DMCs (managerial human capital, managerial social capital and managerial cognitive perceptions) were associated with EFs’ strategies for responding to DIs. Surprisingly, despite theoretical predictions, MD did not moderate the relationship. These findings provided support to the main propositions of the upper echelons theory, however, not for its contextual moderator (MD). Research limitations/implications The cross-sectional approach to testing the research model limits the identified significant effects that should be further investigated. The research sample was restricted to PSFs operating in Dubai, UAE, thus limiting the generalizability of the findings to the examined context. Practical implications The findings of this investigation are valuable to managers and hiring teams. They provide empirically supported insights on the critical role of managerial dynamic capabilities underpinnings (human capital, social capital and cognitive perceptions) in facilitating organizational RStDI. The findings also provide significant insights to policymakers, notably on the importance of innovative and well-crafted policies and regulative frameworks that enhance MD. Originality/value This study provides one of the first empirical quantitative analysis to assess MD and test its effects as a moderator, thus contributing significantly to the existing theoretical arguments on MD. To the best of the authors’ knowledge, this study is among the first to quantify the relationship between DMCs and organizational RStDI.
... It aids organizations in coping with a perpetually changing external environment, enabling quicker and more effective responses to challenges than noninnovative organizations [35]. While some authors posited that innovation can be generated by adopting and adapting other's ideas [36], it is typically defined as the successful implementation of new ideas [35,37,38]. ...
Article
Full-text available
Innovation is crucial for achieving and maintaining a competitive edge, especially evident in the digital business landscape, where the fourth and fifth industrial revolutions are occurring concurrently. Leadership behavior significantly influences the direction of organizations toward innovation. This study investigated whether a propensity for risk taking, along with a commitment to diversity and agility, promotes or impedes leaders’ innovative behavior. Fuzzy-set qualitative comparative analysis was employed to assess the data gathered from an online survey of 119 global leaders. The results exposed four distinct routes to fostering innovative behavior and three paths leading to noninnovative behavior that should be evaded. All conditions play a vital role in triggering innovative behavior. Conversely, the lack of these conditions can result in noninnovative leadership. This study’s novelty rests on the empirical evidence it provides about the paths guiding leaders toward innovative behavior and avoiding the danger of noninnovative leadership. These findings can assist managers and HR departments in pursuing certain paths for hiring and training managers to boost innovative behavior and preclude paths leading to noninnovative conduct.
... A recent systematic review that evaluated 105 process mapping manuscripts found that process maps help to support understanding of complex healthcare systems and can guide improvement efforts within their local context 27 . de Ven articulates how a process map's narrative presentation is well-suited to show the complexities of a workflow, which can be nonlinear and have unexpected twists and turns 28 . Adopting this awareness is especially important to implementing technologies in organizational settings, which often require changes to workers' roles, relationships, and authority structures 29,30 . ...
Article
Full-text available
When integrating AI tools in healthcare settings, complex interactions between technologies and primary users are not always fully understood or visible. This deficient and ambiguous understanding hampers attempts by healthcare organizations to adopt AI/ML, and it also creates new challenges for researchers to identify opportunities for simplifying adoption and developing best practices for the use of AI-based solutions. Our study fills this gap by documenting the process of designing, building, and maintaining an AI solution called SepsisWatch at Duke University Health System. We conducted 20 interviews with the team of engineers and scientists that led the multi-year effort to build the tool, integrate it into practice, and maintain the solution. This “Algorithm Journey Map” enumerates all social and technical activities throughout the AI solution’s procurement, development, integration, and full lifecycle management. In addition to mapping the “who?” and “what?” of the adoption of the AI tool, we also show several ‘lessons learned’ throughout the algorithm journey maps including modeling assumptions, stakeholder inclusion, and organizational structure. In doing so, we identify generalizable insights about how to recognize and navigate barriers to AI/ML adoption in healthcare settings. We expect that this effort will further the development of best practices for operationalizing and sustaining ethical principles—in algorithmic systems.
Article
Full-text available
This research investigates the social media-enabled strategies adopted by two spiritual tourism agencies in Indonesia amidst the COVID-19 crisis to sustain their business by rekindling traveller confidence. An intrinsic qualitative case study approach is employed involving interviews with seven key stakeholders. Thematic analysis reveals that the creative use of YouTube for virtual pilgrimage simulations and religious content generation enabled continuous traveller engagement. By disseminating personalized information and forming online travel communities, the agencies overcame lockdown limitations and revived enthusiasm for future tours. The findings offer timely insights for tourism managers to harness digital platforms' affordances for crisis response, reputation management, and fostering traveller loyalty
Article
This paper examines the posturing, positioning and practice of Business Design (BD) at Rotman School of Management, University of Toronto, exploring its evolution since the late 1990s to today. It outlines BD’s introduction as a design thinking-lite approach to strategy innovation and its evolution to an experimental design-driven innovation pedagogy for MBA students. A triangulated theoretical foundation combines design principles, innovation theory and management education with the aim to teach and study BD as an innovation management learning construct. The resulting Business Design Method is examined with early findings of its impact, however offers more of a provocation rather than proof of a successful design curriculum for b-schools.
Article
Full-text available
Innovation is often thought of as an outcome. In this chapter we review the literatures on innovation processes pertaining to the invention, development, and implementation of ideas, as they unfold within firms, across multi-party networks, and within communities. Moreover, we explore four different kinds of complexities associated with innovation processes that we label as evolutionary, relational, temporal, and cultural complexities. While one approach is to manage or control such complexities, we draw attention to literatures that suggest that it is far more productive to harness these complexities for sustaining ongoing innovation. We conclude the chapter by highlighting some areas for future research.
Article
Full-text available
Studies of organizational processes can yield observations in the form of event time series that can be analyzed to determine whether they reflect periodic, chaotic, white noise, or pink noise dynamic patterns. These different patterns each imply different underlying generative mechanisms and hence, different process theories. In this paper we present a model that describes how these four dynamical patterns are different from one another. Specifically, a causal system can be characterized by its dimensionality, and by the nature of interaction between causal factors. Low dimensional causal systems yield periodic and chaotic dynamics, while high dimensional causal systems yield white and pink noise dynamics. Periodic and white noise dynamics stem from systems where causal factors act independently, or in a linear fashion, while chaotic and pink noise systems stem from systems where causal factors act interdependently, in a nonlinear fashion. Thus, given a diagnosis of an observed event time series, we can hypothesize a particular story, or causal process theory, that might explain in organization-specific terms why such dynamics came about. In doing so, we also propose that the observation of chaotic organizational dynamics may often signify the presence of control and/or cooperation, rather than a lack of it, as implied by the vernacular use of the term. We conclude by challenging organizational researchers to define new models that capture such observed behavior.
Article
Practice theories of implementing change are lagging behind process theories of organizational change and development. To address this gap, this paper examines common breakdowns in implementing four process models of organization change: teleology (planned change), life cycle (regulated change), dialectics (conflictive change), and evolution (competitive change). Change agents typically respond to these breakdowns by taking actions to correct people and organizational processes so they conform to their model of change. Although this strategy commands most of the attention in the literature, we argue that in many situations managers and scholars might do better if they reflected on and revised their mental model to fit the change journey that is unfolding in their organization.
Article
Introduction - Andrew H Van de Ven and George P Huber Longitudinal Field Research Methods for Studying Processes of Organization Change Images of Imaging - Stephen R Barley Notes on Doing Longitudinal Field Work A Dual Methodology for Case Studies - Dorothy Leonard-Barton Synergistic Use of a Longitudinal Single Site with Replicated Multiple Sites Building Theories from Case Study Research - Kathleen M Eisenhardt Longitudinal Field Research on Change - Andrew M Pettigrew Theory and Practice Studying Changes in Organizational Design and Effectiveness - William H Glick et al Retrospective Event Histories and Periodic Assessments Methods for Studying Innovation Development in the Minnesota Innovation Research Program - Andrew H Van de Ven and Marshall Scott Poole Alternate Approaches to Integrating Longitudinal Case Studies - Robert D McPhee A Primer of Sequence Methods - Andrew Abbott An Empirical Taxonomy of Implementation Processes Based on Sequences of Events in Information System Development - Rajiv Sabherwal and Daniel Robey Theoretical and Analytical Issues in Studying Organizational Processes - Peter R Monge Organizations Reacting to Hyperturbulence - Alan D Meyer, James B Goes and Geoffrey R Brooks
Article
This paper examines whether the developmental process of two biomedical innovations followed either (1) an orderly periodic progression of stages or phases, (2) a random sequence of chance "blind" events, or (3) a seemingly random process of chaotic events. Various diagnostics are applied to distinguish periodic, chaotic, and random patterns in time series data on innovation development events. We find that the actions and outcomes experienced by innovation teams exhibit a chaotic pattern during the initial period of innovation development, and an orderly periodic pattern during the ending development period; however, exogenous context events exhibit a random pattern during both the beginning and ending periods of innovation development. These research findings, if substantiated in other studies, significantly alter prior views of innovation and learning processes. The two most commonly-used explanations of the innovation process, that it follows either an orderly periodic sequence of stages or a random sequence of "blind" events, are not valid where chaos is found. Chaos tells us that the innovation process consists of a nonlinear dynamical system, which is neither orderly and predictable nor stochastic and random. The findings of chaos also expand existing definitions of organizational learning. Learning in chaotic conditions can be viewed as an expanding and diverging process of discovery. Learning during more stable and periodic conditions is viewed as a narrowing and converging process of testing. Timing of transitions from chaos to periodic patterns may explain whether decision or action rationality prevails. Hence, the difference between behavioral learning theorists and cognitive learning theorists may be just a matter of time.
Cycles of divergence and convergence: Underlying processes of organization change and innovation, Chapter 39
  • K Dooley
  • A H Van De Ven
  • Dooley K.
Dooley, K., & Van de Ven, A. H. (In press). Cycles of divergence and convergence: Underlying processes of organization change and innovation, Chapter 39. In H. Tsoukas & A. Langley, (Eds.), The SAGE handbook of process organization studies. Sage Publications.