Conference Paper

Application of Material Balance Models for Choosing The System of Field Development During Geological Exploration

January 2021

DOI:10.3997/2214-4609.202159054

Conference: ProGREss’21

Authors:

Anna Gubanova

Elizaveta Gladchenko

Skolkovo Institute of Science and Technology

D. M. Orlov

Skolkovo Institute of Science and Technology

Dmitry Koroteev

Skolkovo Institute of Science and Technology

ResearchGate has not been able to resolve any citations for this publication.

ResearchGate has not been able to resolve any references for this publication.

Chapter

The Balance between Exploration and Exploitation in the “New” Venture Capital Cycle: Opportunities a...

August 2014

Article

Investments in Exploitation and Exploration Capabilities: Balance Versus Focus

January 2014 · The Journal of Marketing Theory and Practice

Whether performance advantage accrues more to firms that balance exploitation (i.e., serving existing markets) and exploration (i.e., developing new products for future markets) or to those that focus on only one of these objectives is open to debate. To gain a better understanding of this dilemma, we employ longitudinal data from the pharmaceutical industry to examine how efficient firms are at ... [Show full abstract] utilizing resource investments to build exploitation and exploration capabilities. These capabilities are obtained using stochastic frontier estimation, which measures how efficiently firms use resource inputs to generate an output in a competitive landscape. We then link these capabilities to performance. We find that firms with superior exploitation capabilities have higher operating cash flow but lower firm value. In contrast, firms with superior exploration capabilities find the opposite effect. Importantly, firms that are superior in both capabilities enhance cash flow but not firm value.

Chapter

Balancing Exploration and Exploitation in Forward Model Learning

January 2022

Forward model learning algorithms enable the application of simulation-based search methods in environments for which the forward model is unknown. Multiple studies have shown great performance in game-related and motion control applications. In these, forward model learning agents often required less training time while achieving a similar performance than state-of-the-art reinforcement learning ... [Show full abstract] methods. However, several problems can emerge when replacing the environment’s true model with a learned approximation. While the true forward model allows the accurate prediction of future time-steps, a learned forward model may always be inaccurate in its prediction. These inaccuracies become problematic when planning long action sequences since the confidence in predicted time-steps reduces with increasing depth of the simulation. In this work, we explore methods for balancing risk and reward in decision-making using inaccurate forward models. Therefore, we propose methods for measuring the variance of a forward model and the confidence in the predicted outcome of planned action sequences. Based on these metrics, we define methods for learning and using forward models under consideration of their current prediction accuracy. Proposed methods have been tested in various motion control tasks of the Open AI Gym framework. Results show that the information on the model’s accuracy can be used to increase the efficiency of the agent’s training and the agent’s performance during evaluation.

Article

The asymmetric effects of exploitation and exploration on radical and incremental innovation perform...

June 2019 · European Management Journal

Scholars have argued that the exploitation‐exploration interaction provides a source of competi‐tive advantage beyond that provided by each individually. However, we know little about the mutual effects of exploitation and exploration on either incremental or radical innovation per‐formance. To address this gap, we examine data from 171 manufacturing firms. We find incre‐mental innovation ... [Show full abstract] performance is highest when exploitation interacts with an intermediary level of exploration. Radical innovation performance, however, is solely driven by exploration. A coupling with exploitation is not effective. We contribute to the extant literature, first, by disen‐tangling the interaction effects of exploitation and exploration on radical and incremental inno‐vation performance, respectively. Second, we extend extant literature that agrees that main‐taining an appropriate balance of exploitation and exploration is critical for innovation perfor‐mance and that has conceptualized this balance as symmetrical presence and magnitude of ex‐ploitation and exploration. In particular, we provide evidence in support of an asymmetric rela‐tionship.

Preprint

Reinforcement Learning with Probabilistically Complete Exploration

January 2020

Balancing exploration and exploitation remains a key challenge in reinforcement learning (RL). State-of-the-art RL algorithms suffer from high sample complexity, particularly in the sparse reward case, where they can do no better than to explore in all directions until the first positive rewards are found. To mitigate this, we propose Rapidly Randomly-exploring Reinforcement Learning (R3L). We ... [Show full abstract] formulate exploration as a search problem and leverage widely-used planning algorithms such as Rapidly-exploring Random Tree (RRT) to find initial solutions. These solutions are used as demonstrations to initialize a policy, then refined by a generic RL algorithm, leading to faster and more stable convergence. We provide theoretical guarantees of R3L exploration finding successful solutions, as well as bounds for its sampling complexity. We experimentally demonstrate the method outperforms classic and intrinsic exploration techniques, requiring only a fraction of exploration samples and achieving better asymptotic performance.

Article

Managing digital business platforms: A continued exercise in balancing renewal and refinement

September 2020 · Business Horizons

Central to the evolution of a digital business platform is the organization’s ability to balance exploration (renewal) and exploitation (refinement) simultaneously. Drawing on prior research—including digital platforms, contradictory tensions, and organizational ambidexterity—and our own experience investigating digital business platforms in organizations, this article provides insights into how ... [Show full abstract] executives can manage this evolution successfully. More specifically, we present a framework recognizing three pairs of organizational capabilities (i.e., identifying-nourishing, expanding-legitimating, and augmenting-embedding) that enable balancing renewal and refinement of the platform over time. We close by providing critical managerial practices that executives can use in anticipating, adjusting, and evaluating the evolution of a digital business platform over time, including its initiation, development, and growth.

Article

Impact of business environment on balancing innovation process in Indian SMEs

January 2017 · International Journal of Business Innovation and Research

The present research proposes a theoretical framework of assessing extents of innovation capability and balancing interplay of exploration and exploitation processes of SMEs. The innovation capabilities of SMEs are measured on the extent of harnessing exploration and exploitation whereas the balancing of interplay between exploration and exploitation activities explained by sequential and ... [Show full abstract] simultaneous approach in heterogeneous and hostile business environment. Theoretical frameworks are proposed in the form of hypotheses and verified through primary data collect from 213 respondents of 77 manufacturing SMEs in structured questionnaire. The result indicates that SMEs of Innovator class are more prone to sense environmental heterogeneity than the other SMEs. In heterogeneous business environment, they coordinate exploration and exploitation through ambidextrous approach. The SMEs perceiving less hostility as compared environmental heterogeneity follow sequential approach to balance their innovation. The finding is very useful to strategic decision makers/managers/owners of such SMEs to redefine and redesign the extent of balancing firms' innovation. The study also suggests aligning the production setup and innovation capabilities accordingly to balance all technological inputs collected from external environment/customers, and new product/outputs to the market.

Article

Full-text available

Model-Based Bayesian Exploration

January 2013

Reinforcement learning systems are often concerned with balancing exploration of untested actions against exploitation of actions that are known to be good. The benefit of exploration can be estimated using the classical notion of Value of Information - the expected improvement in future decision quality arising from the information acquired by exploration. Estimating this quantity requires an ... [Show full abstract] assessment of the agent's uncertainty about its current value estimates for states. In this paper we investigate ways of representing and reasoning about this uncertainty in algorithms where the system attempts to learn a model of its environment. We explicitly represent uncertainty about the parameters of the model and build probability distributions over Q-values based on these. These distributions are used to compute a myopic approximation to the value of information for each action and hence to select the action that best balances exploration and exploitation.

View full-text

Conference Paper

Genetic Evolution of Control Systems

June 2013 · Lecture Notes in Computer Science

In this paper, we present to utilize Genetic Algorithms (GAs) as tools to model control processes. Two different crossover operators are combined during evolution to maintain population diversity and to sustain local improvement in the search space. In this manner, a balance between global exploration and local exploitation is reserved during genetic search. To verify the efficiency of the ... [Show full abstract] proposed method, the desired control sequences of a given system are solved by the optimal control theory as well as GA with hybrid crossovers to compare their performances. The experimental results showed that the control sequences obtained from the proposed GA with hybrid crossovers are quite consistent with the results of the optimal control.

Article

Balance Across Firms: Exploration and Exploitation in Alliances Between Platform Participants

January 2019 · SSRN Electronic Journal

Article

Choice Interaction and Organizational Structure

July 2001 · SSRN Electronic Journal

We examine how a firm's formal organizational structure affects its ability to cope with interdependent decisions. An agent-based simulation, in which firms struggle to discover good sets of decisions, allows us to examine four coordinating mechanisms that have rarely been analyzed jointly: the grouping of related decisions under a single subordinate, a vertical hierarchy that reviews proposals ... [Show full abstract] from subordinates, firm-level incentives, and managers who are able to process more information. We find that organizational structure affects long-term performance by influencing the number and nature of "sticking points" - configurations of choices the organization will not change. We identify each of the four coordinating mechanisms as a force that either encourages firms to explore a broad set of alternatives or stabilizes firms around existing choices. Successful firms strike a balance between exploration and stability. The need to balance exploration and stability generates interdependencies among the coordinating mechanisms. As a result, firms sometimes benefit from seemingly harmful features: avoidable decision interdependence between departments, a passive CEO, or subordinates of limited ability. We further examine how appropriate organizational design depends on the underlying pattern of interaction among decisions. When interactions are pervasive, successful organizations employ coordinating mechanisms that promote broad exploration.

Application of Material Balance Models for Choosing The System of Field Development During Geological Exploration

No full-text available

Recommended publications

The Balance between Exploration and Exploitation in the “New” Venture Capital Cycle: Opportunities a...

Investments in Exploitation and Exploration Capabilities: Balance Versus Focus

Balancing Exploration and Exploitation in Forward Model Learning

The asymmetric effects of exploitation and exploration on radical and incremental innovation perform...

Reinforcement Learning with Probabilistically Complete Exploration

Managing digital business platforms: A continued exercise in balancing renewal and refinement

Impact of business environment on balancing innovation process in Indian SMEs

Model-Based Bayesian Exploration

Genetic Evolution of Control Systems

Balance Across Firms: Exploration and Exploitation in Alliances Between Platform Participants

Choice Interaction and Organizational Structure