Conference PaperPDF Available

The Relationship Between Agent-based Simulation and Game Theory in the Case of Parallel Trade

Authors:

Abstract and Figures

Pharmaceutical parallel trade emerged due to the European Union's single market for medicines. While many players, such as manufacturers, wholesalers, parallel traders, pharmacies, regulatory authorities, and hospitals, are involved in this market, having a model that accurately reflects the parallel trade market could be a considerable advantage for players in this market. One way to model the parallel trade market is by employing game theory, which is frequently used to model and explain business interactions. However, game theory imposes limitations on models. Agent-based modeling is a promising framework for studying the parallel trade market, which allows us to investigate macroscopic outcomes that emerge from microscopic rules, decisions, and interactions. Moreover, agent-based modeling allows for high expressiveness and complexity in agents, improving agents' efficiency in autonomy and reactivity compared to current game theoretic models. In this paper, we aim to build an agent-based model for the pharmaceutical parallel trading market based on the available game-theoretic model of the market.
Content may be subject to copyright.
The Relationship Between Agent-based Simulation
and Game Theory in the Case of Parallel Trade
Ruhollah Jamaliand Sanja Lazarova-Molnar†∗
The Maersk Mc-Kinney Moller Institute, University of Southern Denmark, 5230 Odense, Denmark
{ruja,slmo}@mmmi.sdu.dk
Institute AIFB, Karlsruhe Institute of Technology, 76133 Karlsruhe, Germany
sanja.lazarova-molnar@kit.edu
Abstract—Pharmaceutical parallel trade emerged due to the
European Union’s single market for medicines. While many
players, such as manufacturers, wholesalers, parallel traders,
pharmacies, regulatory authorities, and hospitals, are involved
in this market, having a model that accurately reflects the
parallel trade market could be a considerable advantage for
players in this market. One way to model the parallel trade
market is by employing game theory, which is frequently used
to model and explain business interactions. However, game
theory imposes limitations on models. Agent-based modeling is
a promising framework for studying the parallel trade market,
which allows us to investigate macroscopic outcomes that emerge
from microscopic rules, decisions, and interactions. Moreover,
agent-based modeling allows for high expressiveness and com-
plexity in agents, improving agents’ efficiency in autonomy and
reactivity compared to current game theoretic models. In this
paper, we develop the concept of an agent-based model for the
pharmaceutical parallel trading market based on an available
game-theoretic model of the market.
Index Terms—agent-based modeling and simulation, game
theory, modeling and simulation, pharmaceutical parallel trade
I. INT ROD UC TI ON
Modeling and simulation enable us to test hypotheses or de-
cisions with the desired number of assumptions and obtain an
intuitive result that is easy to interpret, reducing the possibility
of making decisions that negatively impact predefined perfor-
mance metrics and allowing decision-makers to assess various
factors’ impact. A model is an abstraction of an objective
process or system that can help us study the process/system of
interest and predict the impact of different inputs on selected
performance measures. Simulation refers to the process of
using a computational model to gain insight into a complex
system’s behavior and evaluate designs and plans without
actually bringing them into existence on a real-world level [1].
Agent-based modeling is a computational modeling
paradigm in which the dynamic actions, reactions, and in-
tercommunication protocols among agents in a shared en-
vironment are invoked. Agent-based modeling demonstrated
remarkable performance in modeling real-world business in-
teractions [2]–[4]. Game theory, on the other hand, provides
a theoretical framework to model relationships of competing
agents and their logical interactions [5]. Both frameworks,
agent-based modeling and game theory, are related, allowing
for knowledge exchange on different models [6]–[9]. In this
paper, we discuss the relationships between game theory and
agent-based modeling and utilize an existing game theory
model of the pharmaceutical parallel trade market [10], [11]
to develop the basis of agent-based models for simulating the
interactions between different players in this market. An agent-
based model of the pharmaceutical trading market enables us
to run simulations considering various assumptions to research
and predict the market.
The paper is structured as follows. Section II offers an
overview of game theory and agent-based modeling back-
ground and their relationship. We conclude Section II with an
introduction of our domain of interest, i.e., parallel trade, and
its characteristics. In Section III, we present a game-theoretic
model for the parallel trade of pharmaceuticals. Further in this
section, we discuss employing the game-theoretic model as
a basis for agent-based modeling. In Section IV, we discuss
our work and possible future routes. In the final Section, we
summarize our contributions.
II. BACKGROU ND A ND R EL ATED W OR K
This section provides a background on game theory and
agent-based modeling. Next, we discuss the relationship be-
tween these two paradigms. Finally, we provide information
about the parallel trade of pharmaceuticals and discuss the
application of game theory and agent-based simulation for this
market.
A. Game Theory
Game theory studies strategic interactions of logical agents
(players or decision-makers) in different scenarios. There are
always payoffs and outcomes for each agent’s action, depend-
ing on other agents’ decisions [12]–[15]. The idea of game the-
ory was introduced by Neumann and Morgenstern [16] where
they argued that most economic questions should be analyzed
as games. Straffin defines game theory as a method of making
a decision under specific and interactive conditions, in which
the consequences of actions are affected by the actions of other
agents [17]. Game theory models are abstract representations
of various real-life situations, including economics, computer
science, and social psychology, which provides promising
tools for investigating decision outcomes in a situation.
Preprint
In game theory, a game is defined as a situation in which
a decision-maker makes strategic actions that could impact
other players’ actions and responses. The value associated with
the action in the game is called payoff, which also depends
on other agents’ decisions. A strategy is a plan of action
or decision for playing a game. Games are categorized as
cooperative and non-cooperative, where players can form an
alliance in cooperative games. On the other hand, in non-
cooperative games, they compete with each other, and they
are self-enforcing. There are various solutions and strategies
for a game. A strategy with the best payoff is called dominant
strategy, and a state of a game in which every player is doing
their best regardless of other players’ actions is called equi-
librium [12]–[15]. In other words, when a unilateral decision
change by one player would have a negative impact on his
payoff, the players are in an equilibrium.
An advertising game is a simple game example in which
two companies decide whether to advertise or not. Let us
say we have two companies, A and B. If both companies
advertise, both will gain 10 dollars; if one company advertises
and the other does not, each will get 20 and 5 dollars,
respectively. Finally, if none of them advertises, they will gain
nothing. Table I is a summarized representation of this game,
where each tuple represents the payoff of each company for a
different choice, the first number is the payoff for company A,
and the second one is the payoff for company B. In this game,
the dominant strategy for both companies is to advertise. In
the case of advertising, their income (either 20 or 10) is higher
than not advertising (either 5 or 0) case. Therefore, equilibrium
can be achieved if these two companies choose to advertise in
the market.
The purpose of game theory is to provide a framework for
developing a model for players to determine what strategy or
combination of strategies they should follow to optimize their
profit, reward, or other success indicators. Pecorino [10], and
Grossman and Lai [18] formalized parallel trade as a game
theory model, which could investigate agents’ interaction in
this market and also investigate what they are trying to achieve
through interaction.
TABLE I
ADVE RTIS IN G GAM E RE PRE SE NTATIO N
Company B
Advertise Does not advertise
Company A Advertise (10, 10) (20, 5)
Does not advertise (5, 20) (0, 0)
B. Agent-based Modeling
Agent-based modeling (ABM) is a computational frame-
work for modeling and simulating dynamic processes involv-
ing autonomous and interacting agents, with the intent to
assess agents’ effects on the whole system. In other words,
ABM is a computational replication of a conceptual model
of a system based on discrete entities (agents) with defined
properties and behavior rules used to simulate the entities
on a computer to mimic the phenomena occurring in the
real world. ABM is suitable for modeling complex systems
composed of various interacting autonomous agents with many
degrees of freedom. Autonomous agents can represent individ-
uals, companies, organizations, authorities, customers, or the
like, acting independently in response to external factors and
through interactions with each other. One of the first tutorials
for building agent-based models of real-world problems was
presented at the Winter Simulation Conference in 2005 [19].
Various complex systems have been simulated with agent-
based models, from social and economic models [20] to lo-
gistic optimization models [21], and crowd simulation models
[22].
Compared with game-theoretic frameworks, agent-based
modeling can go far beyond what is analytically feasible. One
good example of ABM application is the representation of
Hotelling’s law [23]. Hotelling’s law is an economic observa-
tion that shows that the rational decision for firms is to make
their products as similar as possible. However, with Hotelling’s
law model and using ABM, we can investigate many aspects
of a market. For example, we can investigate how different
stores can compete over market share by changing the price
of the same product. In this example, stores are the agents
with a variable attribute, the price of the product, and a fixed
attribute, which is their location on the grid. The environment
is the neighborhood, represented as a grid, and each cell
represents a customer. The interaction rule in this example
is that customers add up the price and the distance from the
store and then choose the lowest sum as their preference, and
in case of a tie, they will choose randomly. In this example, we
can investigate how adjacent stores end up in competition and
observe that isolated stores have the most significant venue.
Having such observation in simulation, we can say that the
location of a store has a significant impact on its revenue.
Figure 1 represents this model for five stores using Netlogo
[24], in which stores compete by changing the price of the
same product to get a more significant market share.
The pharmaceutical trading market and its activities can be
modeled as an agent-based model in which the agents are
firms, wholesalers, and shops, and the price and bargaining
power could be traits. Using such a model, we can investigate
the outcome of decisions like pricing and ordering.
C. The Relationship between Game Theory and Agent-Based
Simulation
Several studies have pointed out and established relation-
ships between game theory and agent-based simulation, al-
though in different contexts than the one we consider. Szilagyi
[9] described the difference between game theory and agent-
based modeling, specifically for two-person games and N-
person games, and then reviewed the usefulness of agent-
based modeling in the investigation of N-person games. In
another relevant study on evolutionary game theory, Adami et
al. discuss the differentiation between the game theory model
and agent-based modeling and the idea of how it could be
beneficial to use a game-theoretic model to understand the
Preprint
Fig. 1. Hotelling’s law agent-based simulation representation of stores
competition to get a bigger market share of the same product by changing
price of the product
selective pressure that affects the evolution of agents with
potential conflicts [25]. In their paper, they investigated the
limitations of the mathematics of game theory to model evo-
lution, where the decisions are not always deterministic, and
previous experiences can also influence them. Furthermore,
Adami et al. explored how using an agent-based modeling
method in a game-theoretic framework could capture evo-
lutionary information. Following this study, we encountered
a case study of agent-based models for evolutionary game
theory [26], where the authors present a game with complex
interactions and examine how an agent-based model can be
used to find evolutionary stable states.
D. The Case of Parallel Trade
The European single market for pharmaceuticals enabled
parallel trade of pharmaceuticals over Europe [27]. The par-
allel trade of pharmaceuticals enables companies to import
products from purchase markets where direct importers sell
their preparations at lower prices. The parallel market prevents
monopoly suppliers from engaging in international price dis-
crimination [28].
The margins in parallel trading of pharmaceutical products
are tiny; therefore, decisions concerning timing and pricing
can significantly affect profitability. Furthermore, companies
selling pharmaceuticals often pay huge penalties if they are
unable to deliver agreed products within the agreed time frame.
Hence, parallel trading is characterized by a range of complex
business decisions and factors, such as which pharmaceutical
products to buy, when to apply for marketing authorization,
what price to pay for which product, the amounts to buy, which
markets to enter with a specific product, patent expiry dates,
when to leave which markets, etc.
All pharmaceutical trading decisions are strongly affected
by a dynamic set of actions from various players (agents)
in the market. There have been many efforts for modeling
parallel trade environment, investigating various aspects of it
[28]–[30]. Since all agents in this market make decisions with
their objectives, we can model parallel trade employing non-
cooperative game-theoretic models.
III. THE R EL ATIO NS HI P BE TW EE N AGE NT-BA SE D
MO DE LI NG A ND G AM E TH EO RY IN THE CASE OF PAR AL LE L
TR AD E
A. Underlying Game Theory Models for Parallel Trade
The pharmaceutical parallel trade market has been modeled
using game theory [10], [11], where Pecorino’s goal was to
investigate a firm’s profit with the presence of parallel trade
or without it. Pecorino also discussed the change in social
welfare due to the parallel trade regime. Guo et al. wanted
to investigate the impact of having parallel traders in the
pharmaceutical market and its impact on a firm’s profit. Both
models represented an economic view to investigate the impact
of parallel trade. We continue to elaborate in more detail on
Pecorino’s model.
The problem definition is as follows. A simple pharma-
ceutical market consists of at least two countries; here, we
name them Eand Ias Exporter and Importer, respectively. We
consider a monopolist pharmaceutical manufacturer located in
Eto produce and sell a patented medicine in Eand sell that
medicine in Iafter negotiating its price with their government.
We refer to the price of this medicine in Eand I,PE, and
PI, respectively.
To simplify the model, we consider the production cost of
the medicine to be zero. We will refer to the demand in E
as QE, and QIrepresents the demand in I. Since we aim
to develop a general model, we have a normalized demand
function for the noted medicine in country E, so both prices
and demands are between zero and one. The demand function
in Eis QE= 1PE. For the country I, the demand function
is QI=αPI, where αis assumed to be less than 1such that
the monopoly price in Eis higher than I. Since both demand
functions have the same slope, αcould be interpreted as the
unambiguous market size measure.
We consider two steps for setting PEand PI. In the first
step, the firm and the government in Inegotiate the price of
the medicine (PI), which is determined by a Nash bargaining
game [10]. According to Pecorino, the price will be the one
that maximizes this weighed geometric average, i.e.:
max
PI
[CS (PI)γ][πI](1γ),(1)
where γand 1γrepresent the bargaining power of the
country Iand the firm, respectively, during the negotiation.
γvaries between zero and one, demonstrating the trade-
off between each party’s bargaining power in this market.
Here CS (PI)represents the consumer surplus, which is the
payoff for the country in the bargaining, and πIis the profit
of the firm. The consumer surplus is the area under the
demand curve, which in our case, will be half of the demand
function squared. Furthermore, since the production cost of the
medicine is assumed to be zero, the profit can be expressed as
a product of the demand and the price. In our case, we have
the following:
CS (PI) = 1
2(αPI)2and πI= (αPI)PI.(2)
Preprint
By putting these into equation 1, the PIthat maximize the
equation 1 (equilibrium price (PINE )) will be:
PINE =α(1 γ)
2.(3)
For the second step, we consider there exist nparallel
traders that purchase the medicine in Iwith the negotiated
price of PIand sell it in Ewith a transfer cost of t.
Considering exporter country E, we can estimate equilibrium
price (PE)modeling parallel traders and the firm having a
Cournot competition. Cournot competition is an economic
model describing companies’ competition in quantities for
providing a homogeneous product. In our case, a homogeneous
product is a patented medicine. In Cournot competition, firms
are rational, meaning they act strategically to maximize their
profit given other firms’ decisions. All these characteristics can
be observed in the pharmaceutical trading market. Solving the
Cournot equilibrium, we have:
qt=(12(PI+t)
n+ 2 ,if PI1
2t
0, otherwise .(4)
Where qtis the quantity sold in country Eby a parallel trader.
Then, the total quantity sold by all parallel traders (QT)is:
QT=n×qt,(5)
and the quantity sold in the country Eby the pharmaceutical
trader QMis equal to:
QM=(12n(PI+t)
2(n+ 2) ,if PI1
2t
0, otherwise .(6)
The equilibrium price is:
PE=(1
2[1 n(1 2(PI+t))
n+ 2 ],if PI1
2t
1
2, otherwise .(7)
In this way, we calculate the equilibrium prices in both
countries, considering nparallel traders. Having this model
and equilibrium prices, we can investigate general assumptions
like how bargaining power could impact an equilibrium. For
example, Guo et al. [11] demonstrated the impact of different
values of the bargaining power on the equilibrium price in
different market sizes. However, markets such as pharmaceuti-
cal parallel trade are dynamic and complex, and to accurately
model them; we need a more dynamic framework in which
parameters, such as bargaining power and transfer cost, could
fluctuate as agents’ features as in the real world.
B. The Synthesis of Agent-based Modeling and Game theory
Although game theory can represent a mathematical formal-
ization and equilibrium for the competition in pharmaceutical
trading, we need a more flexible and dynamic framework to
use data and simulate models repetitively to investigate the
impacts of different possible decisions. Agent-based modeling
can provide these features while utilizing the game theory
model. Generally, an agent-based model contains a collec-
tion of autonomous decision-making entities, which we term
agents. These agents have different attributes that can be fixed
or variable, and they interact with each other based on a set of
rules. In the agent-based model that we subsequently describe,
we use the game theory model introduced in Section III-A as
a basis for defining agents’ attributes and the corresponding
rules of interaction.
The whole idea is that the pharmaceutical trading mar-
ket can be modeled by defining agents, environment, and a
description of agent-agent and agent-environment interaction.
The agents and the environment have attributes and rules of
interaction, and these can be defined as either variable or
fixed. After defining attributes and rules, simulation of the
actions and interactions of autonomous agents can help us to
understand the behavior of the system and what governs its
outcome.
We use the following definitions to base our agent-based
model. First, we define the environment and agents of our
agent-based model. In the model that we propose, we consider
two countries (Eand I), a manufacturer, a government (gov-
ernment of country I), and nparallel traders. We define the
environment as a set of two countries: country Ias a part of the
environment has two attributes: the price of the medicine (PI),
which is variable, and the unambiguous market size measure
(0 < α < 1) which is fixed, and we consider the market
size in Eto be also a fixed variable with the value of 1as we
had in the demand function defined in Section III-A. Then,
we define manufacturer, government and parallel traders as
agents. Their attributes are as follows. Government has only
one attribute, which is the bargaining power (γ), and it is fixed.
Manufacturers have the following attributes: bargaining power
(which is 1minus the bargaining power of the government),
which is fixed, market share in country E, which is variable,
and revenue, which is also variable. Parallel traders have the
following attributes: transfer cost (t), which is fixed, market
share in country E, which is variable, and revenue (sell minus
costs), which is also variable.
Secondly, we define the rules for the model and define what
happens in each step of the agent-based model. Each step
has two chronological events happening. First, the government
of the country Iand the manufacturer start a negotiation to
set the price (PI)according to the Nash bargaining game
that we discussed in Section III-A. Subsequently, there are
two possibilities: (1) if PI>1
2t, then there is no
revenue for the parallel traders, so they will not participate
in the market and the manufacturer will act as a profit-
maximizing monopolist in the country Eand set the price as
1
2;(2) if PI1
2t, then parallel traders can participate
in the market of country E. Then parallel traders and the
manufacturer compete to maximize their revenue in country
E. Since parallel traders and manufacturers are selling the
same product in the market, they will compete by adjusting
their sell quantity (market share) to maximize their profit while
knowing other players’ current market share. Manufacturer
Preprint
profit function (πm)is:
πm= [1 (qm+qT)]qm+PIqT,(8)
where qmand qTare the sell quantity of the manufacturer and
total sell quantity of parallel traders in country E, respectively.
The first term of this equation represents the profit of the
company from their sales in country Eand the second term
represents profit from sell in country I. Profit function for a
parallel trader (πt)is:
πm= [1 (qm+qT)PIt]qt,(9)
where qtis a parallel trader’s sell quantity in country E.
In every step of our model, the manufacturer calculates their
profit function using current market share values and adds the
result to their revenue. Afterward, the manufacturer adjusts
their market share by considering increasing, decreasing, or
keeping the current market share in both countries, and they
will adjust it by the value that brings the highest profit for
them in both countries. Parallel traders also perform the same
procedure; however, they only consider the market in the
country E. Subsequently, with new market shares, we can
calculate the medicine price in the country Efor the next
step using the demand function of country E. Figure 2 is a
visualization of the above-described agent-based model, where
all described attributes and possible interactions are illustrated.
Fig. 2. Illustration of the agent-based model of the simplified parallel trade
scenario
The basis of the agent-based model is derived from the game
theory model. However, the agent-based model gives us the
flexibility to consider more factors in the market. For instance,
not all parallel traders need to have the same properties;
instead, we can consider an attribute like supply power to vary
across time and agents. With the agent-based model, we can
simulate various scenarios to investigate the impact of different
elements on the market, such as setting prices, increasing
supply power, or long-term strategies, defining more realistic
scenarios. Such an agent-based model can, furthermore, be
calibrated using available data.
IV. DIS CU SS IO N
The first step to simulating a business process is to for-
malize it and have a model that accurately reflects the actual
process, given the goals of the simulation study. While this
simulation can differ in goals, such as finding the best price
for a product, selecting a market that offers better revenue
and less competition, or improving the company section, it
could be tricky to find a suitable model to represent the
target business process. In our case, since parallel trade has
economic characteristics, competition in this market could
be represented as a non-cooperative game where each player
pursues their interests. Considering this, we can utilize game
theory, which is the mathematical study of interactions and
strategies among players. With game theory, we are able to
represent economic behaviors by using models and features.
In game theory, a game is in fact, a formalized description
of a strategic situation. However, this formalization could be
rigid in some cases, so we want to consider randomness. For
example, evolutionary behavior could cause randomness in
each player’s characteristics. In parallel trade also, players
can learn from mistakes, change their behavior, and grow in
size and power. Hence, we need a flexible tool to employ
game-theoretic formalization. Agent-based modeling can give
us this ability. In our agent-based model, agents will not decide
randomly, but they will consider the situation rationally, and
with the model they have, they will decide. Their decisions
could have several aspects, such as reducing the bargaining
power of the rival in the Nash bargaining situation or only
considering net profit. Employing such a model allows us to
simulate different scenarios and investigate various decisions.
Following what we discussed, this model can be devel-
oped further by considering more and more features and
characteristics. For example, we can formalize a company’s
personality with a basis of different characteristics like the
idea of Oldham and Morris [31] work where they formalized
a normal person’s personality as a combination of 16 different
disorders. Having such formalization can help us develop a
more realistic model where companies are different regarding
their past and decisions rather than having a model where
all the companies are the same. We can also consider some
characteristics of the product, such as medicine quality which
definitely impacts a user’s preference.
Considering all characteristics that we discussed, data can
provide information to approximate such characteristics and
features. Also, having historical data would enable us to
validate the model. However, companies may act according
to their strategy, which is related to their characteristics and
Preprint
growth overview. Considering the fact that currently, we did
not formalize the characteristics of a company before, we
may face a lack of data, which means that in some cases,
a simpler model can give us a better replication of an actual
world situation.
In our future work, we aim to involve other players in the
pharmaceutical trading market, such as wholesalers, hospitals,
and pharmacies. Although having information and defining
characteristics for each of these players would be a challenge,
we may need to involve them to get a more realistic replication
of such a market.
V. SUMMARY AND OUTLOOK
In this paper, we reviewed game theory and agent-based
modeling and simulation in an attempt to link both and
develop a basis for utilizing existing game theory models
towards building an agent-based model of the parallel trade
market of pharmaceuticals. Therefore, we presented a game
theoretic model of the pharmaceutical trading market, which
we subsequently used to develop an agent-based model for
this market, resulting improvement of agents’ efficiency in
autonomy and reactivity. After all, we discussed how using
an agent-based model for the pharmaceutical trading market
would be beneficial for different purposes, such as inves-
tigating the economic impact of parallel trade presence in
the pharmaceutical market or developing a decision support
system for the different players in this market. Developing an
agent-based model for the pharmaceutical parallel trade market
provides the opportunity to utilize available historical data of
this market to run a data-driven simulation. This simulation
can give us the opportunity to research economic parallel trade
impacts on players and prices, all players’ decision outcomes,
and market activities.
There are a number of aspects where we can further
develop this model. The first one is considering more than two
counties, we considered the current model as an initial model
to investigate the whole European pharmaceutical market.
Therefore, in future we will expand the model to more than
two countries. The second one is to define the personality of
each player in this market, considering different characteristics
for them. The third one is to consider more attributes and
interactions in the pharmaceutical market. Finally, we plan to
use historical data for the parameter estimation and simulation,
as well as validation of the model, leading to a software to
support the simulation of different decisions and scenarios
within the domain of parallel trade of pharmaceuticals.
ACK NOW LE DG ME NT
This work is partly funded by the Innovation Fund Denmark
(IFD) under File No. 9065-00207B.
REF ER EN CE S
[1] S. Bandini, S. Manzoni, and G. Vizzari, Agent based modeling and
simulation: an informatics perspective, Journal of Artificial Societies
and Social Simulation, vol. 12, no. 4, p. 4, 2009.
[2] S. Abar, G. K. Theodoropoulos, P. Lemarinier, and G. M. O’Hare,
“Agent based modelling and simulation tools: A review of the state-
of-art software,” Computer Science Review, vol. 24, pp. 13–33, 2017.
[3] C. Zhuge and C. Shao, “Agent-based modelling of purchasing, renting
and investing behaviour in dynamic housing markets, Journal of com-
putational science, vol. 27, pp. 130–146, 2018.
[4] Y. Shi, Q. Luo, and H. Li, “An agent-based model of a pricing process
with power law, volatility clustering, and jumps,” Complexity, vol. 2019,
2019.
[5] K. Chatterjee and W. Samuelson, Game theory and business applica-
tions. Springer, 2001.
[6] M. Sotomayor, J. D. P´
erez-Castrillo, and F. Castiglione, Complex
Social and Behavioral Systems: Game Theory and Agent-based Models.
Springer Nature, 2020.
[7] R. Jolly and W. Wakeland, “Using agent based simulation and game the-
ory analysis to study information sharing in organizations the infoscape,”
in Proceedings of the 41st Annual Hawaii International Conference on
System Sciences (HICSS 2008). IEEE, 2008, pp. 335–335.
[8] A. J. Collins and S. Etemadidavan, “Interactive agent-based simulation
for experimentation: a case study with cooperative game theory,” Mod-
elling, vol. 2, no. 4, pp. 425–447, 2021.
[9] M. N. Szilagyi, “Investigation of n-person games by agent-based mod-
eling,” Complex Systems, vol. 21, no. 3, pp. 201–243, 2012.
[10] P. Pecorino, “Should the us allow prescription drug reimports from
canada?” Journal of Health Economics, vol. 21, no. 4, pp. 699–708,
2002.
[11] S. Guo, B. Hu, and H. Zhong, “Impact of parallel trade on pharma-
ceutical firm’s profits: rise or fall?” The European Journal of Health
Economics, vol. 14, no. 2, pp. 345–355, 2013.
[12] D. Fudenberg and J. Tirole, Game theory. MIT press, 1991.
[13] R. B. Myerson, Game theory: analysis of conflict. Harvard university
press, 1997.
[14] M. J. Osborne and A. Rubinstein, A course in game theory. MIT press,
1994.
[15] E. Rasmusen, “Games and information. an introduction to game theory,
Theory and Decision, vol. 29, no. 2, 1990.
[16] O. Morgenstern and J. Von Neumann, Theory of games and economic
behavior. Princeton university press, 1953.
[17] P. D. Straffin Jr, Game theory and strategy. MAA, 1993, vol. 36.
[18] G. M. Grossman and E. L.-C. Lai, “Parallel imports and price controls,”
The Rand journal of economics, vol. 39, no. 2, pp. 378–402, 2008.
[19] C. M. Macal and M. J. North, “Tutorial on agent-based modeling and
simulation,” in Proceedings of the Winter Simulation Conference, 2005.
IEEE, 2005, pp. 14–pp.
[20] G. Dosi, G. Fagiolo, and A. Roventini, “An evolutionary model of
endogenous business cycles, Computational Economics, vol. 27, no. 1,
pp. 3–34, 2006.
[21] D. Weyns, N. Bouck´
e, and T. Holvoet, “Gradient field-based task
assignment in an agv transportation system,” in Proceedings of the fifth
international joint conference on Autonomous agents and multiagent
systems, 2006, pp. 842–849.
[22] M. Batty, Agent-based pedestrian modeling,” pp. 321–326, 2001.
[23] H. Hotelling, “Stability in competition,” in The collected economics
articles of Harold Hotelling. Springer, 1990, pp. 50–63.
[24] S. Tisue and U. Wilensky, “Netlogo: A simple environment for modeling
complexity, in International conference on complex systems, vol. 21.
Boston, MA, 2004, pp. 16–21.
[25] C. Adami, J. Schossau, and A. Hintze, “Evolutionary game theory using
agent-based methods,” Physics of life reviews, vol. 19, pp. 1–26, 2016.
[26] J. Smit and E. Plumb, “A case study of agent-based models for
evolutionary game theory,” arXiv preprint arXiv:2109.01849, 2021.
[27] F. Kermani, Another twist in the eu parallel trade saga,” Pharm.
Technol. Europe, vol. 2, no. 1, pp. 14–16, 2010.
[28] T. M. Valletti and S. Szymanski, “Parallel trade, international exhaustion
and intellectual property rights: a welfare analysis,” The Journal of
Industrial Economics, vol. 54, no. 4, pp. 499–526, 2006.
[29] G. Ackland, E. Chattoe-Brown, H. Hamill, K. Hampshire, S. Mariwah,
and G. Mshana, “The role of trust in a self-organizing pharmaceutical
supply chain model with variable drug quality and imperfect informa-
tion.” Journal of artificial societies and social simulation., vol. 22, no. 2,
p. 5, 2019.
[30] J. Zhang, “The benefits of consumer rebates: A strategy for gray market
deterrence,” European Journal of Operational Research, vol. 251, no. 2,
pp. 509–521, 2016.
[31] J. M. Oldham and L. B. Morris, The personality self-portrait. Bantam
New York, NY, 1990.
Preprint
... In an agent-based model, multiple autonomous agents with different characteristics interact with each other and the environment [26]. We presented the initial concept of using ABM for studying the pharmaceutical parallel trade market in [27], and here we further develop the concept into an algorithmic agentbased model, which enables us to run simulations. ...
Conference Paper
Pharmaceutical parallel trade is a legal trade in European countries, where traders can buy medicinal products in one country and sell them in other countries to make a profit. In the pharmaceutical parallel trade market, players such as manufacturers, wholesalers, parallel traders, pharmacies, and hospitals are involved. Studying and analyzing this market is of significant interest to economists and players involved. Agent-based modeling offers a robust algorithmic framework to analyze macroeconomic phenomena through micro-founded models. As an initial step in using agent-based modeling for the parallel trade of pharmaceuticals, we consider a simplified pharmaceutical trading market inspired by available game theory models. In this paper, we developed and elaborated the implementation of an agent-based model for the pharmaceutical trade market and employed it to run multiple scenarios that are impossible to analyze through game-theoretic models. Subsequently, we demonstrated how an agent-based model could be utilized to analyze the market from an economic perspective and how players in this market can recruit this model in their business decisions.
Chapter
The European pharmaceutical parallel trade refers to the practice of purchasing pharmaceutical products in one European Union (EU) member state at a lower price and reselling the products in another EU member state at a higher price. In the pharmaceutical market, pricing strategies are of utmost importance as the market structure and regulations allow only the lowest-priced product to gain market share, making it imperative for players to optimize their pricing decisions in order to remain competitive. Therefore, developing a dynamic and data-driven pricing strategy that takes into account market conditions, competitors’ behaviors, and regulatory compliance is of interest to players involved in this market. In this paper, we demonstrate the potential of agent-based modeling as a tool for integrating mathematical modeling and economic concepts and investigating targeted pricing strategies in the pharmaceutical parallel trade market. We achieve this by utilizing agent-based modeling to evaluate and compare multiple pricing strategies through simulation. We aim to identify the challenges associated with developing a dynamic pricing approach in this complex market by showcasing the effectiveness of agent-based modeling. We contribute to the understanding of pricing strategies and their implications in the pharmaceutical parallel trade market.KeywordsAgent-based modeling and simulationPricing strategyPrice competitionPharmaceutical parallel trade
Article
Full-text available
Incorporating human behavior is a current challenge for agent-based modeling and simulation (ABMS). Human behavior includes many different aspects depending on the scenario considered. The scenario context of this paper is strategic coalition formation, which is traditionally modeled using cooperative game theory, but we use ABMS instead; as such, it needs to be validated. One approach to validation is to compare the recorded behavior of humans to what was observed in our simulation. We suggest that using an interactive simulation is a good approach to collecting the necessary human behavior data because the humans would be playing in precisely the same context as the computerized agents. However, such a validation approach may be suspectable to extraneous effects. In this paper, we conducted a correlation research experiment that included an investigation into whether game theory experience, an extraneous variable, affects human behavior in our interactive simulation; our results indicate that it did not make a significant difference. However, in only 42 percent of the trials did the human participants’ behavior result in an outcome predicted by the underlying theory used in our model, i.e., cooperative game theory. This paper also provides a detailed case study for creating an interactive simulation for experimentation.
Conference Paper
Full-text available
Evolutionary game theory is a mathematical toolkit to analyse the interactions that an individual agent has in a population and how the composition of strategies in this population evolves over time. While it can provide neat solutions to simple problems, in more complicated situations where assumptions such as infinite population size may be relaxed, deriving analytic solutions can be intractable. In this short paper, we present a game with complex interactions and examine how an agent-based model may be used as a heuristic technique to find evolutionarily stable states.
Article
Full-text available
We present an Agent-Based Model (hereafter ABM) for a pharmaceutical supply chain operating under conditions of weak regulation and imperfect information, exploring the possibility of poor quality medicines and their detection. Our interest is to demonstrate how buyers can learn about the quality of sellers (and their medicines) based on previous successful and unsuccessful transactions, thereby establishing trust over time. Furthermore, this network of trust allows the system itself to evolve to positive outcomes (under some but not all circumstances) by eliminating sellers with low quality products. The ABM we develop assumes that rational and non-corrupt agents (wholesalers, retailers and consumers) learn from experience and adjust their behaviour accordingly. The system itself evolves over time: under some — but not all — circumstances, sellers with low-quality products are progressively eliminated. Three distinct states of the supply chain are observed depending on the importance of trust built up from past experience. The “dynamic” state is characterised by a low level of trust leading to a continually changing system with new drugs introduced and rejected with little regard to quality. The “frozen” state arises from high levels of reliance on past experience and locks the supply chain into a suboptimal state. The “optimising” state has moderate reliance on past experience and leads to the persistence of suppliers with good quality; however, the system is still “invadable” by better quality drugs. Simulation results show that the state reached by the system depends strongly on the precise way that trust is established: Excessive levels of trust make it impossible for new, improved treatments to be adopted. This highlights the critical need to understand better how personal experience influences consumer behaviour, especially where regulation is weak and for products like medicines whose quality is not readily observable.
Article
Full-text available
In this paper, we propose a new model of security price dynamics in order to explain the stylized facts of the pricing process such as power law distribution, volatility clustering, jumps, and structural changes. We assume that there are two types of agents in the financial market: speculators and fundamental investors. Speculators use past prices to predict future prices and only buy assets whose prices are expected to rise. Fundamental investors attach a certain value to each asset and buy when the asset is undervalued by the market. When the expectations of agents are exogenously driven, that is, entirely shaped by exogenous news, then they can be modeled as following a random walk. We assume that the information related to the two types of agents in the model will arrive randomly with a certain probability distribution and change the viewpoint of the agents according to a certain percentage. Our simulated results show that this model can simulate well the random walk of asset prices and explain the power-law tail distribution of returns, volatility clustering, jumps, and structural changes of asset prices.
Book
This volume in the Encyclopedia of Complexity and Systems Science, Second Edition, combines the main features of Game Theory, covering most of the fundamental theoretical aspects under the cooperative and non-cooperative approaches, with the procedures of Agent-Based Modeling for studying complex systems composed of a large number of interacting entities with many degrees of freedom. In Game Theory, the cooperative approach focuses on the possible outcomes of the decision-makers’ interaction by abstracting from the "rational" actions or decisions that may lead to these outcomes. The non-cooperative approach focuses on the actions that the decision-makers can take. As John von Neumann and Oskar Morgenstern argued in their path-breaking book of 1944 entitled Theory of Games and Economic Behavior, most economic questions should be analyzed as games. The models of game theory are abstract representations of a number of real-life situations and have applications to economics, political science, computer science, evolutionary biology, social psychology, and law among others. Agent-Based Modeling (ABM) is a relatively new computational modeling paradigm which aims to construct the computational counterpart of a conceptual model of the system under study on the basis of discrete entities (i.e., the agent) with some properties and behavioral rules, and then to simulate them in a computer to mimic the real phenomena. Given the relative immaturity of this modeling paradigm, and the broad spectrum of disciplines in which it is applied, a clear cut and widely accepted definition of high level concepts of agents, environment, interactions and so on, is still lacking. This volume explores the state-of-the-art in the development of a real ABM ontology to address the epistemological issues related to this emerging paradigm for modeling complex systems.
Article
Residential Location Choice (RLC) and Real Estate Price(REP) have been considered as highly correlated and therefore have been jointly studied. This paper develops an agent-based RLC-REP joint model as a key component of an integrated land use-transport model, SelfSim. RLC-REP is capable of simultaneously simulating purchasing, renting and investing behaviour, considering the interactions and competitions between different agent types in the housing market, including renter, landlord, purchaser, seller and investor agents, resulting in new residential locations and real estate prices. In addition, the demographic evolution model in SelfSim that is directly linked to the RLC-REP model is also introduced. Next, both global and local sensitivity analyses (SAs), which employ the Elementary Effect Method (EEM) and Once-At-A-Time (OAT) Method, respectively, are carried out to fully test RLC-REP in a numerical example set up based on a Chinese medium-sized city, Baoding. The EEM-based global SAs identify four influential parameters (among the thirty-four) that could significantly influence the outputs of interests. The OAT-based local SAs further explore how these four important parameters influence the outputs, suggesting that the interactions between parameters could heavily influence the model sensitivity. Finally, the potential applications of the SA results to calibrate the model and to set up “what-if” scenarios are discussed.
Article
The key intent of this work is to present a comprehensive comparative literature survey of the state-of-art in software agent-based computing technology and its incorporation within the modelling and simulation domain. The original contribution of this survey is two-fold: (1) Present a concise characterization of almost the entire spectrum of agent-based modelling and simulation tools, thereby highlighting the salient features, merits, and shortcomings of such multi-faceted application software; this article covers eighty five agent-based toolkits that may assist the system designers and developers with common tasks, such as constructing agent-based models and portraying the real-time simulation outputs in tabular/graphical formats and visual recordings. (2) Provide a usable reference that aids engineers, researchers, learners and academicians in readily selecting an appropriate agent-based modelling and simulation toolkit for designing and developing their system models and prototypes, cognizant of both their expertise and those requirements of their application domain. In a nutshell, a significant synthesis of Agent Based Modelling and Simulation (ABMS) resources has been performed in this review that stimulates further investigation into this topic.
Chapter
Agent-based modeling and simulation (ABMS) is a relatively new approach to modeling systems composed of autonomous, interacting agents. Agent-based modeling is a way to model the dynamics of complex systems and complex adaptive systems. Such systems often self-organize themselves and create emergent order. Agent-based models also include models of behaviour (human or otherwise) and are used to observe the collective effects of agent behaviours and interactions. The development of agent modeling tools, the availability of micro-data, and advances in computation have made possible a growing number of agent-based applications across a variety of domains and disciplines. This article provides a brief introduction to ABMS, illustrates the main concepts and foundations, discusses some recent applications across a variety of disciplines, and identifies methods and toolkits for developing agent models.
Article
The recent developments in agent-based modeling of several N-person games are reviewed and some features of the author's software tools as well as some applications are described. After explaining the transition from two-person to N-person games, the classification and properties of N-person games, our software tools, and agent personalities, the following N-person games are considered: prisoners' dilemma, chicken dilemma, battle of the sexes game, games with crossing payoff functions, a new game with parabolic payoff functions, transitions between different N-person games, and analytical solutions of N-person games. Several practical applications are then considered.