Conference PaperPDF Available

Extended Artificial Pheromone System for Swarm Robotic Applications

Authors:
Extended Artificial Pheromone System for Swarm Robotic Applications
Seongin Na1, Mohsen Raoufi2, Ali Emre Turgut3, Tom´
aˇ
s Krajn´
ık4, and Farshad Arvin1
1School of Electrical and Electronic Engineering, The University of Manchester, M13 9PL, Manchester, UK
seongin.na@student.manchester.ac.uk , farshad.arvin@manchester.ac.uk
2Department of Aerospace Engineering, Sharif University of Technology, Tehran, Iran
3Mechanical Engineering Department, Middle East Technical University, 06800 Ankara, Turkey
4Artificial Intelligence Centre, Faculty of Electrical Engineering, Czech Technical University, Prague, Czechia
Abstract
This paper proposes an artificial pheromone communication
system inspired by social insects. The proposed model is an
extension of the previously developed pheromone commu-
nication system, COS-Φ. The new model increases COS-
Φflexibility by adding two new features, namely, diffusion
and advection. The proposed system consists of an LCD
flat screen that is placed horizontally, overhead digital cam-
era to track mobile robots, which move on the screen, and
a computer, which simulates the pheromone behaviour and
visualises its spatial distribution on the LCD. To investigate
the feasibility of the proposed pheromone system, real micro-
robots, Colias, were deployed which mimicked insects’ role
in tracking the pheromone sources. The results showed that,
unlike the COS-Φ, the proposed system can simulate the im-
pact of environmental characteristics, such as temperature, at-
mospheric pressure or wind, on the spatio-temporal distribu-
tion of the pheromone. Thus, the system allows studying be-
haviours of pheromone-based robotic swarms in various real-
world conditions.
Introduction
Social insects are known for conducting complex tasks with
coordination in highly effective ways. They carry out com-
plicated tasks such as food foraging, aggregating, mat-
ing, etc. using limited perception and memory capabil-
ities (Schmickl et al., 2009; Jackson and Morgan, 1993;
Agosta, 1992; Schmickl et al., 2016; Michener and Press,
1974). Those complex tasks require effective communi-
cation mechanisms within a group of insects. As a key
to achieve the effective communication, several social in-
sects use pheromones which is a medium for the stigmergic
behaviours. Stigmergy is an indirect coordination mecha-
nism using a shared communication medium (Theraulaz and
Bonabeau, 1999). A medium created by an agent in the en-
vironment actuates the other agents to perform certain ac-
tions without any direct communication between them (Hey-
lighen, 2016; Marsh and Onof, 2008). As an example of
how stigmergy is used, an ant releases trail pheromone when
it detects food and other ants detect the trail and follow
it (Jackson and Ratnieks, 2006; Wyatt, 2003; Sumpter and
Beekman, 2003).
Figure 1: Artificial pheromone system including a horizon-
tally placed LCD screen, overhead camera for tracking sys-
tem and a computer.
This coordination mechanism has remarkable features
compared with other traditional methods such as direct com-
munication. First of all, it achieves optimisation through
positive and negative feedback (Jackson and Ratnieks, 2006;
Sumpter and Beekman, 2003; Theraulaz and Bonabeau,
1999; Heylighen, 2016). By reinforcing or suppressing the
medium at a position depending on how close it is to the
goal, the agents can carry out the tasks in an optimal man-
ner, e.g. the shortest path for food foraging is created af-
ter multiple iterations with reinforcement and suppression
on the pheromone trail. Secondly, it does not require com-
plex functionality for each agent (Heylighen, 2016). Com-
pared to the conventional methods, stigmergy demands sig-
nificantly lower capability for each agent. For instance,
an agent does not need to save information into its mem-
ory because it is saved in and read from the media. As an
another example, an agent does not have planning or an-
ticipation ability since it performs tasks only based on the
present media. The advantages of stigmergy have inspired
researchers who study swarm robotics especially adopting
pheromone (Fossum et al., 2014; Purnamadjaja and Russell,
608
2007; Font Llenas et al., 2018). Researchers have devel-
oped and implemented artificial pheromone systems with
different means from chemical substances and RFID chips
to light-based means and virtualization system (Arvin et al.,
2018b; Fujisawa et al., 2014; Herianto and Kurabayashi,
2009; Arvin et al., 2015; Valentini et al., 2018; Beckers et al.,
2000). The methods using chemical means duplicate evapo-
ration, diffusion, locality and reactivity which are the char-
acteristics of pheromone in the real world (Fujisawa et al.,
2014). Besides, different kinds of chemical substances can
be used as different kinds of pheromone which have distinct
functionality (Purnamadjaja and Russell, 2007). Although
their similarities to the pheromone in the real world con-
tributes to mimic the important features of the pheromone,
it is difficult to control the properties of the chemical sub-
stances such as evaporation and diffusion rates. Hence, it
is challenging to be used as an experimental tool (Fujisawa
et al., 2014; Sugawara et al., 2004). Additionally, sensing
technology for chemical substances has to be improved to
detect reasonably small amount of chemicals (Purnamadjaja
and Russell, 2010).
The methods using RFID chips have advantages in swarm
robotics because they use low-cost data carriers and it is
free from batteries. However, the fixed size of data carri-
ers does not allow this method to be used with different res-
olutions (Herianto and Kurabayashi, 2009). Virtualization
system is a relatively new method implementing pheromone
communication which reads data from robots, sends the data
to virtual map for mapping and sharing to the robots in the
swarm. In spite of its bidirectional communication and ca-
pacity for large-scale swarm robotics application, the virtu-
alisation of sensors and actuators are restricted by the reso-
lution of the grid (Valentini et al., 2018). Light-based meth-
ods have a number of advantages which cover certain limi-
tations present in the other methods (Arvin et al., 2015; Gar-
nier et al., 2007). The characteristics of pheromone such as
evaporation and diffusion are easily controllable. Further-
more, light-based methods have significantly higher resolu-
tion than the methods using RFID chips or virtualization en-
vironment. Moreover, different types of pheromone can be
implemented since various colors of light can be used (Arvin
et al., 2018a; Jackson and Ratnieks, 2006).
One of the light-based artificial pheromone communica-
tion systems, COSΦ, (Arvin et al., 2015) has four advan-
tages as follows: (1) Precise pheromone trail can be cre-
ated by using high-resolution horizontal LCD screen as an
arena to project light-based artificial pheromones. (2) Char-
acteristics of pheromone such as evaporation and thickness
are easily and precisely modified. (3) Pheromone can be
overlapped or suppressed so that positive feedback and neg-
ative feedback can be implemented. (4) Numerous types of
pheromone can be generated using RGB colors. Although
the system has advantageous features listed above, there are
points which can be developed for more diverse functions
and applications.
The goal of this work is extending COSΦsystem to
cover its limitation. Although evaporation and injection
of pheromones was clearly replicated in the system, diffu-
sion was not implemented whereas it is a necessary fea-
ture of temporal pheromone development (Herianto and
Kurabayashi, 2009; Sugawara et al., 2004; Ji et al., 2013).
Furthermore, the mathematical model of the pheromone up-
dating is expanded. Therefore, it includes advection of the
pheromone by the wind and the advection effect is applied
in the system. This expanded system is expected to offer
more options to users for bio-inspired swarm robotic stud-
ies (Figure 1). Adding the two phenomena has the meaning
described below.
Diffusion is the movement of molecules from the area of
higher concentration to those of lower concentration. So-
cial insects follow pheromone trail, they detect diffused
pheromone rather than contacting to the trail and moving
directly along it (Wyatt, 2003). Despite its importance,
it was not modelled and implemented in the previous re-
search. Therefore, it is meaningful to apply diffusion ef-
fect.
Advection is the transfer of substances or any quantity by
the flow of a fluid, like wind. In fact, pheromone, as a
substance, is transported by wind which is the flow of the
air. Through applying the advection effect with different
velocity and direction, we have a more reliable model and
figure out how wind influences to the pheromone commu-
nication.
This paper is arranged as follows: Section II presents ar-
tificial pheromone system, COSΦ, Section III presents the
proposed extended properties of the COSΦ, Section IV pro-
vides experimental configurations, and Section V presents
the results from experiments and discusses the outcomes.
Artificial Pheromone System, COSΦ
In the previous project (Arvin et al., 2015), COSΦ(Com-
munication System via Pheromone) was introduced. It has
a software system and a robotic platform. The software sys-
tem consists of two major parts. The first part is a visual
localization system, SwarmCon (Krajn´
ık et al., 2014). It
reads the position of robots using a camera attached above
the arena and sends their information to the pheromone re-
leasing system which displays light on the LCD screen. The
second part is a pheromone releasing system. After re-
ceiving the position data from the localisation system, the
pheromone releasing system computes where and how much
the pheromone will be injected accordingly. The system also
repetitively updates the obtained pheromone data reflecting
the development of released pheromone over time in reality.
The system subsequently displays a gray-scale image based
on the pheromone data on the LCD screen.
609
COSΦhas three remarkable features which make this
system more reliable and user-friendly to be used as an
experimental platform for researchers in the field of biol-
ogy, swarm robotics or other related disciplines: i) It pro-
vides highly precise location data of robots and pheromone
through SwarmCon system. Moreover, its resolution is equal
to that of the LCD screen; hence, the smallest controllable
size of the pheromone is equivalent to a pixel of the screen.
ii) It has high flexibility allowing the users to change exper-
imental conditions, settings and even initial characteristics
of the pheromone in order to fit their needs. iii) It is a low-
cost platform. COSΦrequires only a low-cost USB camera,
an LCD screen as an arena, and the low-cost micro-robots,
Colias (Arvin et al., 2014).
Pheromone Model
The gray-scale image displayed on the LCD screen com-
puted by the system based on Equation 1.
I(x, y) =
n
X
i=1
ciΦi(x, y)(1)
The brightness of a pixel at a position (x,y), I(x, y)is de-
termined by the multiplication of Φi(x, y)which represents
ith pheromone intensity and ciwhich denotes how strong
the ith pheromone is displayed on the screen. Since the
system can use multiple different types of pheromone, the
brightness of a pixel is the sum of the effect of ndifferent
pheromones released at a position.
In the previous project (Arvin et al., 2015), the change in
the intensity of pheromone at a position (x,y) at a time, ˙
Φi,
is defined by
˙
Φi=ln 2
eiΦ
Φi(x, y) + κiΦi(x, y) + ιi(x, y )(2)
where eiΦ, κiare the evaporation constant and diffusion
constant respectively and ιi(x, y)denotes the amount of in-
jected pheromone at a time. In the previous study (Arvin
et al., 2015), only evaporation and injection terms were ap-
plied into the development in the pheromone concentration.
The two phenomena influence the pheromone in the ways
explained in the below two subsections. Diffusion model is
described in the next section.
Evaporation
Evaporation of the deposited pheromone in the real world
is a fundamental feature of pheromone as a chemical sub-
stance. The intensity of pheromone decays over time due to
evaporation. This model exhibits that the pheromone expo-
nentially decays over time without spreading to the adjacent
positions. Figure 2 shows how the pheromone evaporates
with eiΦ= 20 at t={0,1,2,3}s illustrated by the black,
red, green and blue line respectively. The pheromone is ini-
tially released from x[200,300] with the intensity of 255.
Figure 2: Evaporation of pheromone over time t= 0s
(black), t= 1s (red), t= 2s (green) and t= 3s (blue).
Its horizontal axis denotes the x position of the pheromone
in the 2-D arena with the size of 500×500 pixels, and the
vertical axis is the intensity of the pheromone between 0 and
255.
Injection
The injection ιi(x,y) represents the amount of the newly in-
jected ith pheromone at the position (x,y). In the system,
ιi(x,y) is defined by
ιi(x, y) = (sΦ,if p(xxr)2+ (yyr)2lΦ/2
0,otherwise
(3)
where, (xr, yr) is the position of the robot, lΦis the diam-
eter of the pheromone injected at the time and sΦis the
pheromone release rate.
Extended Pheromone System
Based on the previous model of the pheromone temporal
development and the mathematical model of moving sub-
stances through the fluid proposed in (Stam, 2005), the evo-
lution of the pheromone intensity field is developed as fol-
lows:
˙
Φi(x, y) = u· ∇Φi(x, y)ln 2
eiΦ
Φi(x, y)+
κi2Φi(x, y) + ιi(x, y),
(4)
where, uis a two-dimensional vector field which represents
the wind velocity field. This equation stems from Navier-
Stokes equation which illustrates the motion of fluids. It
is assumed that the pheromone is a non-reactive substance.
Hence, the pheromone does not vary by chemical reaction
but the factors described in Equation 4.
Diffusion
As previously mentioned, diffusion is one of the factors of
the pheromone behaviour. In the Equation 4, diffusion is
described as κi2Φi(x, y). For the sake of computation
610
Figure 3: Diffusion of pheromone over time t= 0 s (black),
t= 1 s (red), t= 2 s (green) and t= 3 s (blue).
simplicity, diffusion is implemented with the approximate
model using the Gaussian filter. It contains analogous fea-
tures to what the actual diffusion model has. i) The to-
tal amount of the pheromone is conserved while it diffuses
ii) The pheromone at a position is distributed to the neigh-
bour positions and the pheromone from surrounding posi-
tions diffuses to the position. Moreover, the intensity of
the pheromone at a position increases if it is surrounded by
greater intensity of the pheromone. Conversely, the inten-
sity decreases if the intensity of the pheromone of its nearby
positions is lower than it.
Φk+1
i(x, y) = ωΦk
i(x, y) =
a
X
s=a
b
X
t=b
ω(s, t)Φk
i(xs, y t),(5)
where ωis a kernel matrix with the size of (2a+1)×(2b+1)
which is convolved with the matrix of the ith pheromone
strength Φk
iat kth iteration, and ωis defined by the equation
below:
ω(x, y) = 1
2πσ2ex2+y2
2σ2, w R2a+1×2b+1,(6)
where the element at ((a+ 1),(b+ 1)) is assigned as (0,0)
of ωand σis the standard deviation of elements of ω. The
elements of the kernel are determined based on the Gaussian
distribution. The further an element from the center of the
matrix is, the smaller value the element has. Figure 3 shows
the diffusion of pheromone at t={0,1,2,3}s illustrated by
the black, red, green and blue line respectively. The axes are
identical to Figure 2. At t= 0 s, the pheromone released on
x= 200300 has the intensity of 255. The arena size is also
500 ×500 pixels and the kernel size is 95 ×95 pixels and
σ= 20. Every time the pheromone is updated with the dif-
fusion, the area where the pheromone is deposited expands
while the maximum intensity of the pheromone decreases.
Figure 4: Advection of pheromone over time t= 0 s (black),
t= 1 s (red), t= 2 s (green) and t= 3 s (blue).
Advection
The change in pheromone intensity at the position (x,y) by
advection is simply described as u· ∇Φi(x, y)in Equation
4. The dot multiplication of the wind velocity field uand
the gradient of the pheromone can be expressed as:
u· ∇Φi(x, y) = ux·Φi(x, y)
∂x +uy·Φi(x, y)
∂y ,(7)
where uxand uyare the x- and y-component of u, respec-
tively. In this project, same magnitude of uxand uyare
applied on the entire field. In other words, the wind with
a given magnitude and direction blows equally at all the
positions. Figure 4 shows the advection of the pheromone
along the x axis where ux= 50, namely, the wind speed
is 50 pixel/s. The pheromone is initially injected from
x[200,300] with the intensity of 255. The black, red,
green and blue lines represent the intensity of the pheromone
on the xposition at t={0,1,2,3}s. It is illustrated that the
wind causes the pheromone to be transferred in the almost
parallel manner without a considerable change in the shape.
Experimental Setup
There are three different experimental configurations to
study: i) effects of diffusion, ii) effects of advection, and
iii) combination of both diffusion and advection on the be-
haviour of the robots. Also, we run a set of experiments
excluding pheromone effects as the control.
A circular cue (with diameter of 25 cm) with a maximum
intensity of pheromone at the centre, source of pheromone
injection, is projected on the right hand side of the area
(screen) and the robots are randomly placed on the left hand
side of the arena. Each experiment takes 5 min and we anal-
yse the collective behaviour of the proposed system with two
metrics which are: i) number of robots at the pheromone
source and ii) average distance of the robots from the centre
of the pheromone source.
It must be mentioned that the robots do not deposit
pheromone during experiments; hence, they only change
611
their direction towards the highest intensity pheromone trail.
The pheromone cue is only injected once at the initial stage
t= 0 s of each experiment.
Arena Configuration
Arena that is used in this work is analogous to the experi-
mental setup presented in (Arvin et al., 2015). It includes a
horizontally placed 42” flat LCD screen, a USB camera, and
a computer to track the robots and manage the pheromone
system. Figure 1 shows the experimental setup that was used
in this work.
Utilizing this system, we are able to determine whether or
not a robot is reached the cue. In this regard, at the beginning
of each experiment, we store the brightness of each pixel in
a matrix Ia. Then, the localisation system detects the tags of
four corners and calculates the transformation between the
arena and camera coordinate systems. Similarly, it allows
us to detect the robots and measure their positions on the
field. Then, the visual system takes the brightness of the
current image as Icand compares its with Ia.By finding the
largest circular continuous segment in Icand calculating its
position (xc, yc)and average brightness bc, the cue zone is
determined.
Robotic Platform
Colias micro-robot (Arvin et al., 2014) was utilised in this
study to test the feasibility of the proposed extensions (Fig-
ure 5-a). Colias is a low-cost open-source mobile robot uses
an AVR micro-controller as its main processor. It has three
short-range infrared proximity sensors at the front to detect
obstacles and other robots. Colias has two light intensity
sensors (Figure 5-b) at the bottom of the robot, sland sr
on the left and right hand side, respectively. Motors’ rota-
tional velocities, Nland Nr, are directly controlled using
measurements from these two sensors:
Nl=slsr
α+β ,
Nr=srsl
α+β ,
(8)
where, αis the velocity sensitivity coefficient and βis a bi-
asing speed. In this work, βrelies on the average pheromone
intensity, because the higher intensity results in the lower ve-
locity:
β= 100 sr+sl
2.(9)
This relation between βand the sensors measurements is
tuned empirically. The main idea is to reduce the speed of
motion near source of the pheromone to keep the robots at
the high intensity pheromone cue. Therefore, there are two
direct impacts of the pheromone on the robots behaviour
which are: i) controlling angular velocity of the robot to di-
rect robot to the centre of the pheromone and ii) reducing
speed of the robot with increasing pheromone intensity.
Figure 5: (a) Colias micro-robot and (b) bottom of the robot
including light intensity sensors.
Experiments
Three pheromone configurations were implemented. The
first configuration was diffusion speed with two settings:
1. Diffusion-A: pheromones diffuse by a rate which results
in diffusion of 25% of total pheromone till t=300 s (eiΦ=
1000, a, b = 7 and σ= 0.3)
2. Diffusion-B: pheromones diffuse by a rate which results
in diffusion of 50% of total pheromone till t=300 s (eΦ=
1000, a, b = 7 and σ= 6)
The second set of experiments were conducted with various
advection speeds:
1. Advection-A: pheromone spot moves with the wind speed
of 2.27 pixel/s to the left hand side of the arena during
t= 300 s (eiΦ= 1000, ux= 2.27 and uy= 0)
2. Advection-B: pheromone spot moves with the wind speed
of 4.53 pixel/s to the left hand side of the arena during
t= 300 s (eiΦ= 1000, ux= 4.53 and uy= 0)
The third set of experiments were conducted with combin-
ing Diffusion-B and Advection-B. Apart from the 5 distinct
configurations which are already mentioned, we applied a
simple experiment in which the effect of neither diffusion
nor advection is considered. All of these 6 experiments were
conducted with two population sizes of N∈ {4,6}robots.
Moreover, for each configuration, 5 independent runs are ap-
plied.
In order to assess the effect of these two phenomena on
the behaviour of the system, two different variables are de-
fined. The number of robots on pheromone, a dimensionless
variable, is the ratio of number of robots which are located
within the cue to all robots in the arena. The second vari-
able is “coherence distance”, dcoh , indicating the average
distance of all robots to the center of cue, which is defined
by the following equation:
dcoh =1
N
N
X
i=1
k(xi, yi),(xc, yc)k(10)
in which, (xi, yi)and (xc, yc)are the location of i-th robot
and cue center, respectively, and k.kis the Euclidean dis-
tance operator between two points in a 2-D space.
612
(a) (b)
(c) (d)
(e) (f)
Figure 6: The arena, robots and pheromone from the camera
perspective, illustrating the experiments of Advection-B, as
well as Diffusion-B + Advection-B . Each row is related to
a specific time t={0,60,180}s, respectively.
Results & Discussion
The results of the above-mentioned experiments are pre-
sented in this section. Figure 6 shows several images from
randomly selected experiments at various times showing the
effect of diffusion and advection on the system. The images
in the left column show an experiment with the configura-
tion of Advection-B with 6 robots, and the images of the
right column have the configuration of mixed Diffusion-B
and Advection-B. In the left column, the effect of wind on
the movement of the cue is shown vividly. The cue starts to
move from the right side toward the left side of the arena due
to advection. In this case, the number of robots which were
able to find and stay at the cue is raised. The effect of diffu-
sion on the pheromone is clearly shown in the right column;
The sharp edge of the cue fades by time, resulting in lower
number of robots remained in the cue. To such an extent that
some of them lost the cue and wander in the arena. On the
other hand, it makes the robots to stay closer to the center of
cue, and as a result, the coherency of the robots increases.
Meanwhile, the advection affects the cue location.
To study the effect of diffusion on the behaviour of robots,
Figure 7 demonstrates the pheromone intensity and coher-
ence distance for three different configurations set of exper-
iments: i) No effects, ii) Diffusion-A, and iii) Diffusion-B.
As shown in Figure 7 (a), the number of robots reached the
(a) (b)
Figure 7: Effect of diffusion on the behaviour of robots. (a)
The number of robots on pheromone and (b) Coherence dis-
tance
(a) (b)
Figure 8: Effect of advection on the behaviour of robots.
(a) The number of robots on pheromone and (b) Coherence
distance
spot in Diffusion-A and B are close to that of with no effect
configuration. However, when time went and the pheromone
diffused to the neighbor areas, the cue shrunk and the robots
left the cue. As what we expected, this separation happened
for Diffusion-B much earlier than Diffusion-A. The diffu-
sion has another impact on the behaviour of robots, which
results in more coherence. Prior to separation, the robots in
the cue stayed closer to the center of cue. This can be seen
not only from Figure 6 (d), but also from the Figure 7 (b).
The effect of advection on the behaviour of robots can be
seen in Figure 8, in which 6 robots are utilized. Compared
to the ‘no effect’ configuration, the number of robots which
were able to find the cue increased when advection is con-
sidered. However, the influence of wind on the coherency is
negligible.
Finally, the result of combination of both concepts are il-
lustrated in Figure 9 besides the result of ’no effect’ case.
We can see that the number of robots on pheromone is gen-
erally more than the simple case, but, same as Figure 7, it
starts to drop after a time called separation time.
To investigate the effects of different factors on collec-
tive behaviour of the swarm, all the results were statisti-
cally analysed using 2-way Analysis of Variance (ANOVA).
Table 1 and Table 2 show the results of ANOVA test for
number of robots on pheromone and coherence distance.
613
(a) (b)
Figure 9: Effect of both diffusion and advection on the be-
haviour of robots. (a) The number of robots on pheromone
and (b) Coherence distance
Table 1: Results of ANOVA test for number of robots on
pheromone
Factors p-value F-value
Exp. Configuration 0.000 132.708
Time 0.000 2.512
Based on the results, both factors, time and experiment con-
figurations, significantly affected the swarm. However, the
configuration was the most significant factor in number of
robots on pheromone (F=132.708) and coherence distance
(F=80.156).
Table 2: Results of ANOVA test for coherence distance
Factors p-value F-value
Exp. Configuration 0.000 80.156
Time 0.000 4.639
Conclusion
This paper added two new properties – diffusion and ad-
vection– to the previously developed artificial pheromone
system, COS-Φ. Three set of experimental configurations
were conducted to investigate the performance of the pro-
posed properties. Coherence distance and number of robots
on the pheromone spot were tracked during experiments.
The results were statistically analysed and the most effec-
tive factor was detected. The future work is to include sev-
eral robots with capability of injecting pheromones and to
study inter- robot interactions using the updated artificial
pheromone communication.
Acknowledgement
This work was supported by EPSRC RNE (EP/P01366X/1),
EPSRC RAIN (EP/R026084/1), and Czech Ministry of Sci-
ence and Education grant ‘Research Centre for Informatics’
number CZ.02.1.01/0.0/0.0/16 019/0000765.
References
Agosta, W. (1992). Chemical Communication: The Lan-
guage Of Pheromones. Henry Holt and Company.
Arvin, F., Espinosa, J., Bird, B., West, A., Watson, S., and
Lennox, B. (2018a). Mona: an affordable open-source
mobile robot for education and research. Journal of
Intelligent & Robotic Systems, pages 1–15.
Arvin, F., Krajn´
ık, T., Turgut, A. E., and Yue, S. (2015).
COSΦ: artificial pheromone system for robotic swarms
research. In IEEE/RSJ International Conference on In-
telligent Robots and Systems (IROS), pages 407–412.
IEEE.
Arvin, F., Murray, J., Zhang, C., and Yue, S. (2014). Col-
ias: An autonomous micro robot for swarm robotic ap-
plications. International Journal of Advanced Robotic
Systems, 11(7):113.
Arvin, F., Turgut, A. E., Krajn´
ık, T., Rahimi, S., Okay, I. E.,
Yue, S., Watson, S., and Lennox, B. (2018b). ΦClust:
Pheromone-Based Aggregation for Robotic Swarms.
In IEEE/RSJ International Conference on Intelligent
Robots and Systems (IROS), pages 4288–4294.
Beckers, R., Holland, O. E., and Deneubourg, J.-L. (2000).
From Local Actions to Global Tasks: Stigmergy and
Collective Robotics, pages 1008–1022. Springer
Netherlands, Dordrecht.
Font Llenas, A., Talamali, M. S., Xu, X., Marshall, J. A.,
and Reina, A. (2018). Quality-sensitive foraging by a
robot swarm through virtual pheromone trails. In In-
ternational Conference on Swarm Intelligence, pages
135–149. Springer.
Fossum, F., Montanier, J., and Haddow, P. C. (2014). Re-
pellent pheromones for effective swarm robot search in
unknown environments. In IEEE Symposium on Swarm
Intelligence, pages 1–8.
Fujisawa, R., Dobata, S., Sugawara, K., and Matsuno,
F. (2014). Designing pheromone communication in
swarm robotics: Group foraging behavior mediated by
chemical substance. Swarm Intelligence, 8(3):227–
246.
Garnier, S., Tˆ
ache, F., Combe, M., Grimal, A., and Ther-
aulaz, G. (2007). Alice in pheromone land: An exper-
imental setup for the study of ant-like robots. In IEEE
Swarm Intelligence Symposium, pages 37–44.
Herianto and Kurabayashi, D. (2009). Realization of an ar-
tificial pheromone system in random data carriers us-
ing rfid tags for autonomous navigation. In 2009 IEEE
International Conference on Robotics and Automation,
pages 2288–2293.
614
Heylighen, F. (2016). Stigmergy as a universal coordination
mechanism i: Definition and components. Cognitive
Systems Research, 38:4 – 13. Special Issue of Cognitive
Systems Research Human-Human Stigmergy.
Jackson, B. D. and Morgan, E. D. (1993). Insect chemical
communication: Pheromones and exocrine glands of
ants. CHEMOECOLOGY, 4(3):125–144.
Jackson, D. E. and Ratnieks, F. L. (2006). Communication
in ants. Current Biology, 16(15):R570 – R574.
Ji, J., Song, X., Liu, C., and Zhang, X. (2013). Ant colony
clustering with fitness perception and pheromone dif-
fusion for community detection in complex networks.
Physica A: Statistical Mechanics and its Applications,
392(15):3260–3272.
Krajn´
ık, T., Nitsche, M., Faigl, J., Vanˇ
ek, P., Saska, M.,
Pˇ
reuˇ
cil, L., Duckett, T., and Mejail, M. (2014). A prac-
tical multirobot localization system. Journal of Intelli-
gent & Robotic Systems, 76(3):539–562.
Marsh, L. and Onof, C. (2008). Stigmergic epistemol-
ogy, stigmergic cognition. Cognitive Systems Research,
9(1):136 – 149. Perspectives on Social Cognition.
Michener, C. and Press, B. (1974). The Social Behavior of
the Bees: A Comparative Study. Belknap Press Series.
Belknap Press of Harvard University Press.
Purnamadjaja, A. H. and Russell, R. A. (2007). Guid-
ing robots’ behaviors using pheromone communica-
tion. Autonomous Robots, 23(2):113–130.
Purnamadjaja, A. H. and Russell, R. A. (2010). Bi-
directional pheromone communication between robots.
Robotica, 28(1):6979.
Schmickl, T., Stefanec, M., and Crailsheim, K. (2016). How
a life-like system emerges from a simple particle mo-
tion law. Scientific reports, 6:37969.
Schmickl, T., Thenius, R., Moeslinger, C., Radspieler, G.,
Kernbach, S., Szymanski, M., and Crailsheim, K.
(2009). Get in touch: cooperative decision making
based on robot-to-robot collisions. Autonomous Agents
and Multi-Agent Systems, 18(1):133–155.
Stam, J. (2005). Stable fluids. pages 121–128.
Sugawara, K., Kazama, T., and Watanabe, T. (2004).
Foraging behavior of interacting robots with virtual
pheromone. In IEEE/RSJ International Conference on
Intelligent Robots and Systems (IROS), volume 3, pages
3074–3079.
Sumpter, D. J. and Beekman, M. (2003). From nonlinearity
to optimality: pheromone trail foraging by ants. Animal
Behaviour, 66(2):273 – 280.
Theraulaz, G. and Bonabeau, E. (1999). A brief history of
stigmergy. Artificial Life, 5(2):97–116.
Valentini, G., Antoun, A., Trabattoni, M., Wiandt, B.,
Tamura, Y., Hocquard, E., Trianni, V., and Dorigo, M.
(2018). Kilogrid: a novel experimental environment for
the kilobot robot. Swarm Intelligence, 12(3):245–266.
Wyatt, T. (2003). Pheromones and Animal Behaviour: Com-
munication by Smell and Taste. Cambridge University
Press.
615
... However, giving real robots the capability to mark the environment with indications of their activities is still an open technological challenge (Corne et al. 2012). In some studies, researchers have developed smart environments to enable pheromonebased stigmergy, for instance, by using: (i) a system of stationary devices (e.g., RFID tags) spread throughout the environment to store virtual pheromones (Alfeo et al. 2019;Campo et al. 2010;Goss et al. 1992;Khaliq et al. 2014;Payton et al. 2001), (ii) devices to display or project virtual pheromones on the ground (Garnier et al. 2013;Hunt et al. 2019;Na et al. 2020Na et al. , 2019, or (iii) augmented reality to immerse the robots in a virtual environment in which they can lay and sense pheromones (Antoun et al. 2016;Reina et al. 2017;Talamali et al. 2020). These systems are flexible, powerful, and enable the implementation of complex coordination mechanisms. ...
... A number of researchers have proposed different approaches in which an external infrastructure is used to partially or completely store the stigmergic information. For instance, the movement of robots is tracked using an overhead camera and the pheromone trails are then either projected on the ground (Garnier et al. 2013;Hunt et al. 2019;Talamali et al. 2020) or displayed on LCD screens that serve as the floor on which the robots move (Arvin et al. 2015;Na et al. 2020Na et al. , 2019. Although the pheromone information is stored digitally in a centralized infrastructure, it is conveyed to robots using colors displayed on LCDs or projected onto the ground. ...
Thesis
Full-text available
This dissertation aims to automatically design pheromone-based stigmergy in robot swarms, addressing two key challenges in swarm robotics: i) the automatic design of stigmergy-based collective behaviors, and ii) the real-world implementation of such systems. While manual design of stigmergy-based behaviors in swarm robotics is possible, it is a complex and resource-intensive process. Designing collective behaviors for loosely coupled, autonomous robots is inherently difficult, and even more so when environmental modification is necessary. Optimization-based design provides an alternative, but could often requires some human input to fine-tune a produced control software. This dissertation explores a fully-automatic design method that is based on automatic modular design method, striving to eliminate the need for human intervention. While stigmergy-based behaviors hold great promise for robot swarms, practical implementation faces challenges. Virtual stigmergy aids in simulation, but fails to capture the dynamic, environment-altering nature essential to its true potential. Physical methods like alcohol trails or external tracking systems can be expensive, complex, and potentially compromise robot autonomy. This research introduces Phormica, a cost-effective solution using special surfaces and UV LEDs to create artificial pheromones, enabling broader experimentation in real-world scenarios. To demonstrate these concepts, I introduce Habanero, an automatic design method to design stigmergy-based control software. Using a swarm of e-puck robots, I evaluate Habanero’s performance across different missions and compared it to alternative design methods like neuroevolution-based design, manual design, and random-walk behavior. Our experimental results show that Habanero is a viable approach for pheromone-based stigmergy design. The produced behaviors are comparable to, sometimes outperforming, those created by human designers. Interestingly, while Habanero’s modules are mission-agnostic, the devised strategies are mission-specific. The automatic process effectively leverages pheromone-based stigmergy to create collective behaviors demonstrating spatial organization, memory, and communication.
... Virtual worlds that use digital doubles can be a great starting point for understanding pervasive RFID computing in the real world, according to Na et al. (2019), which came to this realization a year ago. As a result of relevant research, Koutitas et al. (2018) presents a proven new concept known as the "Virtual Environment of Things," or rather "VEoT," allowing physicalbased intelligent objects and virtual artifacts to communicate in real-time within a CAD virtual environment. ...
Thesis
Full-text available
The Design Science Research (DSR) concentrated on creating a virtual to real-world synchronization model of CAD (Computer-Aided Design) Radio Frequency Identification RFID and RFID hardware devices and closed the knowledge gap and lack of scholarly literature on CAD and RSSI optimization modeling.
... Several natural systems [6,8,14,16,17] use stigmergy as a recruitment strategy, wherein the agents leave signals such as pheromones in the environment. This serves as a spatio-temporal memory to harness more individuals into the collective, and has inspired the design of synthetic systems [18][19][20][21][22][23][24][25][26][27][28][29]. Then, task execution using stigmergy can be thought of as a triadic interaction between three relevant variables: the agents, the stigmergic communication field, and the environment (see Fig. 1(d)) which vary spatio-temporally towards task execution. ...
Preprint
Full-text available
Cooperative task execution, a hallmark of eusociality, is enabled by local interactions between the agents and the environment through a dynamically evolving communication signal. Inspired by the collective behavior of social insects whose dynamics is modulated by interactions with the environment, we show that a robot collective can successfully nucleate a construction site via a trapping instability and cooperatively build organized structures. The same robot collective can also perform de-construction with a simple change in the behavioral parameter. These behaviors belong to a two-dimensional phase space of cooperative behaviors defined by agent-agent interaction (cooperation) along one axis and the agent-environment interaction (collection and deposition) on the other. Our behavior-based approach to robot design combined with a principled derivation of local rules enables the collective to solve tasks with robustness to a dynamically changing environment and a wealth of complex behaviors.
... The real-world dataset represents the external localisation application of the markers in swarm robotics, providing a low-cost ground-truth system. This application of the fiducials is popular [4,24,25] as the swarms can then operate in various conditions without the need for setting up complex localisation systems of multiple cameras and synchronisation units. The critical aspect is the usage of infrared light emitters and receivers within the swarm community as an essential means of communication among the nearby robots. ...
... This approach is largely inspired by stigmergy based coordination mechanisms, such as pheromones observed in ant colonies. This was achieved through stationary robot beacons in [27], [8], RFID tags that stored pheromone information in [28] and an LCD screen platform that used variation in light intensity to communicate pheromone level [29]. A major challenge for this communication approach is finding an effective and scalable means of "marking" the environment beyond controlled laboratory conditions. ...
Article
Swarm foraging is a common test case application for multi-robot systems. In this paper RepAtt algorithm is used for improving coordination of a robot swarm by selectively broadcasting repulsion and attraction signals. This is a chemotaxis-inspired search behaviour where robots use the temporal gradients of these signals to navigate towards more advantageous areas. Hardware experiments were used to model and validate realistic, noisy sound communication and vision system. We then show through extensive simulation studies that RepAtt significantly improves swarm foraging time and robot efficiency under realistic communication and vision models. Note to Practitioners —This research developed a swarm foraging algorithm that takes into consideration the vision and communication sensing noise levels faced by robots in real world applications. The algorithm, known as RepAtt, was developed with the aim of emphasizing algorithmic simplicity and limiting the hardware requirements for the robots in the swarm. In this paper, we have focused on the problem of deploying swarm robots to forage litter in an environment such as a park. The communication model of the robots was based on the physics of sound, while their vision system was modelled using experiments with deep neural networks based object detectors. The results show that the RepAtt algorithm is robust to different distributions of targets (or litter) in the search space, exhibits good swarm efficiency with changes in swarm population and is robust to noise in its communication and vision systems. Apart from the RepAtt algorithm, other contributions made by this research include modelling of robot vision system to aid extensive study of the impact of communication and vision noise on swarm coordination. This will be relevant for extensive testing and validation before deployment to swarm robots hardware. The sound communication used in this research limits the kinds of environment the robots can be deployed in. Echoes within an enclosed environment and bandwidth limitation for communication frequency and public disturbance due to sound emitted by the robots can all contribute to this limitation. Thus, this research can be improved by investing in the development of a communication technology with similar physics. Other areas of improvement include adopting better obstacle avoidance algorithms and implementing suitable manipulators for handling litter objects. The algorithm can be extended to make it applicable for solving other problems such as search and rescue operations where foraging targets could be disaster survivors; demining and hazardous waste cleanup, where targets are the mines or waste material; and planetary exploration, where targets could be interesting features of the planets are the targets searched for by the robots.
... The design of the pheromone-based collision avoidance technique was inspired from [55], [56]. In those works, pheromone-based foraging and aggregation capability was applied to a mobile robot swarm using two artificial pheromone inputs. ...
Article
Full-text available
Autonomous vehicles have been highlighted as a major growth area for future transportation systems and the deployment of large numbers of these vehicles is expected when safety and legal challenges are overcome. To meet the necessary safety standards, effective collision avoidance technologies are required to ensure that the number of accidents are kept to a minimum. As large numbers of autonomous vehicles, operating together on roads, can be regarded as a swarm system, we propose a bio-inspired collision avoidance strategy using virtual pheromones; an approach that has evolved effectively in nature over many millions of years. Previous research using virtual pheromones showed the potential of pheromone-based systems to maneuver a swarm of robots. However, designing an individual controller to maximise the performance of the entire swarm is a major challenge. In this paper, we propose a novel deep reinforcement learning (DRL) based approach that is able to train a controller that introduces collision avoidance behaviour. To accelerate training, we propose a novel sampling strategy called Highlight Experience Replay and integrate it with a Deep Deterministic Policy Gradient algorithm with noise added to the weights and biases of the artificial neural network to improve exploration. To evaluate the performance of the proposed DRL-based controller, we applied it to navigation and collision avoidance tasks in three different traffic scenarios. The experimental results showed that the proposed DRL-based controller outperformed the manually-tuned controller in terms of stability, effectiveness, robustness and ease of tuning process. Furthermore, the proposed Highlight Experience Replay method outperformed than the popular Prioritized Experience Replay sampling strategy by taking 27% of training time average over three stages.
... The expected flocking performance is the group of robots collectively move along the track of the leader. To evaluate the group motion, we used two metrics which have commonly used in swarm robotics area [25,29,47,48]: d s and ξ . These two metrics were calculated and recorded at each sampling time during every experiment. ...
Article
Full-text available
Flocking is a social animals’ common behaviour observed in nature. It has a great potential for real-world applications such as exploration in agri-robotics using low-cost robotic solutions. In this paper, an extended model of a self-organised flocking mechanism using heterogeneous swarm system is proposed. The proposed model for swarm robotic systems is a combination of a collective motion mechanism with obstacle avoidance functions, which ensures a collision-free flocking trajectory for the followers. An optimal control model for the leader is also developed to steer the swarm to a desired goal location. Compared to the conventional methods, by using the proposed model, the swarm network has less requirement for power and storage. The feasibility of the proposed self-organised flocking algorithm is validated by realistic robotic simulation software.
Article
Full-text available
Stigmergy is a form of indirect communication and coordination in which individuals influence their peers by modifying the environment in various ways, including rearranging objects in space and releasing chemicals. For example, some ant species lay pheromone trails to efficiently navigate between food sources and nests. Besides being used by social animals, stigmergy has also inspired the development of algorithms for combinatorial optimisation and multi-robot systems. In swarm robotics, collective behaviours based on stigmergy have always been designed manually, which is time consuming, costly, hardly repeatable, and depends on the expertise of the designer. Here, we show that stigmergy-based behaviours can be produced via automatic design: an optimisation process based on simulations generates collective behaviours for a group of robots that can lay and sense artificial pheromones. The results of our experiments indicate that the collective behaviours designed automatically are as good as—and in some cases better than—those produced manually. By taking advantage of pheromone-based stigmergy, the automatic design process generated collective behaviours that exhibit spatial organisation, memory, and communication.
Chapter
Flocking is a common behaviour observed in social animals such as birds and insects, which has received considerable attention in swarm robotics research studies. In this paper, a homogeneous self-organised flocking mechanism was implemented using simulated robots to verify a collective model. We identified and proposed solutions to the current gap between the theoretical model and the implementation with real-world robots. Quantitative experiments were designed with different factors which are swarm population size, desired distance between robots and the common goal force. To evaluate the group performance of the swarm, the average distance within the flock was chosen to show the coherency of the swarm, followed by statistical analysis to investigate the correlation between these factors. The results of the statistical analysis showed that compared with other factors, population size had a significant impact on the swarm flocking performance. This provides guidance on the application with real robots in terms of factors and strategic design.
Article
Full-text available
Mobile robots are playing a significant role in Higher Education science and engineering teaching, as they offer a flexible platform to explore and teach a wide-range of topics such as mechanics, electronics and software. Unfortunately the widespread adoption is limited by their high cost and the complexity of user interfaces and programming tools. To overcome these issues, a new affordable, adaptable and easy-to-use robotic platform is proposed. Mona is a low-cost, open-source and open-hardware mobile robot, which has been developed to be compatible with a number of standard programming environments. The robot has been successfully used for both education and research at The University of Manchester, UK.
Article
Full-text available
We present the Kilogrid, an open-source virtualization environment and data logging manager for the Kilobot robot, Kilobot for short. The Kilogrid has been designed to extend the sensory-motor abilities of the Kilobot, to simplify the task of collecting data during experiments, and to provide researchers with a tool to fine-control the experimental setup and its parameters. Based on the design of the Kilobot and compatible with existing hardware, the Kilogrid is a modular system composed of a grid of computing nodes, or modules that provides a bidirectional communication channel between the Kilobots and a remote workstation. In this paper, we describe the hardware and software architecture of the Kilogrid system as well as its functioning to accompany its release as a new open hardware tool for the swarm robotics community. We demonstrate the capabilities of the Kilogrid using a 200-module Kilogrid, swarms of up to 100 Kilobots, and four different case studies: exploration and obstacle avoidance, site selection based on multiple gradients, plant watering, and pheromone-based foraging. Through this set of case studies, we show how the Kilogrid allows the experimenter to virtualize sensors and actuators not available to the Kilobot and to automatize the collection of data essential for the analysis of the experiments. © 2018 Springer Science+Business Media, LLC, part of Springer Nature
Article
Full-text available
Scientific Reports 6 : Article number: 37969; 10.1038/srep37969 published online: 30 November 2016 ; updated: 21 February 2017 . In the original version of this Article, all instances of “simple” were incorrectly given as “simplistic”.
Conference Paper
Full-text available
In time-critical situations such as rescue missions, effective exploration is essential. Exploration of such unknown environments may be achieved through the dispersion of a swarm of robots. Recent research has turned to biology where pheromone trails provide a form of collective memory of visited areas. Rather than the attractive pheromones that have been the focus of much research, this paper considers locally distributed repellent pheromones. Further, the conditions for maximising search efficiency are investigated.
Article
Full-text available
Robotic swarms that take inspiration from nature are becoming a fascinating topic for multi-robot researchers. The aim is to control a large number of simple robots in order to solve common complex tasks. Due to the hardware complexities and cost of robot platforms, current research in swarm robotics is mostly performed by simulation software. The simulation of large numbers of these robots in robotic swarm applications is extremely complex and often inaccurate due to the poor modelling of external conditions. In this paper, we present the design of a low-cost, open-platform, autonomous micro-robot (Colias) for robotic swarm applications. Colias employs a circular platform with a diameter of 4 cm. It has a maximum speed of 35 cm/s which enables it to be used in swarm scenarios very quickly over large arenas. Long-range infrared modules with an adjustable output power allow the robot to communicate with its direct neighbours at a range of 0.5 cm to 2 m. Colias has been designed as a complete platform with supporting software development tools for robotics education and research. It has been tested in both individual and swarm scenarios, and the observed results demonstrate its feasibility for use as a micro-sized mobile robot and as a low-cost platform for robot swarm applications.