Conference PaperPDF Available

Robot Citizenship: A Design Perspective


Abstract and Figures

This paper suggests robot citizenship as a design perspective for attending to the sociality of human-robot interactions (HRI) in the near future. First, we review current positions regarding robot citizenship, which we summarize as: human analogy, nonhuman analogy and socio-relationality. Based on this review, we then suggest an understanding of citizenship that stresses the socio-relational implications of the concept, and in particular its potential for rethinking the way we approach the design of robots in practice. We suggest that designing for robot citizenship (in the terms suggested by this paper) has the potential of fostering a shift from a logic of functionality to one of relationality. To illuminate the direction of this shift in design practice, we include and discuss three robot concepts designed to address and rethink present HRI challenges in the urban environment from a relational perspective.
Content may be subject to copyright.
Design and Semantics of Form and Movement 87
Robot Citizenship:
A Design Perspective
Maria Luce Lupetti1, Roy Bendor1, Elisa Giaccardi1,2
1Faculty of Industrial Design, Delft University of Technology, Delft, The Netherlands
2Umea Institute of Design, Umea, Sweden
{m.l.lupetti; r.bendor; e.giaccardi}
This paper suggests robot citizenship as a design
perspective for attending to the sociality of human-
robot interactions (HRI) in the near future. First, we
review current positions regarding robot citizenship,
which we summarize as: human analogy, nonhuman
analogy and socio-relationality. Based on this review,
we then suggest an understanding of citizenship that
stresses the socio-relational implications of the concept,
and in particular its potential for rethinking the way
we approach the design of robots in practice. We
suggest that designing for robot citizenship (in the terms
suggested by this paper) has the potential of fostering a
shift from a logic of functionality to one of relationality.
To illuminate the direction of this shift in design
practice, we include and discuss three robot concepts
designed to address and rethink present HRI challenges
in the urban environment from a relational perspective.
Citizenship; Design Practice; Urban Robotics; Human-
Robot Interaction; More-Than-Human City
1. Introduction
Current technological advancements in the fields of
Artificial Intelligence (AI) and robotics have stirred a
lively debate about the nature of human-nonhuman
relationships and how these may be regulated. In this
debate, designers often find themselves caught in
between sensationalist attributions of citizenship to
humanoid robots such as Sophia [1], and more pragmatic
initiatives that contemplate the attribution of legal
personhood to robots, such as the European Parliament
Resolution of Civil Law Rules of Robotics [2]. Attempts to
regulate human-robot relationships through the typically
human construct of citizenship as a congruent set of
rights and responsibilities can also be observed in other,
more mundane cases. The widespread and unregulated
presence of delivery robots in San Francisco, for
example, has raised a series of social concerns to
which the city has responded with a strict regulation
that limits the number of delivery robots moving freely
around the city [3]. In contrast, the state of Arizona
has responded to similar concerns by giving the delivery
robots the same rights as pedestrians [4] as a way to
make them comply with the same rules.
Although robots have yet to populate the urban
environment en masse, unresolved challenges concerning
their social desirability and responsibility [5-8] call
for a deep reflection on what attributing citizenship
to robots may lead to. This, in turn, compels us to
rethink future urban environments as more-than-human
entanglements of human and nonhuman entities and
needs [9].
Design and Semantics of Form and Movement88 Design and semantics of form and movement88
While a socio-relational perspective of human and
nonhuman coexistence has gained attention in the
field of human-computer interaction (HCI), mainly in
research concerned with animals and plants [10-13], it
has yet to make an impact when it comes to the design
of human-robot interactions. This paper responds
to this gap with a speculative investigation into the
idea of robot citizenship. The paper first reviews the
current debate on the topic of robot citizenship as it
is underlined by three different rhetorical strategies:
using human analogies, using nonhuman analogies,
and pointing to socio-relationality. The paper then
explores the implications of robot citizenship as an
instantiation of the socio-relational perspective, and
in particular its potential for rethinking the way we
approach the design of robots in the urban context.
In doing so, the paper attempts to move away from
addressing citizenship normatively as a codified set of
rights and responsibilities by proposing an alternative,
complementary design perspective [14] meant to
challenge and inspire practitioners to shift from a logic
of functionality to one of relationality.
2. Robot Citizenship
Investigations of the social implications of robots
through legal categories such as rights, personhood,
and citizenship, have become increasingly frequent
within academe [15-21]. In the following sections, we
draw upon, and extend, existing work on the topic to
describe three main rhetorical strategies through which
the concept of robot citizenship can be approached:
human analogy, nonhuman analogy, and socio-
2.1 Human Analog y
The first perspective is grounded in the idea that in
the future, robots, especially when powered by AI, will
become so sophisticated that they will be practically
indistinguishable from humans in terms of cognitive
abilities, sentience, and self-awareness. In such Blade
Runner-like scenarios robots may be eligible for rights
and even citizenship. An extensive argument from this
perspective is provided by Marx and Tiefensee [18].
Although they remain skeptical about robots becoming
fully sentient, they envision functionally equivalent states
that would enable robots to perceive and preserve
their “wellbeing”, making them worthy of protection as
“moral patients”, as Gunkel [21] puts it. Similarly, due to
their growing complexity and sophistication, robots may
also be able to detect moral demands from other agents
and, accordingly, behave responsibly. Because of such
ability to hold both rights and responsibilities, Mark
and Tiefensee [18] argue that robots may also become
Argumentation grounded in possible future abilities of
robots, however, is often contested [21-23] because
it relies on overvaluations of the actual capabilities of
even the most advanced robots. In this sense, such
argumentation reads more like science fiction than
plausible foresight [23].
2.2 Nonhuman Analogy
An alternative perspective on citizenship that better
accounts for current robots’ abilities is based on
attributing citizenship to “useful” nonhumans. Kymlicka
and Donaldson [24], for instance, discuss animal
citizenship by focusing on the concept of domestication
as a qualifying relationship. Domesticated animals, they
note, can be seen as citizens because of their ability to
regulate their behavior according to norms of civility
(thus respecting the rights of other members), and
because of their ability to perform their duties (thus
providing a meaningful service for the community).
Although criticized when it comes to animals [18],
this argumentation can be applied to robots who
fulfil the same criteria. There are precedents: rights
were recently granted to nonhumans by virtue of
their membership, contribution and relationship
with the human community. The Whanganui river
in New Zealand, for instance, was granted the same
legal rights as humans after a local Māori tribe fought
for its recognition as an ancestor and a contributing
member to the welfare and wellbeing of the tribe [25].
As Forlano [25] explains, “by granting the river legal
rights, crimes against the river can now be treated as
crimes against the tribe”. Similar initiatives include the
attribution of rights to the Ganges and Yamuna rivers in
India [26] and Lake Erie in the United States [27].
However, attributing human legal rights to nonhumans
may lead to open conflicts between the interests of the
two, as in is the case of Lake Erie. The attribution of
Design and Semantics of Form and Movement 89
rights to the lake, in fact, generated a protest from local
farmers who claimed that their rights (endangered by
the impossibility of fertilizing their crops because of the
protection of the lake) should be anteposed to the ones
of the lake [27]. Despite the merit of accounting for the
expanded nature of communities and of stressing the
importance of contribution to a shared good, then, this
perspective remains controversial.
2.3 Socio -Relationalit y
While both previous perspectives provide convincing,
even if controversial answers to whether and how
we could consider robots as citizens, we argue
that addressing robots through a logic of rights and
responsibilities only provides partial answers. As
Coeckelbergh [22] argues in his discussion on robots
and morality, by focusing on a robot’s individual
features, the rights approach does not account for how
relations among entities and the social context itself
contribute to changes in moral considerations. Instead,
we could approach moral considerations from a socio-
relational perspective [21-22] in which morality should
not be seen as inherent to any single entity but rather
as an extrinsic quality. What this means is that a robot
should not be addressed as a moral agent or “patient”
[28] per se, but as an object of moral consideration by
virtue of its relations within a social context.
Accordingly, the socio-relational perspective goes
beyond individual abilities, and accounts for the relations
between the individual and the whole. In other words,
attributing citizenship to robots should not be based on
the question of whether robots are “like us”, or “help
us”, but are “part of us” – a point also made by Marx
and Tiefensee [18] in their account for citizenship based
on robot sophistication, and by Kymlicka and Donaldson
[24] in their discussion of citizenship for domesticated
animals. Going beyond rights and responsibilities, a
citizen, to be qualified as such, should be engaged with
other entities in interdependent relations aimed at a
collective welfare.
By firmly shifting the emphasis from a logic of rights
and responsibilities to one of relations, then, this
perspective reveals the need for a richer vocabulary
(that would, for instance, help differentiate hard from
soft rights [22]), or a completely new one that would
enable us to account for the different forms of moral
considerations that arise from new human-robot shared
3. A Design Perspective on Robot
The preceding discussion hints at how the concept of
robot citizenship may help the HRI field to extend its
interest from technical concerns to social ones, shifting
its focus from pragmatic and technical challenges to
topics like relationality and ethics. Given that current
debates on robot citizenship tend to focus on normative
questions and seek resolution in policy and regulation,
a process that tends to react to technological
developments instead of anticipating them, we suggest
there is value in considering robots as citizens as a
matter of philosophical and designerly speculation. In
other words, we are not interested in offering legalistic
solutions for the more-than-human city or a critical
speculation on the near future, but in opening up a
provocative design space.
By introducing the notion of robot citizenship in this
way (in terms of relationality and not legality), we invite
designers to look at emerging human-robot interactions
not as a matter of individual robotic capabilities but
as a matter of the relations among robotic and non-
robotic entities. Discussing robot citizenship, therefore,
invites designers to approach the design of HRI from
considerations of the community, its values and shared
goals, instead of from the individual robot’s functional
capabilities. Through this conceptual shift, considering
robot citizenship may not only contribute to the
ongoing discussion about meaningful future partnerships
between humans and computational artefacts [29-33],
but also contribute to a more holistic view of HRI.
The question remains, how can this conceptual shift be
translated into actionable design strategies?
As described above, approaching design from the
perspective of robot citizenship asks us to rethink the
performance of robots interdependently, and thus
investigate the appropriateness of the relationships
between robots and other entities instead of robots on
their own. As summarized in Figure 1, the design space
that opens up in response to thinking about robots
as citizens requires that we understand how a robot
Design and Semantics of Form and Movement90
may enter into relation with both other entities and
the environment. From this initial framing, then, it is
possible to identify opportunities for meaningful and
appropriate partnerships by reflecting on the possible
roles that both human and nonhuman entities may be
asked to perform together, on the basis of what Kuijer
and Giaccardi [33] refer to as capabilities that are
“uniquely human” and “uniquely artificial”.
To this suggestion we add a specific perspective:
instead of looking only at what individual entities are
‘good at’, we suggest considering what they are not
good at. As Marenko and van Allen [31] argue, most
current approaches to interaction design tend to be
task-oriented and efficiency-driven, and therefore
tend to produce specific narratives about devices as
consistently behaving entities towards which people
often build inappropriate expectations. By recognizing
limits and coming to terms with unpredictability, and
by suggesting narratives of “dumb-smart” [34] entities,
designers can free themselves from the idea of designing
for perfection and redirect their actions towards
“ecologies of things that are mutually responsive and
interdependent” [31].
Once they identify such inabilities, designers can explore
how the same performance is successfully instantiated
by other entities, as a way to envision possible design
alternatives. Among these, we suggest focusing on
strategies that communicate interdependency and may
foster values that can be considered appropriate for
human-robot interactions. This perspective helps us not
only to pivot towards relationality and interdependence,
but also to shift our focus to the extrinsic (rather than
intrinsic) qualities of a robot that can enable appropriate
forms of interaction. To do so, we need to understand
what Coeckelbergh [22] calls “apparent features”,
according to which the features of a robot are not
appropriate or morally significant on their own, but only
by virtue of their interplay with other entities (much in
the same way that “affordances” differ from technical
features). Consequently, by addressing this socially
constructed idea of appropriateness, designers are
invited to craft robot features that account for how these
features would be experienced and judged by humans.
In what follows, we illustrate the design space that
opens up by considering socio-relationality as a key
framing for HRI. We start with a brief discussion of
urban robot challenges, and then present three robot
concepts that illustrate how addressing robot citizenship
can translate into tangible design strategies.
4. Urban Robots in Question
By approaching the design of robots from the
perspective of robot citizenship, we developed three
concepts for urban robots. These address real world
challenges faced by designers of urban HRI, that
were identified through interviews with five robotics
researchers with expertise in autonomous navigation
for unmanned ground vehicles (UGV) (a type of robot
used in urban applications, e.g., delivery of goods). We
started the interviews with a short introduction about
the project and its objectives, stressing our interest
in identifying what are the most pressing challenges
in urban robotics. We then investigated further the
emerging challenges through a focused review of related
HRI literature. Then, for each of these challenges,
Fig. 1. Overview of the
main principles involved
when approaching robot
design from the socio-
relational perspective
suggested by the
concept of citizenship.
Design and Semantics of Form and Movement 91
we suggested an alternative approach to the problem
by identifying potential cooperative strategies and
envisioning apparent features that may facilitate them.
We exemplify the concepts with illustrations that
show a robot in a specific situation, communicating an
implicit message, and provoking a desired response from
4.1 Robot Challenges and Relational
Our interviews with the roboticists helped us identify
a small series of current urban robot challenges (see
figure 2). These challenges include problems related
to (1) the robot’s need for adapting to non-dedicated
infrastructures and related social norms, e.g. navigating
sidewalks and adapting to pedestrians’ speed and norms;
(2) inefficiencies resulting from the need for keeping safe
distances, as a way to appropriately navigate crowded
areas and deal with the unpredictable behaviors of
other entities; (3) issues emerging from the robot’s
difficulty of being understood, which may lead people
to misjudgment and adverse feelings; and (4) inability
of being respected, which makes the robot a potential
victim of human malicious actions, e.g. hacking and
By reflecting on some of these issues and envisioning
possible alternative approaches, we developed three
concepts: the Transparent Robot, which responds to the
issue of being (mis)understood; the Handleable Robot,
which responds to the difficulty of dealing with non-
dedicated infrastructures; and the Shapeshifting Robot,
which addresses the challenge of keeping safe distances
from others.
The Transparent Robot. This concept (Fig. 3A)
illustrates situations in which a malfunctioning robot
may be perceived as something mysterious and
potentially dangerous, thus generating adverse feelings
and attitudes in human bystanders. In fact, “if a robot
is just standing somewhere looking as a generic
box, without doing anything, people may think it’s a
bomb” stressed one of the interviewees. Common
HRI strategies address this issue by preventing and
detecting malfunctions with regular interval checks
(e.g. [35]). However, this challenge may be reframed by
considering the social environment the robot is part of,
and relying on the human perception of the situation.
Recalling existing practices (e.g., calling for assistance
if an elevator breaks; calling the owner of a lost dog to
bring it home, etc.), we suggest malfunctioning robots
may be addressed not as a matter of manufacturer
responsibility, but rather as a case of a community
member in need of care.
From this perspective, designers may shift their focus
from increasing efficiency to evoking empathy. One
feature that may help facilitate this shift is the robot’s
Fig. 2. Overview of
urban robot challenges
identified through
the interviews with
Design and Semantics of Form and Movement92
appearance: changing its appearance from opaque
to transparent (with or without additional symbolic
elements), the robot can communicate its situation:
“Look what happened to me! I need your help! In this
way, the challenge of human (mis)interpretation of
the situation may become an opportunity to generate
empathy and care.
The Handleable Robot. This concept (Fig. 3B) relates
to the challenges faced by a robot when attempting to
fit its behavior to non-dedicated urban infrastructure. In
such cases, the robot’s autonomy is strongly dependent
on its ability to combine various skills like detection,
prediction and planning. Take, for instance, the case of a
robot trying to cross a street or a busy intersection on
its own – a particularly complex challenge [36]. Within
current HRI strategies, this challenge is addressed by
improving the robot’s autonomy and self-sufficiency –
creating better environmental modeling and detection,
and designing more sophisticated predictive algorithms.
However, if we look at social encounters in similar
situations, we notice that the same problem is often
dealt with interdependencies generated by affinity and
shared membership in the community. Recalling these
existing social phenomena, then, we may consider
the possibility of a robot’s lack of autonomy as an
opportunity to instantiate interdependent relationships.
Much like children, elderly, or the disabled, robots may
cross a street safely by joining a shared performance
and relying on the abilities (and kindness!) of others.
When arriving at a crosswalk or needing to cross a busy
street, the robot may communicate its need for help by
producing a gesture that mimics the way humans reach
for help by extending their hand to others. This might
be achieved by rethinking the shape and purpose of the
flagpoles that sometimes protrude from the robot’s
back. The pole, in this mode, can be used not only to
signal the presence of the robot, but also to function as
a steering device that indicates that the robot is flexible
enough to be helped. Shifting the position of the pole,
the robot implicitly says to humans: You can help me by
handling me”.
The Shapeshifting Robot. This concept (Fig. 3C)
responds to the challenge of navigating a crowded
environment, where the robot’s difficulty to predict the
behavior of a large number of moving agents (especially
people) represents a very complex problem. Currently,
designers try to solve the problem by developing
algorithms based on a “preventive approach” in which
the environment and other entities are detected,
their behaviors are predicted, and the movements
are planned for avoiding collision. Nonetheless, the
complexity of the challenge and the insufficiency
of current modelling efforts often lead to errors in
navigation, harm to humans, or robots stopping in
their tracks in order to prevent harm. As stated by one
of our interviewees, “most of navigation algorithms
are designed to be passive […] there is too much
focus on prevention”. This highlights how current
design strategies do not relate to the social nature of
the challenge they address. When we look at crowd
behavior, however, we notice that it is often regulated
by a series of tacit norms that go far beyond the desire
to avoid bumping into others. From body gestures that
enable a mutual understanding of intentions, to gentle
physical contact, humans, as well as animals, adapt to
each other. What we suggest, then, is to look at the
robot as a constitutive part of the crowd and, as such,
an entity that can enable such mutual understanding and
gentle physical contact.
Fig. 3. Rethinking
design challenges
through relational
strategies yielded three
concepts (from left to
right): the Transparent
Robot (A), the
Handleable Robot (B),
and the Shapeshifting
Robot (C).
Design and Semantics of Form and Movement 93
Providing a robot with a flexible soft shell, for instance,
may mimic how humans acknowledge and interact in a
crowd, sleekly squeezing and slipping through the crowd
respectfully instead of parting it aggressively. Through
these nonverbal behaviors, the robot communicates to
its human surrounding: You can touch me as I go by, I’m
safe and friendly”.
5. Discussion and Conclusions
The examples discussed above hint at practical
implications of approaching robots not as tools but
rather as members of a co-performing community.
Subsequently, designers may be able to solve
some of the challenges inherent to complex urban
environments by designing robots that would be
perceived, recognized, and tolerated as valuable
members of the community. In this mode, the three
concepts we describe above replace self-sufciency with
interdependency; autonomy with mutuality; and a tool
perspective with a civic sensibility.
By considering the community instead of the individual
robot’s functional capabilities (or lack of), designers
can gain a more holistic view of HRI, understanding
a robot according to its embeddedness in the urban
environment, its social relations and practices. In
this perspective, what usually represents a limit and
challenge for a robot, may become an opportunity
for instantiating meaningful shared performances
with humans, in which the abilities of one may
become a strategy to deal with the limits of another
[33]. Furthermore, by reframing HRI challenges as
sociotechnical and not merely technical, the concept
of citizenship helps to unfold a design space that is
much less reliant on the legal system’s catching up to
the everyday presence of robots. Thus, while effort is
being put to regulate robots from a legal perspective,
designers may already move forward by thinking of
urban robots as social actors and therefore anticipating
regulatory and behavioral responses. The design of HRI,
it follows, can become anticipatory instead of reactive.
With that said, despite its potential, this new design
space is not free from complications. First, our proposal
assumes that citizen robots, or, more accurately,
robots that behave as citizens, will elicit certain
responses from humans. But, what if nobody wants to
take the extended hand of the Handleable robot and
help it cross the street? What if nobody cares if the
Transparent robot needs help? What if the softness of
the Shapeshifting robot is only perceived aesthetically?
What if people, despite those apparent features, still
perceive robots as an obstruction, a burden, or even as
This last question introduces a second complication. We
suggested here that robots may be considered members
contributing to the community’s common good, but
who gets to decide what that means in practice, and
how? Should HRI designers be responsible for deciding
what robot uses and roles are desirable? Should they
hold public referendums on each and every proposal
for an urban robot? And even then, what if conflicting
proposals emerge from within the community?
These critical questions highlight how despite its
practical implications, our approach does not provide
solutions, but only opens up a larger space for
discussion. This very ability to raise questions and
foster further reflections, however, is what we believe
represents the very meaningful nature of citizenship as a
concept that can be used in the design and investigation
of urban robots. In fact, “in certain circumstances asking
questions is as important as solving a problem” [37].
Design can play a crucial role in this. What we suggest,
then, is to look at citizenship as a design perspective that
can be used to challenge existing norms and attitudes,
provoke discussion and question established practices
[38] – a way to question the drive for technical
efficiency that characterizes current robot design.
Through the concept of citizenship, designers are
invited to question beliefs about the role of robots in
society, and to rethink their approach to urban robotics
from the logic of autonomy and efficiency towards
relationality and interdependency.
Acknowledgments. We thank the Amsterdam
Institute for Advanced Metropolitan Solutions (AMS)
and Delft Design for Values Institute for supporting the
Design and Semantics of Form and Movement94
1. Stone Z.: Everything you need to Know About Sophia, The
World's First Robot Citizen. Forbes, Retrieved July 10, 2018,
from: (2017).
2. Hern A.: Give Robots ‘Personhood’ Status, EU Committee
Argues, The Guardian, Jan. 12, 2017. Retrieved July 19, 2018,
from: (2017).
3. Wong J C.: San Francisco sours on rampant deliver y robots:
‘Not every innovation is great’, The Guardian, Dec. 10, 2017.
Retrieved July 19, 2018, from: (2017).
4. Lapastora C.: Arizona law gives delivery robots same rights
as pedestrians – but they must abide by same rules. Fox
News. Retrieved July 16, 2018, from: ht tps://
5. Salvini P., Ciaravella G., Yu W. L., Ferri G., Manzi A.,
Mazzolai B., Laschi C ., Kim B. O. and Dario P.: How safe
are service robots in urban environments? Bullying a
robot. In Int. Symposium on Robot and Human Interactive
Communication (RO-MAN’10), 1-7 (2010).
6. Nagenborg M.: Urban robotics and responsible urban
innovation. Ethics and Information Technology, 1-11 (2018).
7. Arnold T. and Scheutz M.: Beyond Moral Dilemmas:
Exploring the Ethical Landscape in HRI. In ACM/IEEE
International Conference on Human-Robot Interaction (HRI
'17), 445-452 (2017).
8. Boden M., Bryson J., Caldwell D., Dautenhahn K ., Edwards
L., Kember S., Newman P., Parr y V., Pegman G., Rodden T.,
Sorrell T., Wallis M., Whitby B. and Winfield A.: Principles
of robotics: regulating robots in the real world, Connection
Science, 29:2, 124-129 (2017).
9. Franklin A .: The more-than-human city. The Sociological
Review, 65(2), 202-217 (2017).
10. Mancini C.: Animal-computer interaction: a manifesto.
Interactions, 18, 4, 69-73 (2011).
11. Aspling F., Juhlin O., and Chiodo E.: Smelling, pulling, and
looking: unpacking similarities and differences in dog
and human city life. In 12th International Conference on
Advances in Computer Enter tainment Technology (ACE
'15), Article 64 (2015).
12. Bastian M.: Towards a more-than-human par ticipatory
research. In Michelle Bastian, Owain Jones, Niamh Moore,
Emma Roe (eds.) Participatory Research in More-than-
Human Worlds, 33-51, Routledge (2016).
13. Smith N., Bardzell S., and Bardzell J.: Designing for
Cohabitation: Naturecultures, Hybrids, and Decentering
the Human in Design. In Conference on Human Factors in
Computing Systems (CHI '17), 1714-1725 (2017).
14. Pierce, J., Sengers, P., Hirsch, T., Jenkins, T., Gaver, W. and
DiSalvo, C.: Expanding and ref ining design and criticality in
HCI. In 33rd Annual ACM Conference on Human Factors in
Computing Systems, 2083-2092 (2015).
15. MacDorman K. F. and Cowley S. J.: Long-term
relationships as a benchmark for robot personhood. In
15th Int. Symposium on Robot and Human Interactive
Communication (ROMAN’06), IEEE (2006).
16. Sullins J. P.: When is a robot a moral agent?. International
Review of Information Ethics, 6 (2006).
17. Robertson J.: Human rights vs. Robot rights: Forecasts from
Japan, Critical Asian Studies, 46:4, 571-598 (2014).
18. Marx J. and Tiefensee C.: Of animals, robots and men.
Historical Social Research / Historische Sozialforschung, Vol.
40, No. 4 (154), 70-91 (2015).
19. Ashrafian H.: Ar tificial intelligence and robot responsibilities:
Innovating beyond rights. Science and engineering ethics,
21(2), 317-326 (2015).
20. Rainey S.: Friends, robots, citizens? SIGCAS Comput. Soc.
45, 3, 225-233 (2016).
21. Gunkel D. J.: Robot rights. MIT Press (2018).
22. Coeckelbergh M.: Robot rights? Towards a social-relational
justification of moral consideration. Ethics and Information
Technology 12.3, 209-221 (2010).
23. Floridi L. and Taddeo M.: Romans would have denied robots
legal personhood. Nature, May 16, 2018. Retrieved July 20,
2018, from: (2018).
24. Kymlicka W. and Donaldson S.: Animals and the Frontiers of
Citizenship. Oxford Journal of Legal Studies, 34(2), 201-219
25. Forlano L.: Posthumanism and Design. She Ji: The Journal of
Design, Economics, and Innovation, 3(1), 16-29 (2017).
26. Daley J.: India’s Ganges and Yamuna rivers are given the
rights of people. Retrieved March 7, 2019,
from: (2017).
27. Daley J.: Toledo, Ohio, just granted lake Erie the same legal
rights as people. Retrieved March 7, 2019,
from: (2019).
28. Floridi L. and Sanders J. W.: On the morality of artificial
agents. Minds and machines, 14(3), 349-379, (2004).
29. Breazeal C., Gray J., Hoffman G. and Berlin M. Social robots:
Beyond tools to partners. In ROMAN 2004. 13th IEEE
International Workshop on Robot and Human Interactive
Communication, 551-556 (2004).
30. Johnson M., Bradshaw J. M., Feltovich P. J., Jonker C. M., Van
Riemsdijk M. B., and Sierhuis M.: Co-active design: Designing
suppor t for interdependence in joint activity. Journal of
Design and Semantics of Form and Movement 95
Human-Robot Interaction, 3(1), 43-69 (2014).
31. Marenko B. and Van Allen P.: Animistic design: how to
reimagine digital interaction between the human and the
nonhuman. Digital Creativity, 27(1), 52-70 (2016).
32. Rozendaal M.: Objects with intent: a new paradigm for
interaction design. interactions, 23(3), 62-65 (2016).
33. Kuijer L. and Giaccardi E.: Co-performance: Conceptualizing
the role of artificial agency in the design of everyday life.
In Conference on Human Factors in Computing Systems
(CHI’18), 125 (2018).
34. Van Allen P.: Rethinking IxD. Medium. Retrieved February
22, 2019, from: (2016).
35. Crestani D., Godary-Dejean K . and Lapierre L.: Enhancing
fault tolerance of autonomous mobile robots. Robotics and
Autonomous Systems, 68, 140 -155 (2015).
36. Chand A. and Yuta S. I.: Road-crossing landmarks detection
by outdoor mobile robots. Journal of Robotics and
Mechatronics, 22(6), 708-717 (2010).
37. Ozkaramanli D. and Desmet P.: Provocative design for
unprovocative designers: Strategies for triggering personal
dilemmas. In 50th Conference of Design Research Society
38. Raptis D., Jensen R . H., Kjeldskov J. and Skov M. B.:
Aesthetic, Functional and Conceptual Provocation in
Research Through Design. In Conference on Designing
Interactive Systems (DIS’17), 29-41 (2017).
... Given these problems, the HRI field has begun to adopt speculative and critical design approaches that explore the use of metaphors, more or less explicitly, to challenge robot assumptions. Concepts like 'neediness' [21], 'domestication' [4], 'destruction' [42], and 'citizenship' [41] have been particularly used to broaden the HRI discourse beyond utilitarian values and mimetic approaches. In 'Technological Dream Series: No. 1: Robots, 2007' [21], Dunne & Raby break down robot ideals of autonomy and efficiency through concepts like neediness which, by suggesting human-robot co-dependency, represents an unconventional strategy to mantain a human sense of control over the robot. ...
... Finally, by using the concept of citizenship, Lupetti et al. [41] described the future of robots' sociality and their possible civic embeddedness, exploring how we can bypass the idea of robots as fully autonomous and efficient agents with whom humans should negotiate roles. The authors propose consideration of communitydriven values and other interaction nuances as a way to design robots that may engage in codependent relationships with humans. ...
Conference Paper
Full-text available
The word "robot" frequently conjures unrealistic expectations of utilitarian perfection: tireless, efficient, and flawless agents. However, real-world robots are far from perfect—they fail and make mistakes. Thus, roboticists should consider altering their current assumptions and cultivating new perspectives that account for a more complete range of robot roles, behaviors, and interactions. To encourage this, we explore the use of metaphors for generating novel ideas and reframing existing problems, eliciting new perspectives of human-robot interaction. Our work makes two contributions. We (1) surface current assumptions that accompany the term "robots," and (2) present a collection of alternative perspectives of interaction with robots through metaphors. By identifying assumptions, we provide a comprehensible list of aspects to reconsider regarding robots’ physicality, roles, and behaviors. Through metaphors, we propose new ways of examining how we can use, relate to, and co-exist with the robots that will share our future.
... Contrasting with actual experiences, on the other hand, revealed some of the challenges when it comes to the permanent integration of robots into public space, thereby also considering alternative roles and world views on human-robot relations (e.g. humans as caretakers) (Lupetti et al., 2019). ...
Full-text available
The contemporary city is increasingly mediated by computing and automation, promising to improve the quality of urban life. Urban robots represent the next generation of urban technologies, which are capable of sensing, autonomously operating and physically manipulating the urban environment. However, while research in engineering led the foundation for the technological development of urban robots, their human-centred design, including the design of the interfaces to facilitate encounters and interactions between humans and urban robots, has been less explored. Furthermore, it remains an open question how to systematically prototype these complex technologies in urban environments. The research aim of this thesis is to advance the understanding of the design space of urban robotic interfaces. To achieve this aim, this publication-based thesis employs a research in and through design approach, using methods from human-computer interaction. To seek a deeper understanding of the opportunities and challenges of designing urban robotic interfaces, existing urban interfaces and new ones emerging out of the intrinsic characteristics of urban robots are reviewed and classified. This review lays the foundation for the two implemented case studies, which form the core part of this thesis: First, a slow-moving urban robot that draws with chalk on the ground was designed and deployed as an urban probe to explore the potential of physicalised displays, and to investigate social interactions around urban robots. For the second case study, we guided the design of a low-resolution lighting display for a fully functional shared autonomous vehicle. The case studies consist of two empirical studies each, which were conducted in the wild and in the lab, respectively. The findings that emerged from this research expand the design space of urban robotic interfaces and shed light on the challenges in prototyping by offering conceptual, empirical and methodological contributions.
... Autonomy seems to be important for this Lopez-Mobilia (2011) In this study, "children were asked whether or not different kinds of nonhuman entities (dogs, trees, robots, dolls) were capable of a range of psychological states (e.g., thinking, feeling)" then "asked to judge the morality of actions that led to a negative consequence for a nonhuman target." The results showed no "relation between psychological attributions and moral judgments," though this could be due to the study methodology Lupetti et al. (2019) After summarizing previous contributions relevant to the discussion of robot citizenship, the authors summarize their findings from interviews with roboticists on "a small series of current urban robot challenges." They argue for the importance of a "socio-relational perspective" in the design of robots MacDorman and Cowley (2006) MacDorman and Cowley argue that the "ability to sustain long-term relationships" is "the most compelling" benchmark for personhood, since other benchmarks are "trivial, subjective, or based on assumptions about moral universals." ...
Full-text available
Ethicists, policy-makers, and the general public have questioned whether artificial entities such as robots warrant rights or other forms of moral consideration. There is little synthesis of the research on this topic so far. We identify 294 relevant research or discussion items in our literature review of this topic. There is widespread agreement among scholars that some artificial entities could warrant moral consideration in the future, if not also the present. The reasoning varies, such as concern for the effects on artificial entities and concern for the effects on human society. Beyond the conventional consequentialist, deontological, and virtue ethicist ethical frameworks, some scholars encourage “information ethics” and “social-relational” approaches, though there are opportunities for more in-depth ethical research on the nuances of moral consideration of artificial entities. There is limited relevant empirical data collection, primarily in a few psychological studies on current moral and social attitudes of humans towards robots and other artificial entities. This suggests an important gap for psychological, sociological, economic, and organizational research on how artificial entities will be integrated into society and the factors that will determine how the interests of artificial entities are considered.
... Contrasting with actual experiences, on the other hand, revealed some of the challenges when it comes to the permanent integration of robots into public space, thereby also considering alternative roles and worldviews on human-robot relations (e.g. humans as caretakers) [41]. ...
Conference Paper
Full-text available
In this paper, we investigate how to elicit new perspectives in research-through-design (RtD) studies through annotated portfolios. Situating the usage in human-robot interaction (HRI), we used two robotic artefacts as a case study: we first created our own annotated portfolio and subsequently ran online workshops during which we asked HRI experts to annotate our robotic artefacts. We report on the different aspects revealed about the value, use, and further improvements of the robotic artefacts through using the annotated portfolio technique ourselves versus using it with experts. We suggest that annotated portfolios – when performed by external experts – allow design researchers to obtain a form of creative and generative peer critique. Our paper offers methodological considerations for conducting expert annotation sessions. Further, we discuss the use of annotated portfolios to unveil designerly HRI knowledge in RtD studies.
... In this vein, for PUDs to fully comply with their promise of providing a more sustainable alternative to conventional displays, new alternative strategies that consider and involve more-than-human perspectives (e.g. other living beings [8,30], but also robotic agents [55]) need to be considered in the design process of pervasive urban displays and, more broadly, the development of smart cities functioning as their operating system [88]. ...
Full-text available
After almost a decade of relentless development, pervasive urban displays have fragmented into a diversity of approaches with radically distinct characteristics in terms of how mobile they are, as well as the materials they are made of. In this article, we investigate such a diversity in terms of the relationships between key conceptual entities of pervasive urban displays, namely the displayed content, the enabling display technology and the surrounding physical environment. First, we propose a taxonomy for pervasive urban displays through two dimensions: increasing levels of physical integration of content into the surrounding environment (attached, blended, physicalised), and increasing levels of mobility of the display technology within the environment (fixed, portable, self-moving). We extend this taxonomy through looking at the relationship between content and display technology from a conceptual lens and present two categories, namely Screens and Printers. We then provide a classification of current approaches to the design of pervasive displays along these two dimensions and categories, and introduce a new class of pervasive display, which we call pulverised urban displays (PUDs). These displays represent content in a physical form, entangled with the built and natural environment which are capable of an autonomous change to their position. Drawing on urban robotic devices and their capability to sense and manipulate the environment or act as a display itself, we present examples of PUDs. Finally, this article concludes with challenges for designing self-moving robotic and pulverised urban displays.
Conference Paper
Full-text available
This paper introduces the notion of co-performance, with the aim to offer Human-Computer Interaction (HCI) researchers and practitioners a new perspective on the role of artificial agency in everyday life, from automated systems to autonomous devices. In contrast to 'smartness,' which focuses on a supposed autonomy of artifacts, co-performance considers artifacts as capable of learning and performing next to people. This shifts the locus of design from matters of distributions of agency at design time, to matters of embodied learning in everyday practice for both human and artificial performers. From this perspective, co-performance acknowledges the dynamic differences in capabilities between humans and artifacts, and highlights the fundamentally recursive relation between professional design and use. Implications for HCI design practice are unpacked through reflections on smart thermostat design in light of historic changes in roles between humans and heating systems, and changing ideas of appropriateness in everyday practices of domestic heating.
Full-text available
Robots are leaving factories and entering urban spaces. In this paper, I will explore how we can integrate robots of various types into the urban landscape. I will distinguish between two perspectives: (1) the responsible design and use of urban robots and (2) robots as part of responsible urban innovations. The first viewpoint considers issues arising from the use of a robot in an urban environment. To develop a substantive understanding of Responsible Urban Robotics, we need to focus on normative implications of city life as the context in which in robots are being used. I will refer to the desirable qualities of city life as “cityness” and will argue that we should design for cityness. The second approach asks how robots might be used to address challenges specific to cities. From the perspective of RRI, this may require participatory approaches in which the needs of the stakeholders are addressed. But we may also find inspiration in the work undertaken in architecture on expanding the concept and field to ensure that architects not only provide services to the lucky few but also create useful and beautiful spaces for the many. A dialogue with architects, urban designers, and urban planners may also be needed to successfully address the spatial issues raised by the presence of robots in the city.
Conference Paper
Full-text available
Recently within HCI, design approaches have appeared, which deviate from traditional ones. Among them critical design introduces deliberate provocations in order to challenge established perceptions and practices. We have engaged ourselves with this design approach out of interest in understanding how to use provocation in research through design. Towards this end, we report on a field study with four families that used an aesthetically, functionally and conceptually provocative future probe. The purpose of the probe was to challenge existing energy consuming practices through provocation and make its users reflect on them. The paper describes how all three provocative aspects were addressed, and our findings demonstrate how they were experienced in the real world, and how they impacted our research through design approach. We conclude by presenting reflections on how to design provocations, and reflections on the impact of provocations for research through design in general.
Full-text available
This paper proposes a set of five ethical principles, together with seven high-level messages, as a basis for responsible robotics. The Principles of Robotics were drafted in 2010 and published online in 2011. Since then the principles have influenced, and continue to influence, a number of initiatives in robot ethics but have not, to date, been formally published. This paper remedies that omission.
Notably, a salient shortfall of most outdoor mobile robots is their lack of ability to autonomously cross roads while traveling along pedestrian sidewalks in an urban outdoor environment. If it has the ability to intuitively cross a road, the robot could then travel longer distances and more complex routes than originally possible. To this effect, the authors have been developing technologies that attempt to endow such a road-crossing function to outdoor mobile robots. In this paper, a system for road-crossing landmarks detection and localization for outdoor mobile robots is presented. We show how a robot equipped with a single monocular camera and laser range finder sensor can accurately detect, identify and localize roadcrossing landmarks such as pedestrian push button boxes, zebra crossings and pedestrian lights that the robots needs to be aware of and use in order to autonomously cross roads. In addition, experimental results and future plans are discussed.
Conference Paper
Recent research in urban informatics has presented the city as both a complex technological center and a diverse cultural, social, and political entity. However, there has been little research into the changing role that nature plays in urban space, particularly when it comes to understanding how animals have adapted to life in technological and networked cities. In the wake of urbanization, new kinds of cohabitation, including increased interactions between humans and animals, has resulted in new challenges for those working in urban informatics. We leverage key concepts in the Anthropocene-naturecultures, hybrids, and decentering the human in design-to unpack the entanglements of animal-human-computer interaction in two design cases: The Big Cat Behavioral Tracking Initiative and The Phenology Clock. We contribute to urban informatics and HCI research by reflecting on ways in which design can promote new forms of cohabitation and support a broader conception of the city that sees animals as an essential part of the urban landscape.
Conference Paper
HRI research has yielded intriguing empirical results connected to ethics and how we act in social contexts with robots, even though much of this work has focused on task-based, one-on-one interaction. In this paper, we point to the need to investigate a wider range of ethically relevant dynamics that interaction with robots carries with it -- individually and in groups, with a single robot or more. We specifically examine three areas: 1) the primacy and implicit dynamics of bodily perception, 2) the competing interests at work in a single robot-human interaction, and 3) the social intricacy of multiple agents -- robots and humans -- communicating and making decisions. While these areas are not exhaustive by any means, we find they yield concrete directions for how HRI can contribute to a widening, intensifying set of ethical debates with critical empirical insight, starting to explore more of the ethical landscape in HRI.