Conference PaperPDF Available

Effectiveness of Virtual Reality in Participatory Urban Planning


Abstract and Figures

In urban planning, 3D modeling and virtual reality (VR) provide new means for involving citizens in the planning process. For municipal government, it is essential to know how effective these means are, to justify investments. In this study, we present a case of using VR in a municipal process of civic participation concerning the redesign of a public park. The process included co-design activities and involved citizens in decision-making through a ballot, using 3D-rendered versions of competing designs. In co-design, 3D-modeling tools were instrumental in empowering citizens to negotiate design decisions, to discuss the quality of designs with experts, and to collectively take decisions. This paper demonstrates that, in a ballot on competing designs with 1302 citizens, VR headsets proved to be equally effective compared to other display technologies in informing citizens during decision making. The results of an additional, controlled experiment indicate that VR headsets provide higher engagement and more vivid memories than viewing the designs on non-immersive displays. By integrating research into a municipal process, we contribute evidence of cognitive and engagement effects of using 3D modeling and immersive VR technologies to empower citizens in participatory urban planning. The case described in the paper concerns a public park; a similar approach could be applied to the design of public installations including media architecture.
Content may be subject to copyright.
Effectiveness of Virtual Reality in Participatory
Urban Planning
A Case Study
Jos P. van Leeuwen
The Hague University of Applied Sciences
The Hague, The Netherlands
Klaske Hermans
Municipality of The Hague
The Netherlands
Antti Jylhä
The Hague University of Applied Sciences
The Hague, The Netherlands
Arnold Jan Quanjer
The Hague University of Applied Sciences
The Hague, The Netherlands
Hanke Nijman
Twynstra & Gudde
Utrecht, The Netherlands
In urban planning, 3D modeling and virtual reality (VR) provide
new means for involving citizens in the planning process. For
municipal government, it is essential to know how effective these
means are, to justify investments. In this study, we present a case
of using VR in a municipal process of civic participation
concerning the redesign of a public park. The process included co-
design activities and involved citizens in decision-making through
a ballot, using 3D-rendered versions of competing designs. In co-
design, 3D-modeling tools were instrumental in empowering
citizens to negotiate design decisions, to discuss the quality of
designs with experts, and to collectively take decisions. This paper
demonstrates that, in a ballot on competing designs with 1302
citizens, VR headsets proved to be equally effective compared to
other display technologies in informing citizens during decision
making. The results of an additional, controlled experiment
indicate that VR headsets provide higher engagement and more
vivid memories than viewing the designs on non-immersive
By integrating research into a municipal process, we contribute
evidence of cognitive and engagement effects of using 3D
modeling and immersive VR technologies to empower citizens in
participatory urban planning. The case described in the paper
concerns a public park; a similar approach could be applied to the
design of public installations including media architecture.
Author Keywords
Participatory design; virtual reality; urban planning; civic
CCS Concepts
Human-centered computing ~ Virtual reality
Human-centered computing ~ Participatory design
In a participatory society, authorities share responsibilities with
citizens and civil communities [13,37] in many domains, such as
health care, safety, social security, and urban planning and the
organization of public spaces. City governments are looking for
optimal ways to improve the infrastructure for public
participation [6,10] using new technologies to support this. The
municipality of The Hague collaborated with The Hague
University of Applied Sciences in an activity of participatory
design to find evidence of the effectiveness of Virtual Reality
technology in participatory urban planning processes.
Virtual Reality (VR) devices such as 3D-rendering headsets and
smartphones have become accessible to a broad audience,
increasing their potential utility beyond specialist settings. Thanks
to their immersive nature, VR headsets can provide a tool for
supporting decision-making processes in architecture and urban
planning, by virtually placing the observer in the context of the
design. 3D rendering in such processes has evolved from expert
systems to participatory systems, in which the public is given the
opportunity to experience the envisioned design through an
immersive visualization [9,20,39,40]. Experimental research
suggests that VR can increase public participation in such
processes [9,17] and provide a sufficiently realistic experience to
make judgements on the quality of the presented content, instead
of paying attention to rendering artifacts.
The municipality of The Hague incorporated 3D rendering and VR
technology in the participatory re-design of a public park in a
neighborhood with approximately 13,500 residents. The
municipality defines four levels of participation: consultation,
advice, co-production, and co-decision [16]. These levels formed
the backbone for a co-creative process that, although initiated and
facilitated by the municipality, was owned by the residents. The
intention of the municipal district director and the neighborhood
manager was to stimulate a sense of ownership in residents and
Permission to make digital or hard copies of all or part of this work for personal or
classroom use is granted without fee provided that copies are not made or distributed
for profit or commercial advantage and that copies bear this notice and the full
citation on the first page. Copyrights for components of this work owned by others
than ACM must be honored. Abstracting with credit is permitted. To copy otherwise,
or republish, to post on servers or to redistribute to lists, requires prior specific
permission and/or a fee. Request permissions from
MAB18, November 1316, 2018, Beijing, China
© 2018 Association for Computing Machinery.
ACM ISBN 978-1-4503-6478-2/18/11…$15.00
MAB'18, November, 2018, Beijing, China J.P. van Leeuwen et al.
engage them in a do-it-with-others (DIWO) activity regarding the
development of the park in their neighborhood [7].
The participation process can be summarized as follows, with the
participation levels shown in italics:
1. Call for participation consultation
All residents in the neighborhood received an invitation to send
suggestions regarding the park to the neighborhood manager
and/or to partake in a workgroup for co-designing the revamp of
the park.
2. Co-creation workgroup co-production
The workgroup of citizens engaged in a series of intensive co-
design sessions with experts from the municipality, making use of
3D modeling, leading to three high-quality designs for the park.
3. Public ballot co-decision
The three variant designs were submitted to voting by all
neighborhood residents. The residents were allowed to view the
proposed designs using a variety of display technologies.
4. Final design co-production
The city’s landscape architect and the workgroup co-produced the
final detailed design, based on the winning variant.
This paper reports on research tapped into phases 2 and 3 of the
process. These phases provided a vessel to investigate the
effectiveness of VR technology in participatory urban planning.
Specifically, we were interested in the following research
questions that mainly relate to phase 3, the public ballot:
RQ 1. How does VR technology affect the residents’
engagement with the decision-making process
regarding the park?
RQ 2. Does immersive VR technology provide a cognitive
benefit in decision making compared to non-immersive
display technologies?
Display technologies available in the ballot were a paper map, a
smartphone, a tablet, a personal computer, or a VR headset. Except
for the paper map that showed 2D plans, all technologies used the
same 3D model to display the designs.
Relating to RQ 1, we define engagement from two perspectives: 1)
citizens’ engagement with the overall participatory decision-
making process as conducted by the municipality; 2) citizens’
engagement with the presentation of the three designs for the
park. The first perspective, regarding the overall participation
process, was measured during the ballot. The latter perspective,
engagement with the presentations, gives an indication of how
well the medium captures citizens’ attention during their personal
decision-making process. In addition to the experiment during the
ballot, we conducted a controlled experiment to quantify the
experiential differences between immersive and non-immersive
Relating to RQ 2, the cognitive benefits were examined by
studying the citizens’ perception of the differences between the
variants designed for the park. During the ballot, we collected data
about the voters’ confidence about their perception. In the
controlled experiment, we investigated the actual perception by
measuring the participants’ recollection of what they had seen.
The paper is structured as follows. Section 2 discusses related
work and section 3 introduces the co-design process. Section 4
then discusses the first experiment, executed during the ballot, and
section 5 reports on the second experiment in the controlled
laboratory study. Sections 6 & 7 present our discussion and
conclusion respectively.
In the past few decades, the role of citizens in relation to
government has evolved considerably from political
representation towards active, civic participation in policy-
making by the end of the 20th century. The ‘participation society’
from the beginning of this century is now evolving into a ‘do-
democracy’ where citizens’ initiatives shape government
responses and actions [19]. De Waal discusses political-
philosophical perspectives on citizenship and how citizenship is
changing as a consequence of the introduction of smart city
technology. He defines the republican perspective, that combines
individual freedom with collective responsibilities, as opposed to
the libertarian perspective, that focuses on individual rights and
minimal mutual responsibilities [37,36].
Arnstein, already in the 1960’s, introduced the concept of a citizen
participation ladder, as a form of classifying as well as critiquing
different styles of governance and participation settings [3]. Foth
defines four stages of evolution of the relationship between city
government and citizens, with government in roles evolving from
administrator to collaborator and citizens evolving from residents
to co-creators [13]. Creighton defines participation as “the process
by which public concerns, needs, and values are incorporated into
governmental and corporate decision-making” [8]. Engaging
citizens to participate in public decision-making processes can
foster creativity and generate fresh ideas [23], while resulting in
strong citizen commitment to related changes [3,21].
Practice teaches that effective collaboration between citizens and
professional decision-makers requires a middle-out approach [15].
Top-down approaches tend to place decision-makers at the center
of the process and do not generally lead to genuine engagement.
Bottom-up initiatives, e.g. taken by community groups, may be
seen by decision-makers as illegitimate or substandard and
therefore get disregarded. A middle-out process integrates top-
down objectives with bottom-up interests and involves
stakeholders in all stages of the decision-making process.
Visual communication can effectively support processes of
collective decision-making and communicating about such
decisions. It can offer a common language in an easily accessible
medium and thus reduce barriers for public engagement, allowing
participants to become more literate about planning processes
[38]. 3D visualizations in urban design have long targeted
professional users, such as architects, urban planners, and
landscape designers [25,35], but are increasingly used for
participatory urban planning as well [1,2]. Visualizations in 3D
and VR are used in public consultation processes [20,39], allowing
the public to interactively access information in 3D models and
leave comments and suggestions for modifications. VR has been
Effectiveness of Virtual Reality in Participatory Urban Planning MAB'18, November, 2018, Beijing, China
demonstrated a suitable means, technologically, to facilitate public
participation in urban decision-making [20]. Visualizations also
offer opportunities to bring evidence into the decision-making
process, informing citizens about environmental issues [40] and
consequences for, e.g., daylight and shadow [9].
The present technology of smartphones allows for sufficiently
realistic VR experiences, making the technology suitable for large-
scale participatory design and assessment of design proposals
[5,22,27]. Experimental applications have suggested that VR and
interactive 3D visualizations on mobile devices help improve
citizens’ understanding and increase public engagement [17].
Immersive VR has been suggested to be beneficial for recalling
items seen during the virtual experience, especially in
multisensory VR environments [11,26]. As an example, Harman,
Brown, and Johnson [18] made an experiment to compare recall
ability between a VR headset and a computer monitor, and found
that people were able to remember more information if they were
using the VR headset. However, also contradictory evidence has
been presented [4,14], suggesting that increased immersion may
have a counterproductive effect for recall. Possible explanations
are limited cognitive capacity and mediated arousal, which have
been hypothesized to affect recall negatively [4].
In the beginning of the process, the municipality published a call
to the residents for attending an information session with
municipal experts. Over 70 residents attended the event, where
municipal experts explained possibilities and limitations of what
could be achieved in the park, both technically and budgetary. The
residents were invited to write up their ideas for the park, which
resulted in over 60 written suggestions.
A workgroup of 25 residents from the neighborhood was formed
in the event, including males and females from various ethnic
backgrounds and age groups, reasonably representative of the
neighborhood’s population. The workgroup collaborated with
municipal experts to generate three designs for the park in three
co-design sessions.
In the first session, the workgroup transformed the residents’
written suggestions into a comprehensive list of ideas. Based on
this list, the neighborhood manager made a set of puzzle pieces for
the different zones of the park. Characteristics for each zone were
derived from the list of ideas.
In the second session, the workgroup used the pieces of the puzzle
to create five compositions for the park. The workgroup members
individually prioritized the list of ideas by distributing 20 points
between the listed items. These activities enabled the workgroup
members to develop a vision for their ideas and choices. The group
then formed three teams that each created a design draft for the
park. The three drafts were then elaborated by a municipal
landscape architect to generate more detailed initial designs.
In the third co-design session, each team discussed their design for
the park (see Figure 1) and improved it using a digital 3D
modelling system, Sketchup, which was operated by an expert (see
Figure 2). This enabled the three teams to comment on and modify
the initial designs and instantly visualize their new ideas in the 3D
modelling environment.
Figure 1. One of the three teams discussing their design
using 2D plans.
Figure 2. One of the three teams discussing their design
with the landscape architect (left) and interacting with an
expert (sitting behind the computer) as he was modelling
their design in 3D.
The co-design sessions resulted in three variant proposals for the
revamp of the park. The differences between the three proposals
concerned the layout of the pathways in the park and the kind and
density of vegetation (e.g., flower beds, hedges). The differences
also concerned larger elements, such as playgrounds, activity
areas (e.g., skate park, basketball ground, fitness equipment), and
outdoor furniture. Two of the three proposals removed an existing
service building; one proposal added a new bandstand in the park.
4.1 Method
With the three designs, a public ballot was conducted among the
residents of the neighborhood. The ballot period spanned 3 weeks.
The main aim of the municipality was to let residents vote for their
favorite among the three designs. This also provided a platform to
investigate the effects of using VR technology in the decision-
making process.
4.1.1 Participants
The municipality sent a written invitation for the ballot to all
residents of the area (approximately 13,500) and advertised it
online and through a poster campaign. As a result, 1302 residents
participated in the ballot. The voting was entirely anonymous and
MAB'18, November, 2018, Beijing, China J.P. van Leeuwen et al.
demographic data of the participants was not collected in order to
minimize any barriers for participating in the voting. The only
personal information recorded was postcode; this was recorded in
order to calculate the distance of the park from the home of the
4.1.2 Setup and Technology
Photorealistic 3D rendering was used to visualize the three
prospective design variants for the park. The rendering was done
for three fixed locations in the park and the rendering engine
supported navigation similar to Google Street View (see Figure 3),
i.e., supporting rotation of the point of view and discrete
transitions from one vantage point to another.
The 3D-rendered park variants were viewable with a range of
devices. A Web-based interface allowed participants to view the
designs on their personal computer, smartphone, or tablet. This
possibility was enabled to support remote voting, e.g., from home.
A voting-support team was active during the ballot period in over
twenty public locations in the neighborhood in and around the
park. The voting-support team presented the designs either with
a VR headset or using a 2D paper map detailing the design
variants. The paper map was used as a baseline in the study.
4.1.3 Procedure
The procedure was slightly different for participation through the
voting-support team vs. participating independently using
personal devices. With the voting-support team, the three variants
were presented in a fixed order (A-B-C), whereas for unassisted
voting the participants were free to display the variants in any
order as many times as they wanted on their own device. The team
assisted in two types of voting sessions, offered to residents as a
choice: using paper or using the VR headset. The team was
instructed to guide the viewing of the three variants, by operating
the VR headset for navigation between vantage points and
variants, and by answering questions that residents might have.
An assisted voting session lasted on average approximately 6
minutes using the VR headset and 3 minutes using the paper map.
After viewing the variants, either unassisted or assisted by the
team, the residents could vote for their preferred proposal. Voting
took place through a form on the district’s official website, where
voters could first view the three variants using their preferred
device and then cast their vote. The voting-support team also
carried tablets to allow residents to vote immediately after viewing
the designs via the VR headsets or on paper (see Figure 4).
In addition to the voting, the participants were asked to answer a
short questionnaire after reviewing all the variants. The
questionnaire contained questions related to the confidence of the
vote, perceiving differences between the design variants,
importance of the park for the voter, and willingness to
recommend the voting to others. It was a strategic decision to keep
the questionnaire short in the ballot in order to maximize the
number of responses in the participatory decision-making process.
4.1.4 Data
Table 1 summarizes the main data collected in the ballot. Voters’
willingness to recommend others to vote was used to determine
the Net Promoter Score (NPS) for the voting procedure. The NPS
is a measure, often used in marketing research, for customers’
engagement with a brand or product [32]. We used this measure
to determine citizens’ engagement with the overall decision-
making process regarding the park, as initiated by the
The questionnaire also gave the voter the opportunity to write a
motivation with their vote, which informed the district officials
about the perceived pros and cons of the three variants for the
Figure 3. Visualization and navigation of the designs
as shown on computer screens.
Figure 4. Residents viewing the variants of the park using
the VR headset (left) and paper plans (right), with the
voting-support team.
Confidence of the vote
0 10 (not at all confident
100% certain)
Confidence about having
perceived the differences
between the variants
0 10 (very few differences
differences very clear)
The importance of the park to
the voter
0 10 (not at all important
very important)
The voter’s willingness to
recommend others to vote
0 10 (not at all willing
certainly willing)
Table 1. Main variables for the questionnaire in the ballot.
Effectiveness of Virtual Reality in Participatory Urban Planning MAB'18, November, 2018, Beijing, China
4.2 Results
4.2.1 Engagement with the process (RQ1)
At the end of the voting period, 1302 residents had submitted valid
votes and completed forms. In earlier work, the research results
regarding the NPS were published [24] and showed that the
engagement with the voting-process in this case was in line with
the average appreciation for municipalities in The Netherlands.
No correlation was found between the importance of the park to
voters and their engagement with the process. The data showed
that voters using the 2D paper maps were significantly less willing
to ask others to vote as well, compared to users of smartphones
and users of the VR headset. Voters using their own computer
were significantly less willing to recommend than smartphone
users, but no significant difference was found between the VR
headset and the smartphone [24].
These results from the ballot questionnaire answer RQ1 from the
first perspective we mentioned earlier: regarding citizens’
engagement with the overall decision-making process. The second
perspective, citizens’ engagement with the presentation, using VR
as opposed to other display techniques, required an additional,
more detailed and controlled study in experiment 2.
4.2.2 Cognitive benefits (RQ2)
Analyzing the data from the ballot questionnaire, the voters’
confidence of their vote did not relate to the vote they casted (for
design variant A, B, or C), nor to the device they used to view the
variants. Voters’ confidence of being able to perceive the
differences between the variants for the park was also not related
to their actual vote.
(I) Device
(J) Device
VR headset
*. The mean difference is significant at the 0.05 level.
Table 2. Mean differences for the variable
‘Differences perceived’ in the ballot.
There were significant differences between the devices used, with
respect to the voters’ self-reported ability to see the differences
between the variants (see Table 2). Voters that viewed the plan
with the VR headset or with the 2D paper maps thus voters that
were approached and assisted by the voting-support team were
significantly more confident of having been able to see the
difference than voters viewing the plans unassisted using their
own devices. The assistance by the voting-support team, that was
instructed to answer questions about the different designs, seems
to be the factor of importance here, not the type of device used for
viewing the designs. The mean difference for the variable
Differences perceived, between assisted and unassisted voting
sessions was relevant and significant at -1.056, BCa 95% CI [-1.360,
-.752], p = .000.
Regarding the perceived differences between the three designs,
the short questionnaire in the ballot only addressed the voters’
confidence about perceiving the differences. Further study was
needed to examine the actual perception of differences, which we
did in experiment 2.
5.1 Method
Due to the unassisted voting opportunity, it was not possible to
control the contextual circumstances during the ballot, which
might have had an effect on the results. A laboratory study was
conducted to assess in detail the differences between immersive
and non-immersive VR regarding perceived differences between
the presented designs and engagement with the presentation
medium. The controlled study was conducted in two public
locations in the city.
5.1.1 Participants
76 participants (32 female) were recruited for the experiment. The
participants were recruited randomly from the location of the
experiment. 42 of these participants used the VR headset to display
the park designs, while the other 34 viewed the designs on a laptop
computer. None of the participants had participated in the public
5.1.2 Setup and Technology
The same VR headset that was used in the ballot was used in the
laboratory study. For comparison, a laptop computer was used to
display the 3D rendering on a 2D screen. Other devices such as
smartphones, tablets, and paper maps were not addressed in the
laboratory study. The main aim was to compare an immersive VR
headset with a non-immersive representation, and it was deemed
sufficient to do this comparison between the headset and a
conventional laptop screen.
The study was conducted in two locations in the city, relatively far
from the park itself in order to eliminate the importance of and
familiarity with the park from the experiment. The locations were
selected to be public indoor spaces with other people present in
the environment. The purpose of having background noise and
activity around the participant was to study the immersive quality
of the VR headset as well as potential distraction effects.
5.1.3 Procedure
The procedure was similar to that in the ballot with the voting-
support team. Each participant was instructed to view the
different designs either with the VR headset or with a laptop. For
the VR headset, the experiment conductor controlled the vantage
point in a fixed order. The participant was allowed to view the VR-
rendered park from each vantage point as long as they wanted and
MAB'18, November, 2018, Beijing, China J.P. van Leeuwen et al.
were encouraged to rotate their head to see the entire park. When
they were ready to move to the next vantage point and
subsequently to the next variant design, they expressed this to the
experiment conductor. Participants who viewed the designs on a
laptop were instructed to follow the same fixed order, but this was
not enforced and these participants switched more freely between
the vantage points and variants. The experiment conductor did not
offer any further clarifications or answers to questions about the
park design variants.
After the viewing, the participants were presented with an
extended questionnaire. The questionnaire was tuned to measure
memory and recall of objects in the park and differences between
the variants. The first part of the questionnaire asked the
participants to write down as many objects as they remembered
seeing (Free recall). The second part contained questions about the
voting experience and the voting itself. The third part presented
the participants with a checklist of 22 items (verbally described,
e.g., ‘a gazebo’); the task was to check whether the participant had
seen each item in variant A, B, and/or C (Recall accuracy).
Free recall
number of objects listed by the
Recall accuracy
0 10 (10 = perfect recall)
Confidence of the vote
1 5 (not confident at all 100%
Confidence about having
perceived the differences
between the variants
1 5 (very few differences
differences very clear)
Immersion in the 3D
1 5 (not immersed at all very
Translocation to the park
1 5 (no translocation at all felt
like in the park completely)
1 5 (not concentrated at all
completely concentrated)
Table 3. Main variables for the laboratory study.
5.1.4 Data
Table 3 presents an overview of the main data collected during the
laboratory study. The participants’ capability to remember what
they had seen was measured in two ways: (1) by counting the
number of objects they were able to write down (Free recall); and
(2) by a Recall accuracy score calculated from the checklist of 22
items. This score is representative for how accurately the
participant remembered the presence of each item in each of the
variants. Mistakes, such as remembering the item but not the
variant in which it was present, led to a lower score. A score of 10
represents perfect recall of all items in all variants (which never
The questionnaire also included questions for measuring the level
of immersion experienced by participants and their feeling of
having been translocated to the park as opposed to being at the
experimentation location. Finally, the questionnaire asked
participants how well they could concentrate on viewing the park
5.2 Results
5.2.1 Engagement with the decision-making (RQ1)
The data from the lab study clearly shows that participants were
significantly more engaged by the VR experience than by
navigating the 3D renderings on the computer screen. For each of
the three variables ‘Immersion,’ ‘Translocation,’ and
‘Concentration,’ there is a significant advantage for the VR
headset (see Table 4). None of these variables could be related to
gender or age groups (under 25, 25-49, 50+).
Mean difference
-.697, 95% CI [-1.250, -.145], p = .014
-1.755, 95% CI [-2.326, -1.184], p = .000
-.821, 95% CI [-1.243, -.398], p = .000
Table 4. Mean differences between Laptop and VR headset,
for variables Immersion, Translocation, and
Regarding session duration, there was no significant difference
between the VR headset and the computer (299 and 275 seconds,
respectively). On average, the sessions with the laptop were not
significantly overestimated, but those with the VR headset were.
Interestingly, the overestimation was found only in male
participants: the mean overestimation of the VR session duration
by males was 32.7% CI [15.214, 51.026], p = -.024; by females it was
3.7% and not significant.
In terms of engagement, the results are clear: in all the
engagement dimensions, the VR headset outperformed the laptop
5.2.2 Cognitive benefits (RQ2)
The laboratory study confirmed that the VR headset did not
significantly induce more self-reported confidence in the
participants’ decision, compared to the laptop. Participants’
confidence of being able to perceive the differences between the
variants for the park was also not related to their actual vote.
No significant mean difference in the recall accuracy was observed
between the laptop and the VR headset. However, the mean of the
number of objects participants listed in the free recall task was 6.24
for the laptop and 8.02 for the VR headset. The mean difference is
significant: -1.789, BCa 95% CI [-3.237, -.340], p = .016. In other
words, compared to using a laptop for viewing the 360˚ images of
the park, the VR headset allowed participants in the lab
experiment to better recount what they had seen, but when
measuring their recall accuracy in the recall test, there is no
significant difference between the two devices.
The results of this research provide insight into the effectiveness
of VR technology in involving the larger public in participatory
urban planning. Regarding the first research question about
citizens’ engagement with the decision-making process, two
Effectiveness of Virtual Reality in Participatory Urban Planning MAB'18, November, 2018, Beijing, China
conclusions can be drawn. First, in the co-design process, the
application of 3D modeling was instrumental for the workgroup
to see and reflect upon their designs, resulting in instant design
iterations. Instant visualization in 3D brings ideas to life and fuels
creativity, both in professional designers/planners and untrained
participant citizens, particularly so when designs can be
interactively changed during the co-design sessions. The activity
of visualization helps participants to assess and reflect deeper on
the spatial properties and qualities of their ideas. It facilitates
comparisons of alternative designs and places these, literally, into
the larger urban context. Being able to immediately review design
alternatives in 3D contributed positively to the engagement of the
Second, the results of the controlled laboratory study indicate that
the participants using immersive VR experienced higher levels of
engagement than the participants with non-immersive VR when
viewing alternative designs for the park. This result is very
important for the municipality in deciding whether to invest in
using immersive VR technology to stimulate citizen participation:
engaged voters can be argued to be less prone to external
distractions during the decision making and to be more committed
to make informed decisions. We can conclude that using 3D
rendering and VR technologies is fruitful to enhance civic
participation, as previously demonstrated [24] and discussed also
by Gill and Lange [17].
The data analysis showed a significantly higher engagement in
voters that used a Smartphone to view and assess the designs. This
may either indicate that the device used influences the
engagement level or that Smartphones users are more likely to
engage with local policy. Both possibilities are hard to substantiate
from the research results. The data shows no indications that the
outcome of the voting was biased by the device used to view and
assess the designs.
Interestingly, regarding the second research question about
cognitive benefits of immersive VR, increased engagement did not
result in higher confidence of the vote nor better ability to account
for differences between competing designs. The results of the
laboratory study show that people who used the VR headset were
able to remember more items in the park than people who used
the laptop. There was, however, no difference in the recall
accuracy between the two devices. This indicates that viewing the
designs on the VR headset resulted in more vivid, but not more
accurate, memory than viewing the designs on the laptop.
Considering the fact that the VR headset outperformed the laptop
in terms of immersion, translocation, and concentration, it seems
that the higher level of immersion with the VR headset might have
helped the participants with the free recall of items, which is in
line with previous results [18]. However, based on the results,
immersion was not helpful regarding the recall accuracy. The list
of 22 items to recall was, admittedly, rather long, so the high
cognitive demand of the task combined with the immersive
experience might have hindered the recall accuracy [4,14].
The controlled experiment corroborates the finding from the
ballot regarding the effect of the voting-support team on
perceiving differences between different designs. In the ballot, the
VR headset and paper maps were used with the voting-support
team, who were not only assisting the voting but were also
available to answer any questions the voters had. It is possible that
this discussion influenced the confidence in perceiving differences
between the designs. Since no significant difference between the
VR headset and the laptop was found in the controlled experiment,
the assistance by the team is a probable explanation for these
differences in the ballot. This result suggests that while
technology can be utilized for informed decision making in a
participatory process, interacting with municipal representatives
during the decision making can provide further insight into the
decision to be made.
6.1 Limitations
There are four main methodological limitations in the study, First,
as discussed above, the presence of the voting-support team
during the ballot seemed to influence the comparison between the
technologies. While this can be seen as biasing the voters in terms
of their confidence in perceiving the differences between the
designs, it is important to remember that the main aim of the
municipality was to get as many votes in as possible. We rectified
this bias by conducting the controlled laboratory experiment,
which eliminated the effect of the voting-support team from the
Second, the questionnaire during the ballot was limited in scope
due to the aim of easy voting. This implied that we were not able
to include questions related to immersion, demographics, and
details of perceived differences between the designs. While this
data could have provided further insight into how people
perceived the VR technology in the voting, we were still able to
sufficiently investigate immersion and perceived differences in the
controlled experiment.
Third, to simplify the viewing of the three designs with the VR
headset, they were always presented in the same order (A-B-C).
Thus, the results do not account for possible order effects. We did
not control in which order people viewed the variants in the
unassisted voting, nor how many times they looked at each variant
from each vantage point. However, this approach did not have a
statistically decisive influence on the outcome of the ballot itself
and it is unlikely that it had an effect on the key measures of our
study. Willingness to recommend the voting, perceived
differences between the variants, and level of immersion can be
argued to be relatively robust against order effects.
Finally, while qualitative data was collected through interviews
and observations during the sessions of the workgroup in phase 2
of the participation process, the research presented in this paper
focused solely on collecting quantitative data in the public ballot
in phase 3. Interactions between the voting-support team and the
public were observed, but not methodically enough to allow
conclusions to be drawn.
The presented case study investigated the effectiveness of VR
technology in participatory urban planning, in the context of a
municipal decision-making process. The results suggest that there
are several benefits in using VR headsets with 3D rendering in
such a process. First, immersive VR provides higher engagement
MAB'18, November, 2018, Beijing, China J.P. van Leeuwen et al.
than using 2D presentation technologies, indicating stronger
potential in eliciting participation. Second, immersive VR results
in more vivid memory of the viewed content than computer
monitors, which may be important in terms of making informed
decisions. Third, the effect of human interaction should not be
neglected in decision-making processes harnessing engaging
technologies. Finally, the experiments provide the kind of
evidence that municipal governments need to decide about
investments and the design of participatory planning processes.
The participatory design project had an important social impact
on the neighborhood. The resulting design closely reflects the
needs and wishes of the inhabitants near the park. The
municipality’s decision to involve all inhabitants, in response to
discontentment about the park, has also contributed to the
relationship between the neighborhood and the municipal
government. Citizens showed an increased and genuine interest in
the local urban development and felt invited to partake in the
decision-making. In this way, the renewed park and the process of
its realization contribute to the social cohesion in the
neighborhood and a shared responsibility to maintain its social
and physical qualities. Did the participatory design and the voting
procedure lead to a better design for the park? In the opinion of
the municipal officials involved, the actual value in a project like
this is determined not merely by the quality of the resulting
design, but by the quality of the public support for its outcome.
The social and managerial impact of the participation project is
discussed in more detail in earlier work [24].
Due to the nature of the municipal decision-making process, there
were some methodological limitations in the large-scale field
study during the ballot. These limitations were rectified through
an additional controlled experiment to ensure experimental
validity. The field study and the controlled experiment
complemented each other and resulted in findings that could not
have been obtained without conducting both experiments.
Therefore, we can conclude that when conducting research as an
additional component in a design process of a municipality, it is
important to conduct additional experiments to shed more light
on the obtained insights.
7.1 Future work
From our observations and evaluations with the voting-support
team, we learned that many voters said, after voting, that they
would like to be able to participate in a more nuanced manner than
just choosing between the three options given. They had
suggestions to make and ideas to explore for modifications of the
proposed designs. Ball et al. [5] stress that mutual understanding
between planners and stakeholders is a prerequisite for successful
participatory design. For mutual understanding to happen, there
must be a public dialogue about urban plans, stakeholder needs,
and consequences of design decisions [5]. Facilitating such
dialogues and co-design activities for the larger public calls for a
much subtler approach, where the effectiveness of visual
communication is combined with tools for dialogue, design
exploration, collective construction of meaning, and of shared
understanding. Future work on this topic would have to address
the design of such tools and to explore the delicate balance
between meaningful interactions and public accessibility of what
could potentially become a very complex collaborative design
environment. Prior to this kind of development, more qualitative
research is needed to gain insight into the social factors that bind
participants, both professional and untrained, in co-design
The increasing availability of VR and AR technology, including on
common Smartphones, is lowering the threshold for setting up
and managing this technology in projects with public
participation. For municipalities it is essential to increase the level
of citizen-engagement in decision-making processes and media
technology proves to be a very appealing way to do this. The
municipalities’ interest in using VR and other digital media for this
purpose, leads to two speculations regarding media architecture.
First, in addition or alternative to VR, other digital media can
be utilized to facilitate citizen engagement and offer valuable
capabilities. For instance, using public displays as discussed by,
e.g. [12,2831,33,34], may be suitable to prompt public debates
about alternatives in decision-making processes. Second,
participatory processes will play an increasing role in decision-
making, also regarding the design and realization of media
installations in public spaces. The process presented in this paper
can be applied in such cases and our conclusions may help
optimize the social and managerial effects and the acceptance of
the outcome.
1. Kheir Al-Kodmany. 1999. Using visualization techniques for
enhancing public participation in planning and design:
process, implementation, and evaluation. Landscape and Urban
Planning 45, 1: 3745.
2. Kheir Al-Kodmany. 2001. Visualization Tools and Methods for
Participatory Planning and Design. Journal of Urban
Technology 8, 2: 137.
3. Sherry R. Arnstein. 1969. A Ladder of Citizen Participation.
Journal of the American Planning Association 35, 4: 216224.
4. Jakki Bailey, Jeremy N Bailenson, Andrea Stevenson Won,
June Flora, and K Carrie Armel. 2012. Presence and Memory:
Immersive Virtual Reality Effects on Cued Recall. Proceedings
of the International Society for Presence Research Annual
Conference: 2426.
5. J Ball, N Capanni, and S Watt. 2007. Virtual Reality for Mutual
Understanding in Landscape Planning. International Journal of
Social, Behavioral, Educational, Economic, Business and
Industrial Engineering 1, 11: 661671.
6. Erling Björgvinsson, Pelle Ehn, and Per-Anders Hillgren. 2010.
Participatory design and “democratizing innovation.” In
Proceedings of the Participatory Design Conference - PDC ’10,
7. Glenda Amayo Caldwell and Marcus Foth. 2014. DIY media
architecture: Open and participatory approaches to
community engagement. In Proceedings of the 2014 Media
Architecture Biennale, 110.
8. J.L. Creighton. 2005. The public participation handbook: Making
Better Decisions Through Citizen Involvement. John Wiley &
Sons, Inc., Hoboken, NJ.
9. Jens Dambruch and Michel Krämer. 2014. Leveraging public
participation in urban planning with 3D web technology.
Proceedings of the Nineteenth International ACM Conference on
3D Web Technologies - Web3D ’14: 117124.
10. Christopher A. le Dantec and Carl DiSalvo. 2013.
Effectiveness of Virtual Reality in Participatory Urban Planning MAB'18, November, 2018, Beijing, China
Infrastructuring and the formation of publics in participatory
design. Social Studies of Science 43, 2: 241264.
11. H.Q. Dinh, N. Walker, L.F. Hodges, Chang Song, and A.
Kobayashi. 1999. Evaluating the importance of multi-sensory
input on memory and the sense of presence in virtual
environments. In Proceedings IEEE Virtual Reality 1999, IEEE,
Houston, TX, 222228.
12. Marcus Foth, Martin Tomitsch, Laura Forlano, M. Hank
Haeusler, and Christine Satchell. 2016. Citizens breaking out
of filter bubbles. In Proceedings of the 5th ACM International
Symposium on Pervasive Displays - PerDis ’16, 140147.
13. Marcus Foth. 2017. Participation, Co-Creation, and Public
Space. The Journal of Public Space 2, 4: 2136.
14. Jesse Fox, Jeremy Bailenson, and Joseph Binney. 2009. Virtual
experiences, physical behaviors: The effect of presence on
imitation of an eating avatar. Presence: Teleoperators and
Virtual Environments 18, 4: 294303.
15. Joel Fredericks, Glenda Amayo Caldwell, and Martin
Tomitsch. 2016. Middle-out design: collaborative community
engagement in urban HCI. In Proceedings of the 28th Australian
Conference on Computer-Human Interaction, 200204.
16. Gemeenteraad Den Haag. 2012. Inspraak- en
participatieverordening gemeente Den Haag 2012 (The Hague
municipal bill on civic participation, in Dutch). Gemeente Den
17. Lewis Gill and Eckart Lange. 2015. Getting virtual 3D
landscapes out of the lab. Computers, Environment and Urban
Systems 54: 356362.
18. Joel Harman, Ross Brown, and Daniel Johnson. 2017. Improved
Memory Elicitation in Virtual Reality: New Experimental
Results and Insights. In INTERACT 2017, Springer, 128146.
19. Pepijn van Houwelingen, Anita Boele, and Paul Dekker. 2014.
Burgermacht op eigen kracht? Een brede verkenning van
ontwikkelingen in burgerparticipatie (in Dutch). Sociaal en
Cultureel Planbureau, Den Haag.
20. T.L.J. Howard and N. Gaborit. 2007. Using Virtual
Environment Technology to Improve Public Participation in
the Urban Planning Process. Journal of Urban Planning and
Development 133, 4: 233241.
21. Helena Karasti. 2014. Infrastructuring in participatory design.
In Proceedings of the Participatory Design Conference - PDC ’14,
22. S. F. Kuliga, T. Thrash, R. C. Dalton, and C. Hölscher. 2015.
Virtual reality as an empirical research tool - Exploring user
experience in a real building and a corresponding virtual
model. Computers, Environment and Urban Systems 54: 363
23. Antje Kunze, Jan Halatsch, Carlos Vanegas, Martina Maldaner
Jacobi, Benamy Turkienicz, and Gerhard Schmitt. 2011. A
Conceptual Participatory Design Framework for Urban
Planning. In Proceedings of eCAADe 2011: Respecting Fragile
Places, Ljubljana, Slovenia, 895903.
24. Jos P. van Leeuwen, Klaske Hermans, Arnold Jan Quanjer,
Antti Jylh
, and Hanke Nijman. 2018. Using Virtual Reality to
Increase Civic Participation in Designing Public Spaces. In
Proceedings of the European Conference on Digital Government
2018, Santiago de Compostela, Spain.
25. Jos P. van Leeuwen and Harry J.P. Timmermans (eds.). 2006.
Innovations in Design & Decision Support Systems in
Architecture and Urban Planning. Springer, Dordrecht, NL.
26. James J.W. Lin, Henry B.L. Duh, Donald E. Parker, Habib Abi-
Rached, and Thomas A. Furness. 2002. Effects of Field of View
on Presence, Enjoyment, Memory, and Simulator Sickness in a
Virtual Environment. In Proceedings IEEE Virtual Reality
2002(VR), IEEE, Orlando, FL, 164.
27. Luigi Maffei, Massimiliano Masullo, Aniello Pascale, Gennaro
Ruggiero, and Virginia Puyana Romero. 2016. Immersive
virtual reality in community planning: Acoustic and visual
congruence of simulated vs real world. Sustainable Cities and
Society 27: 338345.
28. Nemanja Memarovic, Ivan Elhart, Andrea Michelotti, Elisa
Rubegni, and Marc Langheinrich. 2013. Social Networked
Displays: Integrating Networked Public Displays with Social
Media. In Proceedings of the International Joint Conference on
Pervasive and Ubiquitous Computing - UbiComp’13, Zurich,
Switzerland, 5558.
29. Nemanja Memarovic, Marc Langheinrich, Florian Alt, Ivan
Elhart, Simo Hosio, and Elisa Rubegni. 2012. Using public
displays to stimulate passive engagement, active engagement,
and discovery in public spaces. In Proceedings of the 4th Media
Architecture Biennale Conference on Participation - MAB ’12,
Aarhus, Denmark, 5564.
30. Nemanja Memarovic, Marc Langheinrich, and Ava Fatah gen.
Schieck. 2014. Community is the Message - Viewing
Networked Public Displays Through McLuhan’s Lens of
Figure and Ground. In Proceedings of the Media Architecture
Biennale - MAB’14, Aarhus, Denmark, 3033.
31. Timo Ojala, Vassilis Kostakos, Hannu Kukka, Tommi
Heikkinen, Tomas Lind
n, Marko Jurmu, Simo Hosio, Fabio
Kruger, and Daniele Zanni. 2012. Multipurpose Interactive
Public Displays in the Wild: Three Years Later. Computer: 42
32. FF Reichheld. 2003. The one number you need to grow.
Harvard business review 81, 12: 4655.
33. Mettina Veenstra, Niels Wouters, Marije Kanis, Stephan
Brandenburg, Kevin te Raa, Bart Wigger, and Andrew Vande
Moere. 2015. Should Public Displays be Interactive? Evaluating
the Impact of Interactivity on Audience Engagement. In
Proceedings of the 4th International Symposium on Pervasive
Displays - PerDis ’15, Saarbruecken, Germany, 1521.
34. Leena Vent
-Olkkonen, Marianne Kinnula, Graham Dean,
Tobias Stockinger, and Claudia Zu
iga. 2013. Who’s There?
Experience-Driven Design of Urban Interaction Using a
Tangible User Interface. In Proceedings of the 12th Int’l Conf. on
Mobile and Ubiquitous Multimedia - MUM ’13, Lule
, Sweden.
35. Bauke de Vries, Jos van Leeuwen, and Henri Achten (eds.).
2001. Computer Aided Architectural Design Futures 2001.
Kluwer Academic Publishers, Dordrecht, NL.
36. Martijn de Waal. 2014. The City as Interface. Nai010 Publishers,
Rotterdam, NL.
37. Martijn de Waal and Marloes Dignum. 2017. The citizen in the
smart city. How the smart city could transform citizenship.
Information Technology 59, 6: 263273.
38. Sarah Williams. 2016. Data Visualizations Break Down
Knowledge Barriers in Public Engagement. In Civic Media:
Technology, Design, Practice, Eric Gordon and Paul Mihailidis
(eds.). The MIT Press, Cambridge, MA, 165197.
39. Ulrike Wissen Hayek. 2011. Which is the appropriate 3D
visualization type for participatory landscape planning
workshops? A portfolio of their effectiveness. Environment
and Planning B: Urban Analytics and City Science 38, 5: 921
40. Ulrike Wissen Hayek, Noemi Neuenschwander, and Adrienne
Grêt-Regamey. 2012. Facilitating well-informed trade-off
decision making on land use change: Integrating rules and
indicators of ecosystem service provision into procedural 3D
visualization. In 6th International Congress on Environmental
Modelling and Software - Leipzig, Germany, 22352242.
... They can be employed toaccess places that cannot be reached in material space (Portman, Natapov, and Fisher-Gewirtzman 2015) and interact with objects that only existing as planned possibilities (Cirulis and Brigmanis 2013). They excel as multisensory community planning platforms (van Leeuwen et al. 2018). In Canberra VR based Esri City Engine has been used to visualise the effects of light rail development (Schubert 2017) and recently in London's Square Mile new planning proposals can utilise detailed digital twin model of Square Mile to gauge the potential changes (VU.CITY 2021). ...
Full-text available
Virtual geographical environments (VGEs) are being used to represent our sense of place through the application of extended-reality or cross-reality (XR) technologies with a focus on technological advancement and immersion. In light of this, we propose that an expanded and interdisciplinary understanding of the concept of immersion is required to facilitate an understanding of spatial data to a broader audience. The potential of focusing on narrative immersion and literary placemaking in VGEs is discussed to evoke a stronger sense of place and a feeling of presence and belonging in users. This paper seeks to highlight the unique affordances and potentialities of XR narrative style GIS digital representations through an interdisciplinary theoretically lead analysis of outputs created by the Building City dashboards project towards the goal of expanding audiences of non-specialist stakeholders in urban planning processes.
... Besides 3D web applications, a large volume of published studies indicates that urban planning processes can benefit from AR and VR approaches. In the context of VR applications in participation processes, for example, van Leeuwen et al. [19] propose that immersive VR applications might provide higher engagement than 3D renderings on screens. Furthermore, Ma et al. [20] argue that VR-driven visualizations of spatial relationships in the built environment can make complex questions more accessible for stakeholders. ...
Full-text available
The demand for participant engagement in urban planning shows a great need for tools that enable communication between stakeholders and make planning processes more transparent. So far, common methods use different tools and platforms independently. This prevents the full potential for effective, efficient, and creative collaboration from being realized. Hence, this paper presents an approach that combines different participation settings (off-site, on-site, and online) by using an interactive touch table and an additional screen, as well as virtual reality (VR) and augmented reality (AR) devices, and synchronizing them in real-time. To fulfill the collaboration requirements, three major technical aspects are addressed in the concept and prototype implementation: Firstly, the demands for various settings and devices require a uniform and cross-device interaction concept. Secondly, all changes in the course of the participation (e.g., adding, manipulating, or removing objects) must be synchronized across all devices in real-time, with very low latency. Thirdly, the various states should be saved persistently during the collaboration process. Detailed empirical usability studies are still pending; however, pretests indicate that the concept is appreciated, and the transferability to other planning processes is given.
... Visualizing ideas using augmented reality and virtual reality seems to be a promising approach to arouse interest and provide information, as well as to foster participation in the form of ideas and discussion about a project [2,3]. City planners and project initiators are often faced with the complex task of delivering different types of information to distinct audiences [4] that need to be made available. ...
Digital public participation formats are an emerging and accessible way to involve diverse groups of citizens in construction projects in their local area. Particularly, mixed reality can help project initiators to visualize the planned changes to the city landscape in an easy and understandable way, enabling people to participate in a creative manner. However, this technology is challenging for most project initiators, as it requires an extensive technical and/or domain experience. Besides that, specialized hardware and experienced staff is required. An easy on-boarding process, which introduces mixed reality step-by-step and offers assistance by external service providers could promote both adoption and usage. In this paper, we present the design process and resulting concept of a configurator for a public participation platform, that aims to guide initiators with different levels of technical knowledge. Besides detailing the design and development process of the prototype, we will present the preliminary results of our evaluation. The interview partners provided positive feedback on the usage of our configurator. Moreover, different approaches are necessary for the public and private sector when configuring and purchasing their participation solution. Finally, we highlight areas that are still in need of further work, such as the compliance with the regulations for public institutions and address further promising areas of research.
... In terms of future work, additional research should consider the growing interest in understanding whether integrating the technique of immersion (e.g., through virtualreality-type environments or narrative immersion) is helpful for the successful deployment of cycling DPPs. It could facilitate more insight, higher levels of engagement and more empathy in the process [28][29][30]. Many studies have investigated the use of bikes in im-mersive environments (such as head-mounted virtual reality headsets and immersive cave automatic virtual environments), but these have been limited to collecting biometric information, health information and understanding navigation techniques and have not been used to inform infrastructure planning [31][32][33][34]. ...
Full-text available
The planning of bicycle infrastructure across our cities remains a complex task involving many key stakeholders, including the community, who traditionally have had limited involvement in the planning process. This research develops an interactive bicycle prioritisation index tool which includes participatory spatial and textual citizen feedback. The research involves three components. Firstly, results of a survey of current cyclists in Sydney (n = 280), their current level of participation, priorities in investment in cycling and preferred locations for cycling infrastructure. This survey was undertaken between May and June 2020. Secondly, it documents the development of an interactive, digital bicycle planning tool which is informed through citizen feedback. Thirdly, it evaluates the approach in conversation with potential end-users, including government, planning practitioners, and advocacy group members. A clear preference for active participation mechanisms (86%) was articulated by current cyclists, as opposed to a reliance on the existing data available and passive data. The resulting tool was understood by interview participants and documented both existing utility and future work needed for practical implementation of similar systems. The research proposes the combination of multiple passive and active data traces with end-user evaluation to legitimise the citizen co-design of bicycle investment prioritisation initiatives. A case study approach was taken, focusing on the city of Sydney, Australia. The bicycle planning support system can be used by cities when engaging in cycle prioritisation initiatives, particularly with a focus on integrating citizen feedback and navigating the new and complex data landscapes introduced through recent, passively collected big data sets.
Augmented reality (AR), a type of immersive technologies, goes beyond traditional methods of engagement with the general public. It offers an interactive way to expand visualization and communication techniques in public participation. AR generates distinctive experiences by combining the real physical world with a digital or simulated reality. This paper discusses three mobile AR applications (apps) developed by a partnership among four community-based organizations and educational institutions in the City of Charlotte, USA. These apps use AR to overlay current streetscapes in the physical world with digital images that show the historical views of the exact physical locations. They also help the public understand neighborhood characteristics by presenting quantitative socio-economic data as three dimensional digital infographics. These AR apps support a series of community events including an open-street event and several indoor exhibits focused on neighborhood history. These events are aimed at expanding overall public participation and civic engagement with a goal of increasing awareness of neighborhood history through data visualization and story-telling. Surveys and interviews conducted during these events show that a majority of event participants gained new knowledge about the history of their neighborhoods with the information provided by these AR experiences.
3D dynamic visualization technologies are increasingly used in studying residents' preferences for urban planning and design scenarios. The techniques help concentrate respondent attention and improve the measurement quality of environmental preferences. However, little is known about differences in measurement quality between different 3D dynamic visualization modes. This paper applies two modes – a self-navigation mode and a video mode - in a virtual environment-based stated choice experiment with the aim of measuring neighborhood public spaces preferences. Based on data from 276 experiment participants and applying conditional and mixed logit techniques, we find no statistically significant differences in the model fit between the two modes. Out of six public space attributes, only one shows statistically significant differences in valuation between modes, namely ‘vertical green’. Our results suggest that the choice between video and self-navigation modes can be based on other (secondary) considerations, i.e., required sample size, respondents' experiences with navigation interfaces, the specific goals of the study or application in practice, and the costs and effort needed to conduct the experiment.
Counties are unique on the services they provide and on their relation to the land, the state, and neighboring municipalities. Smart technologies have the potential to transform cities, but the idiosyncrasies of counties pose some specific challenges in relation to geography, distance, remote populations, isolated communities, obligations to the state, and necessary relations and collaboration with neighboring municipalities. Some smart technologies, such as in utilities, will be best implemented when planned and organized by a regional organization that spans across cities and counties. Other technologies can be planned and implemented internally to serve the county residents, while some will require complicated agreements with neighboring municipalities and participating private entities and corporations. In all cases, the triad of major participants in this transformation are corporations, government, and citizens with all the inner power dynamics such coexistence creates. The smartification process spans a wide spectrum of county departments, and each one has the potential to address county challenges, be involved, and benefit accordingly. When implementing smart technologies, however, it is important to keep in mind general considerations of economy, society, environment, quality of life, and “place” as general guides in policy creation and understand that the goal is not to simply implement technology and acquire the label “smart city” and “smart county,” but instead, to benefit the community, improve quality of life, and create “place.” This presents a juxtaposition of instrumental versus value-based approaches to smart technologies, which is a major philosophical issue at the base of the theoretical implications of smartification. An instrumental approach has the potential of deducing inadequate conclusions by focusing solely on sensor inputs and ignoring the multilayered experience of the human milieu, while a value-based approach will always keep in mind the values of the community to guide policymaking. Finally, it is paramount not to forget that Smart Growth is an entirely different phenomenon than smart technologies, which, contrary to smart growth, have limitations in creating architectural and urban spaces. Both approach quality of life from a very different perspective, can both contribute positive results, but smart technologies lack the ability to create a foundation of good urbanism.
Full-text available
Both policy and research highlight the importance of diverse stakeholder input in urban development processes but visualizing future built environments and creating two-way design communication for non-expert stakeholders are challenging. The present study develops an intuitive and simplified 3D modeling platform that integrates web-based desktop, virtual reality and mobile augmented reality technologies for remote simultaneous urban design collaboration. Through iterative prototyping, based on two series of workshops with stakeholders, the study resulted in such an integrated platform as a minimum viable product as well as specifications for a minimum marketable product to be used in real projects. Further study is required to evaluate the minimum level of detail in the 3D modeling necessary for good perception of scale and environmental impact simulation.
Conference Paper
Full-text available
Municipalities increasingly seek to include citizens in decision-making processes regarding local issues, such as urban planning. This paper presents a case study on using Virtual Reality (VR) in a process of civic participation in the redesign of a public park. The municipality included citizens in intensive co-design activities to create three designs for the park and engaged the neighbourhood community in co-decision, in the form of a ballot. Through the civic participatory process, we studied the effectiveness of using VR technology to engage the community in participating in the co-decision process. The three designs were presented using highly realistic 360˚ visualisations and the effects on engagement were compared between various devices: VR headsets, smartphones, tablets, and computers. Viewing the designs in 2D paper plans was also included in the comparison. The study included over 1300 respondents that participated in the ballot. A statistical analysis of the collected data shows that participants viewing the 360˚ rendered images with VR technology expressed a significantly higher engagement in the co-decision process than those using their computer at home or viewing 2D paper plans. The paper describes the complete participatory design process and the impact of the e-governance used on the target group as well as on the actors organizing the e-governance process. We discuss how the use of new technology and active presence of a voting-support team inspired citizens to participate in the co-creation process and how the investment in this procedure helped the local authorities to generate support for the plans and strengthen its relationship with the community. The use of realistic visualisations that can be easily assessed by citizens through user-friendly technology, enabled a large and diverse audience to participate. This resulted in greater visibility of municipal efforts to enhance the living environment of citizens and is therefore an important step in increased civic engagement in municipal policy-making and implementation.
Full-text available
p>A central notion in urban design, urban interaction design, and placemaking is the user of public space, the occupant, resident, citizen, bystander, passer-by, explorer, or flâneur. When the field of human-computer interaction (HCI) first emerged, the disciplines that represented the “human” aspects of HCI included behavioural psychology, cognitive science and human factors engineering. This situatedness begs the question whether the “user” requires different contextualisations beyond the immediate and traditional HCI concerns of the technical interface, that is, beyond usability. This article aims to illustrate the need for placemakers and urban interaction designers to be transdisciplinary and agile in order to navigate different levels of granularity. This article seeks to practice granular agile thinking by introducing five possible ways to think about the “urban user” and the implications that follow: the user as city resident; the user as consumer of city services; the user as participant in the city’s community consultations; the user as co-creator in a collaborative approach to citymaking, and finally; the user re-thought as part of a much larger and more complex ecosystem of more-than-human worlds and of cohabitation – a process that decentres the human in the design of collaborative cities.</p
Full-text available
Smart city-policy makers and technology vendors are increasingly stating they want to bring about citizen-centered smart cities. Yet, it often remains unclear what exactly that means, and how citizens are envisaged as actors in smart cities. This article wants to contribute to this discussion by exploring the relation between smart cities and citizenship. It aims to do this by introducing a heuristic scheme that brings out the implied notions of citizenship in three distinct sets of smart city visions and practices: The Control Room envisages the city as a collection of infrastructures and services; The Creative City views the city from the perspective of (economic) geography and ponders on local and regional systems of innovation; The Smart Citizens discourse addresses the city as a political and civic community. These smart city discourses are mapped against two visions on citizenship and governance taken from political philosophy. A `republican' perspective with strong presence in social-democratic countries is contrasted with a libertarian one, most prominent in Silicon Valley approaches to smart city technologies. This provides a scheme to reflect on potential benefits and downsides if a specific smart city discourse would develop. Instances of smart cities may promote notions of citizenship that are based on consumer choice and individual responsibility, alternatively they could also reinforce collective responsibilities towards the common good of society.
Conference Paper
Full-text available
This paper presents a collaborative approach for designing, implementing and deploying situated urban HCI interventions. It draws on field studies that use HCI technologies for collecting feedback from citizens. Based on an analysis of these field studies and a discussion of top-down and bottom-up initiatives currently used in community engagement we propose that both decision makers and local communities should be involved in the city making process. We relate our approach, which we refer to as middle-out design, to other co-design and participatory design movements in HCI and conclude on a discussion on how our work can contribute to the discourse around urban HCI particularly for the purpose of community engagement to inform change.
Conference Paper
Eliciting accurate and complete knowledge from individuals is a non-trivial challenge. In this paper, we present the evaluation of a virtual-world based approach, informed by situated cognition theory, which aims to assist with knowledge elicitation. In this approach, we place users into 3D virtual worlds which represent real-world locations and ask users to describe information related to tasks completed in those locations. Through an empirical A/B evaluation of 62 users, we explore the differences in recall ability and behaviour of those viewing the virtual world via a virtual reality headset and those viewing the virtual world on a monitor. Previous results suggest that the use of a virtual reality headset was able to meaningfully improve memory recall ability within the given scenario. In this study, we adjust experiment protocol to explore the potential confounds of time taken and tool usability. After controlling for these possible confounds, we once again found that those given a virtual reality headset were able to recall more information about the given task than those viewing the virtual world on a monitor.
The Europe2020 document indicates a new strategy to turn EU into a smart, sustainable and inclusive economy. Governments have established several principles and priorities for growth that include sustainable development, participation, and decentralization. Participatory planning is an important tool to strengthen the legitimacy of the policy and decision making. To make this possible, decisions and design choices should be accepted and tested by the different participants of the community, stakeholders, experts and even non-experts, as ordinary citizens.
Conference Paper
Social media platforms risk polarising public opinions by employing proprietary algorithms that produce filter bubbles and echo chambers. As a result, the ability of citizens and communities to engage in robust debate in the public sphere is diminished. In response, this paper highlights the capacity of urban interfaces, such as pervasive displays, to counteract this trend by exposing citizens to the socio-cultural diversity of the city. Engagement with different ideas, networks and communities is crucial to both innovation and the functioning of democracy. We discuss examples of urban interfaces designed to play a key role in fostering this engagement. Based on an analysis of works empirically-grounded in field observations and design research, we call for a theoretical framework that positions pervasive displays and other urban interfaces as civic media. We argue that when designed for more than wayfinding, advertisement or television broadcasts, urban screens as civic media can rectify some of the pitfalls of social media by allowing the polarised user to break out of their filter bubble and embrace the cultural diversity and richness of the city.
Conference Paper
Media architecture's combination of the digital and the physical can trigger, enhance, and amplify urban experiences. In this paper, we examine how to bring about and foster more open and participatory approaches to engage communities through media architecture by identifying novel ways to put some of the creative process into the hands of laypeople. We review technical, spatial, and social aspects of DIY phenomena with a view to better understand maker cultures, communities, and practices. We synthesise our findings and ask if and how media architects as a community of practice can encourage the 'open-sourcing' of information and tools allowing laypeople to not only participate but become active instigators of change in their own right. We argue that enabling true DIY practices in media architecture may increase citizen control. Seeking design strategies that foster DIY approaches, we propose five areas for further work and investigation. The paper begs many questions indicating ample room for further research into DIY Media Architecture.
Conference Paper
Networked public displays are being portrayed as "a new communication medium for the 21st century", potentially having the same impact on society as radio, TV, and the Internet. In order to understand how this new medium can impact the society this paper uses a (small) part of Marshall McLuhan's media theory, i.e., the interplay between the figure - the medium - and the ground - the context in which the medium operates - and how the figure amplifies otherwise invisible effects of the ground. By analyzing environmental/urban research on interactions and processes in public spaces this paper infers the effects of the ground - public space - amplified through the figure - networked public displays - on its audience, showing why this new medium is fitted for affecting and enriching place-based communities. Overall, this paper contributes to the theory of networked urban/public displays and their use as a communication medium.