PresentationPDF Available

Toward Understanding Civic Data Bias in 311 Systems: An Information Deserts Perspective

Authors:

Abstract and Figures

While civic technologies for public issues and services such as 311 systems are widely adopted in many U.S. cities, the impact of the emerging civic technologies and their data-level dynamics are unclear. Because the provision patterns of civic issues to technological systems are different across neighborhoods and populations, it is difficult for city officials to understand whether the provided data itself reflects civic issues. Also, the disparities in the information provided to civic technologies in different neighborhoods may exacerbate the existing inequality. To understand how civic data is created and how people's use of civic technologies plays a role as an intermediary process in shaping community performances, we take an information deserts perspective in studying 311 systems. The concept of information deserts is informed by a material understanding of local information landscapes, making it possible to distinguish local information's structural features from its social-construction process. Based on this theoretical lens, we suggest new opportunities for civic technology and data research.
Content may be subject to copyright.
Toward Understanding Civic Data Bias
in 311 Systems: An Information
Deserts Perspective
Myeong Lee
George Mason University
Fairfax, VA 22030, USA
mlee89@gmu.edu
Jieshu Wang
Erik Johnston
Arizona State University
Tempe, AZ 85281, USA
jwang490@asu.edu
erik.johnston@asu.edu
John Harlow
Eric Gordon
Emerson College
Boston, MA 02116, USA
john_harlow@emerson.edu
eric_gordon@emerson.edu
Shawn Janzen
Susan Winter
University of Maryland
College Park, MD 20742, USA
sjanzen@umd.edu
sjwinter@umd.edu
Permission to make digital or hard copies of part or all of this work for personal or
classroom use is granted without fee provided that copies are not made or distributed
for profit or commercial advantage and that copies bear this notice and the full citation
on the first page. Copyrights for third-party components of this work must be honored.
For all other uses, contact the owner/author(s).
Copyright held by the owner/author(s).
CSCW’20,, October 17–21, 2020, Miami, FL, USA
ACM 978-1-4503-6819-3/20/04.
https://doi.org/10.1145/3334480.XXXXXXX
Abstract
While civic technologies for public issues and services such
as 311 systems are widely adopted in many U.S. cities, the
impact of the emerging civic technologies and their data-
level dynamics are unclear. Because the provision patterns
of civic issues to technological systems are different across
neighborhoods and populations, it is difficult for city officials
to understand whether the provided data itself reflects civic
issues. Also, the disparities in the information provided to
civic technologies in different neighborhoods may exacer-
bate the existing inequality. To understand how civic data
is created and how people’s use of civic technologies plays
a role as an intermediary process in shaping community
performances, we take an information deserts perspec-
tive in studying 311 systems. The concept of information
deserts is informed by a material understanding of local in-
formation landscapes, making it possible to distinguish local
information’s structural features from its social-construction
process. Based on this theoretical lens, we suggest new
opportunities for civic technology and data research.
Author Keywords
Information deserts; 311 systems; data bias; smart cities
CCS Concepts
Information systems Information systems applica-
tions; Data analytics; Human-centered computing
Human computer interaction (HCI);
Introduction
Beginning in Baltimore in 1996, cities began using the tele-
phone number “311” to enable residents to report non-
emergency (i.e., not 911) issues, such as potholes, street-
lights, and graffiti, among other urban problems [7]. Subse-
quently, cities have augmented telephone-based 311 ser-
vices with email-, website-, and application-based reporting.
Benefits from these 311 systems have included lower costs
and better service provision [1], as well as more efficient re-
source allocation, such as moving calls from 911 to 311 [5].
Over time, 311 systems have become an important commu-
nication tool between local governments and publics, with
311 mediating public services provision.
Figure 1: The relationship
between data biases,
policy-making, and inequalities.
While 311 systems have greatly expanded the number of
people who contribute to urban data sets, researchers
found that contributors’ motivation is mostly not a sense
of civic duty, but rather territoriality, or a desire to preserve
and protect private space [6]. As a result, socio-economic
divisions tend to be reinforced, not disrupted, through 311
systems [3]. Because a large portion of civic data is his-
torically, demographically, or geospatially biased, compu-
tational social scientists often use algorithmic and data
modeling techniques to understand and adjust for biases
for predicting other community characteristics [8]. However,
these approaches only address biases after the creation
of data, rather than before or during its creation. In addi-
tion, the prediction models that rely on the biased features
in the data could be less generalizable if civic technologies
are revised or enhanced, which may alter the dynamics
of human-system relationships in an ad-hoc manner. If it
were possible to address biases as civic data is created, it
could help researchers and governments improve the eq-
uity of municipal service provision as well as the robustness
of civic data quality. Failing to understand and ameliorate
biases in civic data can exacerbate the inequalities of the
past and institutionalize them in the cities of the future (Fig-
ure 1) [4].
To understand the dynamics of smart cities of the future
and minimize the negative effects of technical interventions
on inequalities, this position paper proposes that it is imper-
ative to:
Identify the biases of the past in the datasets of the
present
Understand how those biases proliferate into hybrid
computer-human systems
Develop computational models that can operational-
ize the information deserts of civic issues to illustrate
those biases
Improve municipal decision-making and public ser-
vice provision by mapping information deserts as a
map-based visualization tool
Produce design guidelines for future civic technolo-
gies to identify and address provision-level biases
Local Information Landscapes
To develop new approaches for modeling and visualizing
the inequities in the pipeline of civic data creation, process-
ing, and use, this position paper draws on a theory of local
information landscape (LIL theory) [2]. LIL theory is a meta-
theoretical framework that explains the community-level,
material structures of local information (e.g. flyers, web-
sites, block parties) and their relationships to other com-
munity characteristics. Mapping LILs can help cities better
manage information provision processes for civic repair.
Because 311 data is a result of ad-hoc design of civic tech-
nologies, studying 311 systems and their data from an LIL
perspective may make it possible to examine some struc-
tural features of the civic issue landscape. Some particu-
larly important aspects of that information provision include:
The types of civic issues reported (e.g. potholes, bro-
ken sidewalks, abandoned vehicles)
The volume of reporting across issues
Individual reporting frequency (Boston median one
report per year)
Territoriality in reporting (range of report locations for
an individual)
Geographical coverage of individuals in reporting
issues
Information Deserts
By studying the aspects of information provision as vari-
ables, we can uncover the information deserts of civic is-
sues in cities [2]. Information deserts are conceptual and
physical spaces where local information is poorly embed-
ded in diverse infrastructures and/or less available than
other areas of the city: the material pre-conditions of local
information that can give rise to information inequality.
The reasons why people do or do not report issues to the
311 systems can vary significantly, and information about
how and why people report issues to 311 is an important
building block for understanding information deserts in
cities. Only after understanding people’s motivations to re-
port civic issues and their information practices in their daily
lives, does it become possible to understand information
inequality and leverage 311 data in an efficient and equi-
table manner to further refine the civic technology. To thor-
oughly investigate the information deserts in cities requires
(1) partnerships to obtain, interpret, and analyze 311 data,
(2) individual-level data granularity (open data ideally, after
eliminating privacy concerns), (3) a combination of social
scientific and computational methods (to address data qual-
ity and missing variables), and (4) ongoing iterative interac-
tions between city employees, researchers, and publics to
define and visualize insights from this research that can im-
prove municipal decision-making and public service provi-
sion. Our current partnership with the City of Boston makes
the pilot of this approach possible as the individual-level
dataset has been made it available to our research team.
Approach
To determine where and how information deserts are lo-
cated, census and geospatial data complement 311 sys-
tem datasets. By making use of computational models that
describe individuals’ information provision behavior and
mobility, it is possible to identify a typology of Boston’s infor-
mation deserts based on community features that affect or
are affected by information deserts. Then, it will be possible
to assess relationships between information deserts and
major demographic and geospatial features of data biases,
as well as how those biases might proliferate into munici-
pal decision-making. Building on the multi-dimensional LIL
model, the interactions between components of LIL can be
quantified by making use of computational models such as
a flow network model for quantifying the degree of informa-
tion fragmentation, an institutional network for measuring
the embeddedness of information in diverse sources, or
a comparative advantage model for measuring the rela-
tive impact of each information source. From an analytic
perspective, a core part of this approach is that a series of
these studies examines community characteristics, informa-
tion provision behavior of individuals, information deserts
of civic issues, and their outcomes separately as building
blocks of the information inequality embedded in civic tech-
nologies.
Future Work
An early prototype visualization tool for 311 data, produced
through this grant and a partnership with Supernormal, is
available at https://betablocks.city/discover. As the work pro-
gresses, this tool will become the object of iteration in re-
sponse to participatory design sessions with city officials to
link its affordances with the needs of its potential users. Fu-
ture work will include (1) refining and developing computa-
tional models of information provision behavior, (2) access-
ing 311 datasets from other cities through expanding our
partnerships, (3) providing a typology of information deserts
of civic issues through data analytics and interviews and (4)
building data visualizations of information deserts of civic
issues to help reduce bias and inequity in public service
provision. This position paper is a call for civic technology
researchers’ attentions to the material, structural features
of civic data that exists in diverse local infrastructures and
civic technologies.
Acknowledgements
We thank all the municipal employees who participated in
this work. We also gratefully acknowledge the grant from
NSF (#1816763).
REFERENCES
1. Benjamin Y Clark, Jeffrey L Brudney, and Sung-Gheel
Jang. 2013. Coproduction of government services and
the new information technology: Investigating the
distributional biases. Public Administration Review 73,
5 (2013), 687–701.
2. Myeong Lee and Brian S Butler. 2019. How are
information deserts created? A theory of local
information landscapes. Journal of the Association for
Information Science and Technology 70, 2 (2019),
101–116.
3. Jeremy R Levine and Carl Gershenson. 2014. From
political to material inequality: Race, immigration, and
requests for public goods. In Sociological Forum,
Vol. 29. Wiley Online Library, 607–627.
4. Derk Loorbach, Niki Frantzeskaki, and Roebin Lijnis
Huffenreuter. 2015. Transition management: taking
stock from governance experimentation. Journal of
Corporate Citizenship 58 (2015), 48–66.
5. Lorraine Green Mazerolle. 2005. Managing calls to the
police with 911/311 systems. US Department of
Justice, Ofifce of Justice Programs, National Institute of
Justice, Washington, D.C.
6. Daniel Tumminelli O’Brien, Dietmar Offenhuber,
Jessica Baldwin-Philippi, Melissa Sands, and Eric
Gordon. 2017. Uncharted territoriality in coproduction:
The motivations for 311 reporting. Journal of Public
Administration Research and Theory 27, 2 (2017),
320–335.
7. Richard W Schwester, Tony Carrizales, and Marc
Holzer. 2009. An examination of the municipal 311
system. International Journal of Organization Theory
and Behavior 12, 2 (2009), 218.
8. Lingjing Wang, Cheng Qian, Philipp Kats, Constantine
Kontokosta, and Stanislav Sobolevsky. 2017. Structure
of 311 service requests as a signature of urban
location. PloS one 12, 10 (2017), e0186314.
ResearchGate has not been able to resolve any citations for this publication.
Article
Full-text available
While urban systems demonstrate high spatial heterogeneity, many urban planning, economic and political decisions heavily rely on a deep understanding of local neighborhood contexts. We show that the structure of 311 Service Requests enables one possible way of building a unique signature of the local urban context, thus being able to serve as a low-cost decision support tool for urban stakeholders. Considering examples of New York City, Boston and Chicago, we demonstrate how 311 Service Requests recorded and categorized by type in each neighborhood can be utilized to generate a meaningful classification of locations across the city, based on distinctive socioeconomic profiles. Moreover, the 311-based classification of urban neighborhoods can present sufficient information to model various socioeconomic features. Finally, we show that these characteristics are capable of predicting future trends in comparative local real estate prices. We demonstrate 311 Service Requests data can be used to monitor and predict socioeconomic performance of urban neighborhoods, allowing urban stakeholders to quantify the impacts of their interventions.
Article
Full-text available
A central question for programs that involve constituents in the coproduction of government services is: what motivates constituents to participate? This study compares two perspectives on this question: the traditional public-as-citizen model treats participation as a function of a general civic disposition that extends to many forms of civic and political participation (e.g. volunteering and voting); and we introduce the public-as-partner model, which argues that a given program might rely on any of the diverse array of human motivations, depending on the specific nature of participation required. We compare these using 311 systems, which provide a hotline and online tools for requesting nonemergency government services (e.g. graffiti removal), evaluating whether using 311 to contribute to neighborhood maintenance primarily reflects a civic disposition or is additionally motivated by a capacity for territoriality (i.e. identifying with and claiming responsibility for spaces), per the public-as-partner model. The study links three forms of information at the individual level for a sample of 311 users from Boston, Massachusetts (n = 722): objective reporting activity, derived from the 311 archive; a user survey including self-reports of civic activities and territorial motives; and voter registration records. Controlling for demographics and the contextual effects of home neighborhood, higher territorial motives predicted a greater likelihood of a person reporting any issues of public concern and reporting more issues over a broader geographical range in one’s home neighborhood (where >80% of reports are made). Civic activities and voting predicted a greater likelihood of reporting in nonhome neighborhoods (e.g. work). This dichotomy highlights the distinction between the two models in conceptualizing the motivations for participation in coproduction. The article explores how to extend this logic to the assessment of participation, outreach, and disparities in access across programs.
Article
Full-text available
In 2001, transition management was introduced into the science-policy debate around sustainable development and complex societal issues. Transition management (TM) at that time posed a number of generic principles derived from an understanding of complex societal sustainability challenges as persistent problems. These formed the basis for the experimental development of a range of new instruments, strategies and actions to influence the speed and development of sustainability transitions. Since its introduction, the field of transitions at large and the research and practices around the TM concept have evolved considerably, including a fundamental scientific debate, the build-up of an empirical basis and a grounded portfolio of TM instruments. In this paper we will take stock of and reflect on the advances in the field of TM based on our experiences with experimentally applying, refining and developing the basic premises, tenets and possible interventions.
Article
Full-text available
Government accountability and responsiveness are foundational concerns of public managers, citizens, the media, and advocacy organizations. Technologies provide viable alternatives for increasing citizen access to government and improving government's responses to the issues of greatest concern to citizens, and the implementation of non-emergency 311 systems have shown tremendous potential in this regard. This paper, therefore, examines municipal 311 systems in terms of accountability and responsiveness functions, namely usability, services provided, internal operations, and measurable outputs. A survey of fourteen municipalities with 311 systems throughout the United States results in the identification of best practices in each of the four research categories.
Article
To understand information accessibility issues, research has examined human and technical factors by taking a socio‐technical view. While this view provides a profound understanding of how people seek, use, and access information, it often overlooks the larger structure of the information landscapes that shape people's information access. However, theorizing the information landscape of a local community at the community level is challenging because of the diverse contexts and users. One way to minimize the complexity is to focus on the materiality of information. By highlighting the material aspects of information, it becomes possible to understand the community‐level structure of local information. This paper develops a theory of local information landscapes (LIL theory) to conceptualize the material structure of local information. LIL theory adapts a concept of the virtual as an ontological view of the local information that is embedded in technical infrastructures, spaces, and people. By complementing existing theories, this paper provides a new perspective on how information deserts manifest as a material pre‐condition of information inequality. Based on these theoretical models, a research agenda is presented for future studies of local communities.
Article
Studies of political participation typically analyze voting, contentious collective action, or membership in voluntary associations. Few scholars investigate a more mundane—but highly consequential—form of neighborhood politics: requests for basic city services. We conceptualize city service requests as a direct, instrumental contact with local government that alters the geographical distribution of public goods. We hypothesize that rates of service requests vary with the ethnic and immigrant composition of neighborhoods, due to differences in these communities’ expectations of local government. We test this hypothesis using administrative data from the City of Boston. We find neighborhoods with high concentrations of first-generation immigrants less likely to request services, relative to need. The concentration of African Americans, however, is associated with large increases in neighborhood service requests. We conclude with implications for the study of race, inequality, and political incorporation.
Article
This article investigates how communications advances affect citizens’ ability to participate in coproduction of government services. The authors analyze service requests made to the City of Boston during a one-year period from 2010 to 2011 and, using geospatial analysis and negative binomial regression, investigate possible disparities by race, education, and income in making service requests. The findings reveal little concern that 311 systems (nonemergency call centers) may benefit one racial group over another; however, there is some indication that Hispanics may use these systems less as requests move from call centers to the Internet and smartphones. Consistent with prior research, the findings show that poorer neighborhoods are less likely to take advantage of 311 service, with the notable exception of smartphone utilization. The implications for citizen participation in coproduction and bridging the digital divide are discussed.
Managing calls to the police with 911/311 systems
  • Lorraine Green Mazerolle
Lorraine Green Mazerolle. 2005. Managing calls to the police with 911/311 systems. US Department of Justice, Ofifce of Justice Programs, National Institute of Justice, Washington, D.C.