Conference PaperPDF Available


IT-mediated crowds are being implemented for multifarious purposes, using multifarious techniques. In this minitrack we seek to coalesce a specific and enduring community of IS and IS-related researchers focused on the study of IT-mediated crowds as a phenomenon. Our aim is to harness, and thus focus, the currently very broad inter-disciplinary study of IT-mediated crowds within the IS discipline proper, to incite a sharing of results and a cross-pollination of ideas among researchers currently looking at IT-mediated crowds from IS, I-School, HCI, Computer Science, Marketing, Education, Natural Sciences, Communication, and Technology Innovation perspectives.
Crowd Science 2018: HICSS Mini-Track
IT-mediated Crowds are being implemented for multifarious purposes, using multifarious
techniques. In this minitrack we seek to coalesce a specific and enduring community of IS and
IS-related researchers focused on the study of IT-mediated crowds as a phenomenon.
Our aim is to harness, and thus focus, the currently very broad inter-disciplinary study of IT-
mediated Crowds within the IS discipline proper, to incite a sharing of results and a cross-
pollination of ideas among researchers currently looking at IT-mediated Crowds from IS, I-
School, HCI, Computer Science, Marketing, Education, Natural Sciences, Communication, and
Technology Innovation perspectives.
In the purview of this mini-track, IT-mediated crowd phenomena include:
Crowd Finance (Crowdfunding, Blockchains, Digital Ledgers, etc)
Prediction Markets
Citizen Science
Open Innovation/Competition platforms
Social Media for resource creation
Wikis & Wikipedia
Big Data from crowds
Participatory Sensing (Crowdsensing)
Spatial Crowdsourcing (the Sharing & Gig Economy)
Situated/Geo-fenced/IoT Crowdsourcing/VR crowds
Wearables Crowdsourcing
IT-mediated Collective Intelligence
We encourage new empirical and theoretical submissions from social, economic, technical, and
organizational scholars, investigating these phenomena in a variety of contexts, including:
Health Care
Governance/Policy/Smart Cities/GIS
Entrepreneurship/User Innovation/Creative Consumers
Institutional & Strategic perspectives
International Business & Development perspectives
Particular questions/topics of interest include:
Human computation, micro-tasking and virtual labour markets
Crowdsourced contests, their design and efficacy
Gamification in IT-mediated crowds
IT-mediated crowds and law/intellectual property
IT-mediated crowds for invention and commercialization
Business models of IT-mediated crowd companies and startups
The economics of IT-mediated crowds
The knowledge dynamics of IT-mediated crowds
IT-mediated crowds and 3D printing
Wearables & Sensors in, and as crowds
IT-mediated crowds and machine learning
The role of Bots/AI in IT-mediated crowds
Measuring IT-mediated crowds and outcomes
Formal models/computational models/simulations
IT-mediated crowd platforms
IT-mediated crowds & Common pool resources
Varieties of Crowd Capital
IT-mediated crowds and Industry/competitive dynamics
Crowd-member/IT/Organization dynamics
Crowd-labor movements and labor dynamics
Expert, non-expert, and mixed Crowds
Knowledge management in, and through, IT-mediated crowds
Double-sided markets/electronic markets/platforms
As track co-chairs, we endeavour to coalesce a set of compelling talks, provide developmental
paper reviews, and special issues stemming from the track, focused on one or more of the
areas mentioned here.
In the last two years, we’re delighted that we’ve been able to welcome eight substantial
contributions to the Crowd Science program, which as a whole cross disciplinary boundaries,
employ a variety of methodologies, and mark important new avenues in the field. These
contributions, as well as a bibliography of what we consider to be fundamental Crowd Science
research, are listed below.
Papers are due June 15 2017. We look forward to your submission!
Mini-track Co-Chairs:
John Prpić
Lulea University of Technology
Jan Kietzmann
Afuah, A., & Tucci, C.L. (2012). Crowdsourcing as a solution to distant search. Academy of Management
Review. 37(3), 355-375.
Aitamurto, T. (2016). Collective Intelligence in Law Reforms: When the Logic of the Crowds and the
Logics of Policymaking Collide. In Proceedings of the Hawaii International Conference on System
Sciences, vol. 49, pp. 5-8. 2016.
Archak, N., & Sundararajan, A. (2009). Optimal Design of Crowdsourcing Contests. In ICIS 2009
Arrow, K.J, R. Forsythe, M. Gorham, R. Hahn, R. Hanson, J.O. Ledyard, S. Levmore, R. Litan, P. Milgrom,
F.D. Nelson, G.R. Neumann, M. Ottaviani, T.C. Schelling, R.J. Shiller, V.L. Smith, E. Snowberg, C.R.
Sunstein, P.C. Tetlock, P.E. Tetlock, H.R. Varian, J. Wolfers, & E. Zitzewitz. (2008). The promise of
prediction markets. Science. 320(5878), 877-878.
Bayus, B.L. (2012). Crowdsourcing New Product Ideas over Time: An Analysis of the Dell IdeaStorm
Community. Management Science. 59(1), 226-244.
Belleflamme, P., Lambert, T., & Schwienbacher, A. (2013). Crowdfunding: Tapping the right crowd.
Journal of Business Venturing. 29(5), 585-609.
Bernstein, M.S., Brandt, J., Miller, R.C., & Karger, D.R. (2011). Crowds in two seconds: Enabling realtime
crowd-powered interfaces. In Proceedings of the 24th annual ACM symposium on User interface
software and technology (pp. 33-42). ACM.
Bernstein, M.S. (2013). Crowd-powered systems. Electrical Engineering and Computer Science.
Cambridge, Massachusetts. Massachusetts Institute of Technology Ph.D. Dissertation.
Blohm, I., Bretschneider, U., Leimeister, J.M., & Krcmar, H. (2011). Does collaboration among
participants lead to better ideas in IT-based idea competitions? An empirical investigation. International
Journal of Networking and Virtual Organisations. 9(2), 106-122.
Bott, M., Gigler, B.-S., & Young, G. (2014). The Role of Crowdsourcing for Better Governance in Fragile
State Contexts. International Bank for Reconstruction and Development/The World Bank.
Brabham, D.C. (2008). Crowdsourcing as a model for problem solving. Convergence. 14(1), 75-90.
Brabham, D.C. (2012). The Effectiveness of Crowdsourcing Public Participation in a Planning Context.
First Monday. 17(12).
Brabham, D.C. (2013). Crowdsourcing. Cambridge, Massachusetts; London, England: The MIT Press.
Brabham, D.C. (2013). Using Crowdsourcing in Government. IBM Center for the Business of
Burtch, G., Ghose, A., & Wattal, S. (2013). An empirical examination of the antecedents and
consequences of contribution patterns in crowd-funded markets. Information Systems Research. 24(3),
Chesbrough, H.W, (2003). Open Innovation: The new imperative for creating and profiting from
technology. Boston: Harvard Business School Press.
Chua, R.Y.J., Roth, Y., & Lemoine, J.F. (2015). The Impact of Culture on Creativity How Cultural Tightness
and Cultural Distance Affect Global Innovation Crowdsourcing Work. Administrative Science Quarterly.
60(2), 189-227
Crowston, K., & Prestopnik, N. (2013). Motivation and Data Quality in a Citizen Science Game: A Design
Science Evaluation. In Proceedings of the 46th Annual Hawaii International Conference on System
Sciences. IEEE Computer Society.
Cullina, E., Conboy, K. & Morgan, L. (2016). Choosing the Right Crowd: An Iterative Process for Crowd
Specification in Crowdsourcing Initiatives. In System Sciences (HICSS), 2016 49th Hawaii International
Conference on (pp. 4355-4364). IEEE.
De Vreede, T., Nguyen, C., De Vreede, G. J., Boughzala, I., Oh, O., & Reiter-Palmon, R. (2013). A
Theoretical Model of User Engagement in Crowdsourcing. In Collaboration and Technology Lecture
Notes in Computer Science Volume 8224 (pp. 94-109). Springer Berlin Heidelberg.
Difallah, D.E., Catasta, M., Demartini, G., Ipeirotis, P.G., & Cudré-Mauroux, P. (2015). The dynamics of
micro-task crowdsourcing: The case of amazon mturk. In Proceedings of the 24th International
Conference on World Wide Web (pp. 238-247). ACM.
Dron, J., & Anderson, T. (2014). Teaching Crowds: Learning and Social Media. Edmonton, AB:AU Press,
Athabasca University.
Easley, D., & Kleinberg, J. (2010). Networks, crowds, and markets: Reasoning about a highly connected
world. Cambridge University Press.
Gellers, J.C. (2016). Crowdsourcing global governance: sustainable development goals, civil society, and
the pursuit of democratic legitimacy. International Environmental Agreements: Politics, Law and
Economics. 16(3), 415-432.
Gerber, E. M., & Hui, J. (2013). Crowdfunding: Motivations and deterrents for participation. ACM
Transactions on Computer-Human Interaction (TOCHI). 20(6), 34.
Gray, M.L., Suri, S., Ali, S.S., & Kulkarni, D. (2016). The crowd is a collaborative network. In Proceedings
of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (pp. 134-
147). ACM.
Greenberg, J. & Mollick, E. (2016). Activist Choice Homophily and the Crowdfunding of Female
Founders. Administrative Science Quarterly.
Hacker, S.B.H. (2014). Duolingo: Learning a Language while Translating the Web. Doctoral Dissertation.
Carnegie Mellon University.
Hall, M., Mazarakis, A., Peters, I., Chorley, M., Caton, S., Mai, J.-E., & Strohmaier, M. (2016). Following
User Pathways: Cross Platform and Mixed Methods Analysis. In CHI’16 Extended Abstracts. San Jose,
USA: ACM Press.
Hayek, F.A. (1945). The Use of Knowledge in Society. The American Economic Review. 35(4), 519530.
Haythornthwaite, C. (2009). Crowds and communities: Light and heavyweight models of peer
production. In System Sciences, 2009. HICSS'09. 42nd Hawaii International Conference on (pp. 1-10).
Hong, L., & Page, S.E. (2001). Problem solving by heterogeneous agents. Journal of economic theory.
97(1), 123-163.
Hong, L., & Page, S.E. (2004). Groups of diverse problem solvers can outperform groups of high-ability
problem solvers. Proceedings of the National Academy of Sciences of the United States of America.
101(46), 16385-16389.
Ipeirotis, P.G., & Paritosh, P.K. (2011). Managing crowdsourced human computation: a tutorial. In
Proceedings of the 20th international conference companion on World Wide Web. (pp. 287288). ACM.
Jeppesen, L.B., & Lakhani, K.R. (2010). Marginality and Problem-Solving Effectiveness in Broadcast
Search. Organization Science. 21(5), 1016-1033.
Kamar, E., S. Hacker, & E. Horvitz, (2012). Combining human and machine intelligence in large-scale
crowdsourcing. In Proceedings of the 11th International Conference on Autonomous Agents and
Multiagent Systems. Volume 1 (pp. 467-474).
Kietzmann, J.H., K. Hermkens, I.P. McCarthy, & B.S. Silvestre, (2011). Social media? Get serious!
Understanding the functional building blocks of social media. Business Horizons. 54(3), 241-251.
Kietzmann, J.H., Silvestre, B.S., McCarthy, I.P., & Pitt, L.F. (2012). Unpacking the social media
phenomenon: towards a research agenda. Journal of Public Affairs. 12(2), 109-119.
Kietzmann, J., & Canhoto, A. (2013). Bittersweet! Understanding and managing electronic word of
mouth. Journal of Public Affairs. 13(2), 146-159.
Kietzmann, J. & Prpić, J. (2016). Introduction to the Organizational Use of IT-Mediated Crowds Minitrack.
49th Hawaii International Conference on System Sciences (HICSS), Koloa, HI, USA, 2016, pp. 4354-4354.
Kietzmann, J., (2017). Crowdsourcing: A revised definition and introduction to new research, Business
Horizons. Forthcoming.
King, A., & Lakhani, K.R. (2013). Using Open Innovation to Identify the Best Ideas. MIT Sloan
Management Review. 55(1), 41-48.
Kingsley, S.C., Gray, M.L., & Suri, S. (2015). Accounting for market frictions and power asymmetries in
online labor markets. Policy & Internet, 7(4), 383-400.
Krause, M., Hall, M., Williams, J.J., Paritosh, P., Prpić, J., & Caton, S. (2016). Connecting Online Work and
Online Education at Scale. In CHI, Extended Abstracts on Human Factors in Computing Systems. pp.
3536 3541. ACM.
Lakhani, K., & Panetta, J.A. (2007). The Principles of Distributed Innovation. Innovations: Technology,
Governance, Globalization. 2(3), 97-112.
Landemore, H. (2014). Inclusive Constitution-Making: The Icelandic Experiment. Journal of Political
Lease, M., J. Hullman, J.P. Bigham, M. Bernstein, J. Kim, W. Lasecki, S. Bakhshi, T. Mitra, & R. C. Miller.
(2013). Mechanical turk is not anonymous. Social Science Research Network.
Lee, J., & Seo, D. (2016). Crowdsourcing not all sourced by the crowd: An observation on the behavior of
Wikipedia participants. Technovation. 55, 14-21.
Lee, D., (2013). Scientific Analysis by the Crowd: A System for Implicit Collaboration between Experts,
Algorithms, and Novices in Distributed Work. Doctoral Thesis.
Lehdonvirta, V., & Bright, J. (2015). Crowdsourcing for Public Policy and Government. Policy & Internet,
7(3), 263-267.
Levy, P. (1997). Collective Intelligence: Mankind's Emerging World in Cyberspace. Perseus Books:
Cambridge, MA, USA.
Li, S.W.D., & P. Mitros. (2015). Learnersourced recommendations for remediation. 2015 IEEE 15th
International Conference on Advanced Learning Technologies (ICALT). pp. 411-412.
Lukyanenko., R., Jeffrey Parsons & Yolanda F. Wiersma (2014). The IQ of the Crowd: Understanding and
Improving Information Quality in Structured User-Generated Content. Information Systems Research.
25:4, 669-689.
Majchrzak, A. (2006). Enabling customer-centricity using wikis and the wiki way. Journal of Management
Information Systems. 23(3), 17-43.
Majchrzak, A., Wagner, C., & Yates, D. (2006). Corporate wiki users: results of a survey. In Proceedings of
the 2006 international symposium on Wikis. ACM, 2006.
Majchrzak, A., & Malhotra, A. (2013). Towards an information systems perspective and research agenda
on crowdsourcing for innovation. The Journal of Strategic Information Systems. 22(4), 257-268.
Malone, T. W., Laubacher, R., & Dellarocas, C. (2010). The collective intelligence genome. MIT Sloan
Management Review, 51(3), 21.
Mamonov, S., Malaga, R., & Rosenblum, J. (2017). An Exploratory Analysis of Title II Crowdfunding
Success. In Proceedings of the 50th Hawaii International Conference on System Sciences
Mergel, I. (2012). Distributed Democracy: for Crowdsourced Issue Reporting. Social
Science Research Network.
Mergel, I., & K.C. Desouza. (2013). Implementing Open Innovation in the Public Sector: The Case of
Challenge. gov. Public Administration Review. 73(6), 882-90.
Mergel, I., S.I. Bretschneider, C. Louis, & J. Smith. (2014). The Challenges of Challenge.Gov: Adopting
Private Sector Business Innovations in the Federal Government. In Proceedings of the 47th Hawaii
International Conference on System Sciences. IEEE.
Michelucci, P. (2013). Synthesis and Taxonomy of Human Computation. In Handbook of Human
Computation (pp. 8386). Springer.
Michelucci, P., & Dickinson, J. L. (2016). The power of crowds. Science. 351(6268), 32-33.
Mitros, P. (2015). Learnersourcing of complex assessments. L@S ’15: Proceedings of the Second (2015)
ACM Conference on Learning @ Scale. pp. 317-320.
Mitros, P., & F. Sun. (2014). Creating educational resources at scale. ICALT ’14: Proceedings of the 2014
IEEE 14th International Conference on Advanced Learning Technologies. pp. 16-18.
Mollick, E. (2014). The dynamics of crowdfunding: An exploratory study. Journal of business
venturing. 29(1), 1-16.
Mollick, E., & Nanda, R. (2015). Wisdom or madness? Comparing crowds with expert evaluation in
funding the arts. Management Science. 62(6), 1533-1553.
Mollick, E. & Robb, A. (2016). Democratizing Innovation and Capital Access. California management
review. 58(2), 72-87.
Morschheuser, B., Hamari, J., & Koivisto, J. (2016). Gamification in crowdsourcing: a review. In 2016 49th
Hawaii International Conference on System Sciences. IEEE.
Mortensen, J.M., M.A. Musen, & N.F. Noy. (2013). Crowdsourcing the verification of relationships in
biomedical ontologies. AMIA Annual Symposium. pp. 1,020-1,029.
Morgan, J., & Wang, R. (2010). Tournaments for Ideas. California Management Review. 52(2), 77-97.
Mrass, V., Peters, C., & Leimeister, J.M. (2017). One for All? Managing External and Internal Crowds
through a Single Platform-A Case Study. In Proceedings of the 50th Hawaii International Conference on
System Sciences.
Nickerson, J.V. (2013). Crowd work and collective learning. In: A. Littlejohn and A. Margaryan
(eds). Technology-enhanced professional learning: Processes, practices, and tools. New York: Routledge,
pp. 39-49.
Noveck, B.S. (2009). Wiki-Government. How Technology Can Make Government Better, Democracy
Stronger, and Citizens More Powerful. Washington, DC: Brookings Institution.
Piezunka, H., & Dahlander, L. (2015). Distant Search, Narrow Attention: How Crowding Alters
Organizations’ Filtering of Suggestions in Crowdsourcing. Academy of Management Journal. 58(3), 856-
Piller, F.T., & Walcher, D. (2006). Toolkits for idea competitions: a novel method to integrate users in
new product development. R&D Management. 36(3), 307-318.
Piscopo, A., Phethean, C., & Simperl, E. (2017). Wikidatians are Born: Paths to Full Participation in a
Collaborative Structured Knowledge Base. In Proceedings of the 50th Hawaii International Conference
on System Sciences
Prpić, J., (2015). Health Care Crowds: Collective Intelligence in Public Health. Collective Intelligence
2015. Center for the Study of Complex Systems, University of Michigan
Prpić, J. (2016). Next Generation Crowdsourcing for Collective Intelligence. Collective Intelligence
Conference, 2016. Stern School of Business, NYU.
Prpić, J., & Shukla, P. (2013). The Theory of Crowd Capital. In Proceedings of the 46th Hawaii
International Conference on Systems Sciences (pp. 35053514). Maui, Hawaii: IEEE Computer Society.
Prpić, J., & Shukla, P. (2014). The Contours of Crowd Capability. In Proceedings of the 47th Annual
Hawaii International Conference on System Sciences (pp. 34613470). Big Island Hawaii: IEEE Computer
Prpić, J., & Shukla, P. (2014). Crowd Capital in Governance Contexts. Oxford Internet Institute, University
of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy.
Prpić, J., & Shukla, P. (2016). Crowd Science: Models, Measurements, and Methods. Proceedings of the
49th Annual Hawaii International Conference on System Sciences, Big Island Hawaii, January 6-9,
Computer Society Press, 2016.
Prpić, J., Jackson, P., & Nguyen, T. (2014). A Computational Model of Crowds for Collective Intelligence.
Collective Intelligence 2014. MIT Center for Collective Intelligence.
Prpić, J., Taeihagh, A., & Melton, J. (2014). Crowdsourcing the Policy Cycle. Collective Intelligence 2014,
MIT Center for Collective Intelligence.
Prpić, J., Taeihagh, A., & Melton, J. (2014). Experiments on Crowdsourcing Policy Assessment. Oxford
Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy.
Prpić, J., Taeihagh, A., & Melton, J. (2015). The Fundamentals of Policy Crowdsourcing. Policy & Internet.
Prpić, J., Melton, J., Taeihagh, A., & Anderson, T. (2015). MOOCs and Crowdsourcing: Massive Courses
and Massive Resources with Crowds. First Monday.20(12).
Prpić, J., Shukla, P., Roth, Y., & Lemoine, J.-F. (2014). Is the World Flat? Unpacking the Geography of
Crowd Capital. 12th Annual Open and User Innovation Conference, Harvard Business School. Boston.
Prpić, J., Shukla, P., Roth, Y., & Lemoine, J.F. (2015). A Geography of Participation in IT-Mediated
Crowds. Proceedings of the 48th Annual Hawaii International Conference on System Sciences, Kauai,
Hawaii, January 5-8, Computer Society Press, 2015.
Prpić, J., Shukla, P., Kietzmann, J., & McCarthy, I. (2015). How to Work a Crowd: Developing Crowd
Capital through Crowdsourcing. Business Horizons. 8(1), 77-85.
Prpić, J., & Kietzmann, J., 2017. Crowd Science: Research on IT-Mediated Crowds-Mini-Track Overview.
50th Hawaii International Conference on System Sciences (HICSS), Big Island, HI, USA, 2017.
Retelny, Daniela, Sébastien Robaszkiewicz, Alexandra To, Walter S. Lasecki, Jay Patel, Negar Rahmati,
Tulsee Doshi, Melissa Valentine, and Michael S. Bernstein. "Expert crowdsourcing with flash teams."
In Proceedings of the 27th annual ACM symposium on User interface software and technology, pp. 75-
85. ACM, 2014.
Robson, K., Plangger, K., Kietzmann, J. H., McCarthy, I., & Pitt, L. (2015). Is it all a game? Understanding
the principles of gamification. Business Horizons. 58(4), 411-420.
Robson, K., Plangger, K., Kietzmann, J. H., McCarthy, I., & Pitt, L. (2016). Game on: Engaging customers
and employees through gamification. Business Horizons. 59(1), 29-36.
Rothschild, D. & Sethi, R. (2016). Trading strategies and market microstructure: Evidence from a
prediction market. Journal of Prediction Markets. 10(1), 29.
Simons, A., Weinmann, M., Tietz, M., & vom Brocke, J. (2017). Which Reward Should I Choose?
Preliminary Evidence for the Middle-Option Bias in Reward-Based Crowdfunding. In Proceedings of the
50th Hawaii International Conference on System Sciences.
Von Ahn, L., Maurer, B., McMillen, C., Abraham, D., & Blum, M. (2008). reCAPTCHA: Human-based
character recognition via web security measures. Science. 321(5895), 1465-1468.
Von Hippel, E. (2005a). Democratizing Innovation. Cambridge, M.A.: The MIT Press.
Von Hippel, E. (2005b). Open source software projects as user innovation networks - no manufacturer
required, In Perspectives on Free and Open Source Software, edited by J. Feller, B. Fitzgerald, S. Hissam,
and K. Lakhani. Cambridge: MIT Press.
Wexler, M.N. (2011). Reconfiguring the sociology of the crowd: exploring crowdsourcing. International
Journal of Sociology and Social Policy. 31(1/2), 6-20.
Wiggins, A., & K. Crowston. (2015). Surveying the citizen science landscape. First Monday. 20(1).
Wilkinson, D.M., & Huberman, B.A. (2007). Cooperation and quality in wikipedia. In Proceedings of the
2007 international symposium on Wikis. (pp. 157-164). ACM.
Wolfson, S.M., & Lease, M. (2011). Look before you leap: legal pitfalls of crowdsourcing. Proceedings of
the American Society for Information Science and Technology. 48(1), 1-10.
Yang, H.L., & Cheng, Y.L. (2010). Motivations of Wikipedia content contributors. Computers in Human
Behavior. 26(6), 1377-1383.
Ye, H. J., & Kankanhalli, A. (2015). Investigating the antecedents of organizational task crowdsourcing.
Information & Management. 52(1), 98-110.
Yoo, Y., R.J., Boland, Jr., K., Lyytinen, & A., Majchrzak. (2012). Organizing for innovation in the digitized
world. Organization Science. 23(5), 1398-1408.
ResearchGate has not been able to resolve any citations for this publication.
Full-text available
This paper offers a primer on crowdsourcing as an informational resource for development, crisis response, and postconflict recovery, with a specific focus on governance in fragile states. Inherent in the theoretical approach is that broader, unencumbered participation in governance is an objectively positive and democratic aim and that government transparency and citizen empowerment can increase a government’s accountability to its citizens and correct poor performance, although not without challenges. Whether for tracking flows of aid, reporting on poor government performance, or organizing grassroots movements, crowdsourcing has potential to change the reality of civic participation in many developing countries.The paper is structured in the following way. In the next sections we provide an overview of the theoretical contributions of crowdsourcing to improve democratic governance. We then examine the critical factors necessary for successful crowdsourcing in general (Sharma 2010) and discuss the inherent challenges and risks, particularly in fragile states. We then provide numerous examples from important crowdsourcing and interactive mapping phenomena and initiatives in Haiti, Libya, Sudan, and Guinea among others. Most of these examples were taken from personal experience, and their accuracy was checked with key actors. We return to analyzing these cases according to Sharma’s framework. Finally, we provide recommendations for donors.
Full-text available
For what purposes are crowds being implemented in health care? Which crowdsourcing methods are being used? This work begins to answer these questions by reporting the early results of a systematic literature review of 110 pieces of relevant research. The results of this exploratory research in progress reveals that collective intelligence outcomes are being generated in three broad categories of public health care; health promotion, health research, and health maintenance, using all three known forms of crowdsourcing. Stemming from this fundamental analysis, some potential implications of the research are discussed and useful future research is outlined.
Full-text available
Crowdsourcing is beginning to be used for policymaking. The wisdom of crowds [Surowiecki 2005], and crowdsourcing [Brabham 2008], are seen as new avenues that can shape all kinds of policy, from transportation policy [Nash 2009] to urban planning [Seltzer and Mahmoudi 2013], to climate policy. In general, many have high expectations for positive outcomes with crowdsourcing, and based on both anecdotal and empirical evidence, some of these expectations seem justified [Majchrzak and Malhotra 2013]. Yet, to our knowledge, research has yet to emerge that unpacks the different forms of crowdsourcing in light of each stage of the well-established policy cycle. This work addresses this research gap, and in doing so brings increased nuance to the application of crowdsourcing techniques for policymaking.
Full-text available
The increasing practice of engaging crowds, where organizations use IT to connect with dispersed individuals for explicit resource creation purposes, has precipitated the need to measure the precise processes and benefits of these activities over myriad different implementations. In this work, we seek to address these salient and non-trivial considerations by laying a foundation of theory, measures, and research methods that allow us to test crowd-engagement efficacy across organizations, industries, technologies, and geographies. To do so, we anchor ourselves in the Theory of Crowd Capital, a generalizable framework for studying IT-mediated crowd-engagement phenomena, and put forth an empirical apparatus of testable measures and generalizable methods to begin to unify the field of crowd science.
Full-text available
In this work we seek to understand how differences in location affect participation outcomes in IT-mediated crowds. To do so, we operationalize Crowd Capital Theory with data from a popular international creative crowdsourcing site, to determine whether regional differences exist in crowdsourcing participation outcomes. We present the early results of our investigation from data encompassing 1,858,202 observations from 28,214 crowd members on 94 different projects in 2012. Using probit regressions to isolate geographic effects by continental region, we find significant variation across regions in crowdsourcing participation. In doing so, we contribute to the literature by illustrating that geography matters in respect to crowd participation. Further, our work illustrates an initial validation of Crowd Capital Theory as a useful theoretical model to guide empirical inquiry in the fast-growing domain of IT-mediated crowds.
Full-text available
In this work we use the theory of Crowd Capital as a lens to compare and contrast a number of IS tools currently in use by organizations for crowd-engagement purposes. In doing so, we contribute to both the practitioner and research domains. For the practitioner community we provide decision-makers with a convenient and useful resource, in table-form, outlining in detail some of the differing potentialities of crowd-engaging IS. For the research community we begin to unpack some of the key properties of crowd-engaging IS, including some of the differing qualities of the crowds that these IS application engage.
Full-text available
Can Crowds serve as useful allies in policy design? How do non-expert Crowds perform relative to experts in the assessment of policy measures? Does the geographic location of non-expert Crowds, with relevance to the policy context, alter the performance of non-experts Crowds in the assessment of policy measures? In this work, we investigate these questions by undertaking experiments designed to replicate expert policy assessments with non-expert Crowds recruited from Virtual Labor Markets. We use a set of ninety-six climate change adaptation policy measures previously evaluated by experts in the Netherlands as our control condition to conduct experiments using two discrete sets of non-expert Crowds recruited from Virtual Labor Markets. We vary the composition of our non-expert Crowds along two conditions: participants recruited from a geographical location directly relevant to the policy context and participants recruited at-large. We discuss our research methods in detail and provide the findings of our experiments.
Full-text available
To begin to understand the implications of the implementation of IT-mediated Crowds for Politics and Policy purposes, this research builds the first-known dataset of IT-mediated Crowd applications currently in use in the governance context. Using Crowd Capital theory and governance theory as frameworks to organize our data collection, we undertake an exploratory data analysis of some fundamental factors defining this emerging field. Specific factors outlined and discussed include the type of actors implementing IT-mediated Crowds in the governance context, the global geographic distribution of the applications, and the nature of the Crowd-derived resources being generated for governance purposes. The findings from our dataset of 209 on-going endeavours indicates that a wide-diversity of actors are engaging IT-mediated Crowds in the governance context, both jointly and severally, that these endeavours can be found to exist on all continents, and that said actors are generating Crowd-derived resources in at least ten distinct governance sectors. We discuss the ramifications of these and our other findings in comparison to the research literature on the private-sector use of IT-mediated Crowds, while highlighting some unique future research opportunities stemming from our work.
Conference Paper
Full-text available
Whereas crowdsourcing as a topic has often been addressed in recent literature, web-based crowdwork-ing platforms that manage the interface between crowdsourcers and crowdworkers have not received much attention so far. Furthermore, most of these platforms focus on either the management of external or internal crowds; platforms that handle both groups are rare. This paper investigates such a provider: the Ger-man company Across Systems. It uses a hybrid model, offering an individual " mini crowdworking platform " that enables the simultaneous government of external and internal crowds as well as a more traditional marketplace crowdworking platform (crossMarket) where supply and demand meet. Using a single-case study approach , the main contribution of this paper is to shed light on a model that has the potential to change the current crowdworking platform market. We show that managing both external and internal crowds on one platform can increase the acceptance, quality and speed of task completion.