A Common Protocol for Agent-Based Social Simulation

Journal of Artificial Societies and Social Simulation, The (Impact Factor: 1.16). 01/2006; 9.
Source: RePEc

ABSTRACT Traditional (i.e. analytical) modelling practices in the social sciences rely on a very well established, although implicit, methodological protocol, both with respect to the way models are presented and to the kinds of analysis that are performed. Unfortunately, computer-simulated models often lack such a reference to an accepted methodological standard. This is one of the main reasons for the scepticism among mainstream social scientists that results in low acceptance of papers with agent-based methodology in the top journals. We identify some methodological pitfalls that, according to us, are common in papers employing agent-based simulations, and propose appropriate solutions. We discuss each issue with reference to a general characterization of dynamic micro models, which encompasses both analytical and simulation models. In the way, we also clarify some confusing terminology. We then propose a three-stage process that could lead to the establishment of methodological standards in social and economic simulations.

Download full-text


Available from: Roberto Leombruni, Aug 13, 2015
  • Source
    • "Sensitivity analysis is part of a repertoire of verification (Law and Kelton, 1991) and validation techniques (Richiardi et al., 2006; Petty, 2010; Windrum et al., 2007). Sensitivity analysis is particularly useful as a validation technique for agent based models where it is not clear how the computer code will influence system behavior without running the model (Dancik et al., 2010; Bianchi et al., 2007). "
    [Show abstract] [Hide abstract]
    ABSTRACT: This paper shows how sensitivity analysis can be used as part of model verification and validation Sensitivity analysis provides insights on where future data validation processes should focus and which inputs may be considered for model reduction. We compared two approaches, one using a systematic variation of parameter values, another using an optimised algorithm to make more efficient the search of their space. Analysis was conducted on an agent-based model that explores the emergence of innovation within business networks, where successful innovation is considered an increase in knowledge and financial resources within the network. The two sensitivity analysis approaches differed both on their time efficiency and on the type of information provided. While the systematic individual sensitivity analysis assisted us in identifying inputs with substantial impact upon the results and suggest solutions for model simplification, the optimised search provided insights on the network resources likely to achieve higher levels of innovation. Genetic algorithms found parameter values that produced different results in the agent-based model.
    Australasian Marketing Journal (AMJ) 02/2014; DOI:10.1016/j.ausmj.2013.12.010
  • Source
    • "According to Grimm et al. (2010), about 70% of articles citing Grimm et al. (2006) are in the ecological modeling area. Similar proposals for documentation standards to agent-based social simulations are done by Triebig and Klégl (2009), Janssen et al. (2008) and Richiardi et al. (2006). MASE is going to be presented using the ODD sequence. "
    [Show abstract] [Hide abstract]
    ABSTRACT: This paper presents a multi-agent model system to characterize land-use change dynamics. The replicable parameterization process should be useful to the development of simulation frameworks, important to environmental policy makers to analyze different scenarios during decision making process. The methodological two-fold approach intends to form a solid backbone based on: (i) the systematic and structured empirical characterization of the model; and (ii) the conceptual structure definition according to the agent-based model documentation protocol – Overview, Design concepts and Details. A multi-agent system for land-use change simulation was developed to validate the model, which is illustrated with a case study of the Brazilian Cerrado using LANDSAT ETM images. The simulation results prove the model importance with a figure of merit greater than 50%, what means the amount of correctly predicted change is larger than the sum of any type of error. The results are very good compared with nine popular peer-reviewed land change models.
    Environmental Modelling and Software 04/2013; 42:30-46. DOI:10.1016/j.envsoft.2012.12.003 · 4.54 Impact Factor
  • Source
    • "Resnick (1996) provides a clear example of a student using a NetLogo simulation to explore emergent behaviour.B arreteau (2003) discuss the value of including the stakeholders in the model'suse in the validation of the model. Leombruni et al. (2006) list fivet ypes of validity that theory-and data-based economic simulation studies must consider: theory (the validity of the theory relative tot he simuland), model (the validity of the model relative tot he theory), program (the validity of the simulating program relative tot he model), operational (the validity of the theoretical concept to its indicator or measurement), and empirical (the validity of the empirically occurring true value relative toi ts indicator). Throughout the paper,w ef ocus on their empirical validity (Manson's( 2002) " output validation " ): hows uccessfully the simulation model'so utput exhibits the historical behaviours of the real-world target system, rather than their program validity (Manson's " structural validation " ): how well the simulation model represents the (prior) conceptual model of the real-world system. "
    [Show abstract] [Hide abstract]
    ABSTRACT: T his paper provides a framework for discussing the validity of computer simulation models of market phenomena. It defines functional complexity and derivesmeasures of this for a well known agent-based simulation model and suggests methods to overcome the obstacle of complexity in validating such models.. Acknowledgments: Ithank Yaneer Bar-Yam, Ian Wilkinson, and three referees for their assistance.
    SSRN Electronic Journal 01/2013; DOI:10.2139/ssrn.2342868
Show more