Mehul Bhatt

Mehul Bhatt
Örebro University | oru

PhD

About

134
Publications
34,078
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
1,719
Citations

Publications

Publications (134)
Article
Full-text available
The modelling, analysis, and visualisation of dynamic geospatial phenomena has been identified as a key developmental challenge for next-generation Geographic Information Systems (GIS). In this context, the envisaged paradigmatic extensions to contemporary foundational GIS technology raises fundamental questions concerning the ontological, formal r...
Conference Paper
Full-text available
We present a cognitive design assistance system equipped with analytical capabilities aimed at anticipating architectural building design performance with respect to peoplecentred functional design goals. The paper focuses on the system capability to generate narratives of visuo-locomotive user experience from digital computer-aided architecture de...
Conference Paper
Full-text available
We present a computational framework for the grounding and semantic interpretation of dynamic visuo-spatial imagery consisting of video and eye-tracking data. Driven by cognitive film studies and visual perception research, we demonstrate key technological capabilities aimed at investigating attention & recipient effects vis-a-vis the motion pictur...
Conference Paper
Full-text available
We demonstrate the need and potential of systematically integrated vision and semantics solutions for visual sensemaking (in the backdrop of autonomous driving). A general method for online visual sensemaking using answer set programming is systematically formalised and fully implemented. The method integrates state of the art in (deep learning bas...
Conference Paper
Full-text available
We position recent and emerging research in cognitive vision and perception addressing three key questions: (1) What kind of relational abstraction mechanisms are needed to perform (explainable) grounded inference --e.g., question-answering, qualitative generalisation, hypothetical reasoning-- relevant to embodied multimodal interaction? (2) How ca...
Article
We demonstrate the need and potential of systematically integrated vision and semantics solutions for visual sensemaking in the backdrop of autonomous driving. A general neurosymbolic method for online visual sensemaking using answer set programming (ASP) is systematically formalised and fully implemented. The method integrates state of the art in...
Conference Paper
Full-text available
We study active human visuo-locomotive experience in everyday navigation from the viewpoints of environmental familiarity, embodied reorientation, and (sensorimotor) spatial update. Following a naturalistic, in situ, embodied multimodal behaviour analysis method, we conclude that familiar users rely on environmental cues as a navigation-aid and exh...
Chapter
Full-text available
A people-centred approach for designing large-scale built-up spaces necessitates systematic anticipation of user’s embodied visuo-locomotive experience from the viewpoint of human-environment interaction factors pertaining to aspects such as navigation, wayfinding, usability. In this context, we develop a behaviour-based visuo-locomotive complexity...
Article
Full-text available
We demonstrate the need and potential of systematically integrated vision and semantics solutions for visual sensemaking in the backdrop of autonomous driving. A general neurosymbolic method for online visual sensemaking using answer set programming (ASP) is systematically formalised and fully implemented. The method integrates state of the art in...
Preprint
We demonstrate the need and potential of systematically integrated vision and semantics solutions for visual sensemaking in the backdrop of autonomous driving. A general neurosymbolic method for online visual sensemaking using answer set programming (ASP) is systematically formalised and fully implemented. The method integrates state of the art in...
Preprint
Full-text available
A people-centred approach for designing large-scale built-up spaces necessitates systematic anticipation of user's embodied visuo-locomotive experience from the viewpoint of human-environment interaction factors pertaining to aspects such as navigation, wayfinding, usability. In this context, we develop a behaviour-based visuo-locomotive complexity...
Conference Paper
Full-text available
We propose an evidence based methodology for the systematic analysis and cognitive characterisation of multimodal interactions in naturalistic roadside situations such as driving, crossing a street etc. Founded on basic human modalities of embodied (inter)action, the proposed methodology utilises three key characteristics crucial to roadside intera...
Conference Paper
Full-text available
We develop a human-centred cognitive model of visuospatial complexity in everyday , naturalistic driving conditions. With a focus on visual perception, the model incorporates quantitative, structural, and dynamic attributes identifiable in the chosen context; the human-centred basis of the model lies in its behavioural evaluation with human subject...
Preprint
We develop a human-centred, cognitive model of visuospatial complexity in everyday, naturalistic driving conditions. With a focus on visual perception, the model incorporates quantitative, structural, and dynamic attributes identifiable in the chosen context; the human-centred basis of the model lies in its behavioural evaluation with human subject...
Conference Paper
Full-text available
Semantic interpretation of dynamic visuospatial imagery calls for a general and systematic integration of methods in knowledge representation and computer vision. Towards this, we highlight research articulating & developing "deep semantics", characterised by the existence of declarative models --e.g., pertaining "space and motion"-- and correspond...
Conference Paper
Full-text available
Within the autonomous driving domain, there is now a clear need and tremendous potential for hybrid solutions (e.g., integrating semantics, learning, visual computing) towards fulfilling essential legal and ethical responsibilities involving explainability (e.g., for diagnosis), human-centred AI (e.g., interaction design), and industrial standardis...
Poster
Full-text available
The Nordic Chapter 2020 of the Insitute on Artificial and Human Intelligence is held in November 2020 in Gothenburg, Sweden. The institute consists of an integrated school, panel discussion, and young researcher forum; the institute is primarily (but not exclusively) aimed at early stage doctoral researchers and research-inclined students enrolled...
Conference Paper
Full-text available
High-level semantic interpretation of (dynamic) visual imagery calls for general and systematic methods integrating techniques in knowledge representation and computer vision. Towards this, we position "deep semantics", denoting the existence of declarative models --e.g., pertaining "space and motion"-- and corresponding formalisation and methods s...
Article
Full-text available
Parametric design systems serve as powerful assistive tools in the design process by providing a flexible approach for the generation of a vast number of design alternatives. However, contemporary parametric design systems focus primarily on low-level engineering and structural forms, without an explicit means to also take into account high-level,...
Preprint
Full-text available
MINDS. MOVEMENT. MOVING IMAGE. consists of two symposia held as part of the 7th International Conference on Spatial Cognition (ICSC 2018). September 10-14, 2018; Rome (Italy) / Convener: Mehul Bhatt., www.icsc-rome.org. Symposium 1: Spatial Cognition and the Built Environment Symposium 2: Visuo-Auditory Perception and the Moving Image Speakers a...
Chapter
We present ASP Modulo ‘Space-Time’, a declarative representational and computational framework to perform commonsense reasoning about regions with both spatial and temporal components. Supported are capabilities for mixed qualitative-quantitative reasoning, consistency checking, and inferring compositions of space-time relations; these capabilities...
Article
Full-text available
Navigation performance in urban and large-scale built-up spaces (e.g. airports, train-stations, hospitals) depends on gradual environmental perception during locomotion, and spatial knowledge acquisition, update/integration at different times along a path. Rotational locomotion is regularly involved in everyday navigation; this, combined with the f...
Preprint
We present ASP Modulo `Space-Time', a declarative representational and computational framework to perform commonsense reasoning about regions with both spatial and temporal components. Supported are capabilities for mixed qualitative-quantitative reasoning, consistency checking, and inferring compositions of space-time relations; these capabilities...
Conference Paper
Full-text available
We propose a hybrid architecture for systematically computing robust visual explanation(s) encompassing hypothesis formation, belief revision, and default reasoning with video data. The architecture consists of two tightly integrated synergistic components: (1) (functional) answer set programming based abductive reasoning with SPACE-TIME TRACKLETS...
Article
Full-text available
We propose a hybrid architecture for systematically computing robust visual explanation(s) encompassing hypothesis formation, belief revision, and default reasoning with video data. The architecture consists of two tightly integrated synergistic components: (1) (functional) answer set programming based abductive reasoning with space-time tracklets...
Conference Paper
Full-text available
We propose a deep semantic characterization of space and motion categorically from the viewpoint of grounding embodied human-object interactions. Our key focus is on an ontological model that would be adept to formalisation from the viewpoint of commonsense knowledge representation, relational learning, and qualitative reasoning about space and mot...
Article
Full-text available
This special issue presents interdisciplinary research---at the interface of artificial intelligence, cognitive science, and human-computer interaction---focussing on the semantic interpretation of human behaviour. The special issue constitutes an attempt to highlight and steer foundational methods research in artificial intelligence, in particular...
Conference Paper
We propose a deep semantic characterisation of space and motion categorically from the viewpoint of grounding embodied human-object interactions. Our key focus is on an ontological model that would be adept to formalisation from the viewpoint of commonsense knowledge representation, relational learning, and qualitative reasoning about space and mot...
Conference Paper
Full-text available
We present a commonsense, qualitative model for the semantic grounding of embodied visuo-spatial and locomotive interactions. The key contribution is an integrative methodology combining low-level visual processing with high-level, human-centred representations of space and motion rooted in artificial intelligence. We demonstrate practical applicab...
Article
Full-text available
This transcript documents select parts of discussions on the confluence of cognition, interaction, design, and human behaviour studies. The interview and related events were held as part of The Bremen Summer of Cognition and Design / CoDesign Roundtable 2017 held at the University of Bremen (Germany) in June 2017. The Q/A sessions were moderated by...
Conference Paper
Full-text available
Parametric design is an established method in engineering and architecture facilitating the rapid generation and evaluation of a large number of configurations and shapes of complex physical structures according to constraints specified by the designer. However, the emphasis of parametric design systems, particularly in the context of architectural...
Article
Full-text available
The term "Cognitive Architectures" indicates both abstract models of cognition, in natural and artificial agents, and the software instantiations of such models which are then employed in the field of Artificial Intelligence (AI). The main role of Cognitive Architectures in AI is that one of enabling the realization of artificial systems able to ex...
Chapter
Full-text available
When undertaking the task of design, architects imagine and anticipate the visuospatial and navigational experience of building users during the initial design conception phase. The ultimate goal is to ensure that the final physical built-up structure inherently performs with respect to people-centered design criteria encompassing function, behavio...
Chapter
Full-text available
Architektinnen und Architekten, die mit dem Entwerfen eines Gebäudes beschäftigt sind, sehen sich während der anfänglichen Konzeptionsphase der Aufgabe gegen-über, die visuell-räumlichen und navigationsbezogenen Erfahrungen der Gebäude-nutzerinnen und-nutzer zu imaginieren und vorwegzunehmen. Was Architektinnen und Architekten in diesem Entwurfssta...
Conference Paper
In this paper we present a novel framework and full implementation of probabilistic spatial reasoning within a Logic Programming context. The crux of our approach is extending Probabilistic Logic Programming (based on distribution semantics) to support reasoning over spatial variables via Constraint Logic Programming. Spatial reasoning is formulate...
Conference Paper
Full-text available
We present an inductive spatio-temporal learning framework rooted in inductive logic programming. With an emphasis on visuo-spatial language, logic, and cognition, the framework supports learning with relational spatio-temporal features identifiable in a range of domains involving the processing and interpretation of dynamic visuo-spatial imagery....
Article
Full-text available
We present an inductive spatio-temporal learning framework rooted in inductive logic programming. With an emphasis on visuo-spatial language, logic, and cognition, the framework supports learning with relational spatio-temporal features identifiable in a range of domains involving the processing and interpretation of dynamic visuo-spatial imagery....
Chapter
Full-text available
This paper presents a computational model of the processing of dynamic spatial relations occurring in an embodied robotic interaction setup. A complete system is introduced that allows autonomous robots to produce and interpret dynamic spatial phrases (in English) given an environment of moving objects. The model unites two separate research strand...
Conference Paper
Full-text available
Evidence-based design (EBD) for architecture involves the study of post-occupancy behaviour of building users with the aim to provide an empirical basis for improving building performance [Hamilton and Watkins 2009]. Within EBD, the high-level, qualitative analysis of the embodied visuo-locomotive experience of representative groups of building use...
Conference Paper
This research is driven by visuo-spatial perception focussed cognitive film studies, where the key emphasis is on the systematic study and generation of evidence that can characterise and establish correlates between principles for the synthesis of the moving image, and its cognitive (e.g., embodied visuo-auditory, emotional) recipient effects on o...
Conference Paper
Full-text available
We present a system for generating and understanding of dynamic and static spatial relations in robotic interaction setups. Robots describe an environment of moving blocks using English phrases that include spatial relations such as "across" and "in front of". We evaluate the system in robot-robot interactions and show that the system can robustly...
Conference Paper
We present a novel numerical optimisation based characterisation of spatial reasoning in the context of constraint logic programming (CLP). The approach —formalised and implemented within CLP— is developed as an extension to CLP(QS), a declarative spatial reasoning framework providing a range of mixed quantitative-qualitative spatial representation...
Article
The systematic modelling of dynamic spatial systems is a key requirement in a wide range of application areas such as commonsense cognitive robotics, computer-aided architecture design, dynamic geographic information systems. We present ASPMT(QS), a novel approach and fully-implemented prototype for non-monotonic spatial reasoning --- a crucial req...
Article
The evidence-based analysis of people's navigation and wayfinding behaviour in large-scale built-up environments (e.g., hospitals, airports) encompasses the measurement and qualitative analysis of a range of aspects including people's visual perception in new and familiar surroundings, their decision-making procedures and intentions, the affordance...
Article
We present a concept for integrating state-of-the-art methods in geometric and qualitative spatial representation and reasoning with feature-based parametric modelling systems. Using a case-study involving a combination of topological, visibility, and movement constraints, we demonstrate the manner in which a parametric model may be constrained by...
Conference Paper
Full-text available
Declarative spatial reasoning denotes the ability to (declaratively) specify and solve real-world problems related to geometric and qualitative spatial representation and reasoning within standard knowledge representation and reasoning (KR) based methods (e.g., logic programming and derivatives). One approach for encoding the semantics of spatial r...
Conference Paper
The systematic modelling of dynamic spatial systems [9] is a key requirement in a wide range of application areas such as comonsense cognitive robotics, computer-aided architecture design, dynamic geographic information systems. We present ASPMT(QS), a novel approach and fully-implemented prototype for non-monotonic spatial reasoning —a crucial req...
Conference Paper
Full-text available
One approach for encoding the semantics of spatial relations within a declarative programming framework is by systems of polynomial constraints. However, solving such constraints is computationally intractable in general (i.e. the theory of real-closed fields), and thus far the proposed symbolic algebraic methods do not scale to real world problems...
Conference Paper
Full-text available
The systematic modelling of dynamic spatial systems [9] is a key requirement in a wide range of application areas such as comonsense cognitive robotics, computer-aided architecture design, dynamic geographic information systems. We present ASPMT(QS), a novel approach and fully-implemented prototype for non-monotonic spatial reasoning —a crucial req...
Article
Full-text available
We present a general theory and corresponding declarative model for the embodied grounding and natural language based analytical summarisation of dynamic visuo-spatial imagery. The declarative model ---ecompassing spatio-linguistic abstractions, image schemas, and a spatio-temporal feature based language generator--- is modularly implemented within...
Article
We propose an approximation of the possible worlds semantics (PWS) of knowledge with support for postdiction – a fundamental inference pattern for diagnostic reasoning and explanation tasks in a wide range of real-world applications such as cognitive robotics, visual perception for cognitive vision, ambient intelligence and smart environments. We p...
Article
We present an answer set programming realization of the h-approximation (HPX) theory [8] as an efficient and provably sound reasoning method for epistemic planning and projection problems that involve postdictive reasoning. The efficiency of HPX stems from an approximate knowledge state representation that involves only a linear number of state var...
Article
Event models obtained automatically from video can be used in applications ranging from abnormal event detection to content based video retrieval. When multiple agents are involved in the events, characterizing events naturally suggests encoding interactions as relations. Learning event models from this kind of relational spatio-temporal data using...
Chapter
Full-text available
Conceptual blending has been employed very successfully to understand the process of concept invention, studied particularly within cognitive psychology and linguistics. However, despite this influential research, within computational creativity little effort has been devoted to fully formalise these ideas and to make them amenable to computational...
Conference Paper
Full-text available
This paper presents a computational model of the processing of dynamic spatial relations occurring in an embodied robotic interaction setup. A complete system is introduced that allows autonomous robots to produce and interpret dynamic spatial phrases (in English) given an environment of moving objects. The model unites two separate research strand...
Conference Paper
Full-text available
Architects concerned with designing built environments (e.g., hospital or an airport) need to “anitcipate” and “ensure” that people-centered design objectives are fulfilled, e.g., people should (not) get lost, the environment should fulfil universal design criteria for diverse user groups and situations (e.g., disabilities, geriatric care, emergenc...
Conference Paper
Full-text available
We propose a commonsense theory of space and motion for the high-level semantic interpretation of dynamic scenes. The theory provides primitives for commonsense representation and reasoning with qualitative spatial relations, depth profiles, and spatio-temporal change; these may be combined with probabilistic methods for modelling and hypothesising...
Conference Paper
Full-text available
We present a formal framework and implementation for declarative spatial representation and reasoning about the topological relationships between boolean combinations of regions (i.e., union, intersection, difference, xor). Regions of space here correspond to arbitrary axis aligned n-polytope objects, with geometric parameters either fully grounded...
Article
Full-text available
Standardisation, archiving, and digital access of spatial data pertaining to built-up environments is an area acquiring increasing attention amongst several interest groups: policy makers, designers and planners, civil engineers, infrastructure management and public service personnel, building users. Initiatives such as the Building Information Mod...
Article
Full-text available
The AAAI-13 Workshop Program, a part of the 27th AAAI Conference on Artificial Intelligence, was held Sunday and Monday, July 14-15, 2013, at the Hyatt Regency Bellevue Hotel in Bellevue, Washington, USA. The program included 12 workshops covering a wide range of topics in artificial intelligence, including Activity Context-Aware System Architectur...
Conference Paper
Full-text available
Background / Purpose: Numerous studies have been conducted investigating the fundamental characteristics of spatial cognition in human agents navigating built-up and indoor environments. Most of them investigate translational motion. We are developing a conceptual framework and case studies aimed at computationally analysing the effects of rotati...
Conference Paper
Full-text available
We propose a history-based approximation of the Possible Worlds Se-mantics (PWS) for reasoning about knowledge and action. A respective plan-ning system is implemented by a transformation of the problem domain to an Answer-Set Program. The novelty of our approach is elaboration tolerant support for postdiction under the condition that the plan exis...
Article
Full-text available
What lies between `\emph{sensing}' and `\emph{sensibility}'? In other words, what kind of cognitive processes mediate sensing capability, and the formation of sensible impressions ---e.g., abstractions, analogies, hypotheses and theory formation, beliefs and their revision, argument formation--- in domain-specific problem solving, or in regular act...