Nuno Jardim Nunes

Nuno Jardim Nunes
University of Lisbon | UL · Informatics Engineering

PhD in Computer Science

About

256
Publications
79,436
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
2,694
Citations
Citations since 2016
106 Research Items
1879 Citations
20162017201820192020202120220100200300
20162017201820192020202120220100200300
20162017201820192020202120220100200300
20162017201820192020202120220100200300
Additional affiliations
January 2017 - present
Instituto Superior Técnico
Position
  • Professor (Full)
January 2010 - present
Interactive Technologies Institute
Position
  • CEO
January 1997 - present
Carnegie Mellon University
Position
  • Professor (Associate)

Publications

Publications (256)
Chapter
The emergence of a networked society generates transformations in the dynamic interactions of people impacting cultural and service systems. A location can provide different individual and collective meanings, perceptions, and experiences to different people. However, it is unclear how urban actors can collect, measure, and operationalise such plac...
Chapter
Climate change is arguably the most urgent issue of our time, demanding the participation of all types of stakeholders, from individuals to governments. However, climate change communication has been focused on negative framings based on the mere presentation of data, in many cases demotivating or simply not helping in action. This Ph.D. proposes u...
Chapter
This pictorial presents the concept and preliminary design of “Tecnico Go!”, an application conceived to support college students during the COVID-19 pandemic. The project applied HCI and user-centred design methods to understand students’ needs, pains, and desires during the pandemic period. The authors collected, unpacked, and reflected on user-c...
Chapter
Climate change is arguably the most urgent crisis of our lifetimes, and the Design community has been continuously exploring how to respond to this complex challenge. However, the past few years have demonstrated just how difficult climate change communication and engagement can be. As a response to the Anthropocene challenges, HCI and Design resea...
Article
Full-text available
Life-supporting ecosystems are facing impending destruction. The human–computer interaction (HCI) community must rethink how to design technological interventions that reconcile concepts and theories for ecological computing. Proponents of sustainable HCI have pushed for tools and systems that aim to decenter the human in a shift toward posthuman d...
Article
Artificial intelligence has the potential to transform many application domains fundamentally. One notable example is clinical radiology. A growing number of decision-making support systems are available for lesion detection and segmentation, two fundamental steps to accomplish diagnosis and treatment planning. This paper proposes a model based on...
Article
Full-text available
In this paper, we present a systematic analysis of large-scale human mobility patterns obtained from a passive Wi-Fi tracking system, deployed across different location typologies. We have deployed a system to cover urban areas served by public transportation systems as well as very isolated and rural areas. Over 4 years, we collected 572 million d...
Article
In this paper, we developed BreastScreening-AI within two scenarios for the classification of multimodal beast images: (1) Clinician-Only; and (2) Clinician-AI. The novelty relies on the introduction of a deep learning method into a real clinical workflow for medical imaging diagnosis. We attempt to address three high-level goals in the two above s...
Chapter
Full-text available
We present a case study to understand how migrant communities embrace and connect with their host city’s cultural heritage. To achieve this, we deployed a study with ten adult migrants (first- and second-generation Lisbon dwellers) articulated into two stages: (i) a five-day photo-challenge involving storytelling elucidated by pictures and short te...
Article
As the world becomes increasingly interconnected, digital technologies impact the way humans experience places and spaces in (smart) cities. To some extent, these smart technologies are intertwined with the urban living enabling the augmentation of the city’s space and creating new opportunities for playful urban engagement. Moreover, touristic cit...
Chapter
Climate change is arguably one of the most debated issues today. The scale and global reach of this crisis doesn’t afford a universal solution and requires widespread global mobilization. Public engagement is essential for the success of any initiative on this topic. However, sometimes communicating the facts is not enough. Interactive storytelling...
Article
Background: The global health crisis caused by COVID-19 has drastically changed human society in a relatively short time. However, this crisis has offered insights into the different roles that such world wide virus plays in the lives of people, and how those have been affected, and eventually propose new solutions. Objective: From the beginning...
Conference Paper
Full-text available
During the COVID-19 pandemic, social distancing measures were employed to contain its spread. This paper describes the deployment and testing of a passive Wi-Fi scanning system to help people keep track of crowded spaces, hence comply with social distancing measures. The system is based on passive Wi-Fi sensing to detect human presence in 93 locati...
Chapter
During the COVID-19 pandemic, social distancing measures were employed to contain its spread. This paper describes the deployment and testing of a passive Wi-Fi scanning system to help people keep track of crowded spaces, hence comply with social distancing measures. The system is based on passive Wi-Fi sensing to detect human presence in 93 locati...
Article
Full-text available
Tourism is one of the world’s largest industries fundamentally arising from mobility as a form of capital. In destination islands that have a delicate ecosystem to maintain, this source of income can become problematic in terms of sustainability. A difficulty in making people aware of this issue is also represented by the fact that such sustainabil...
Article
Full-text available
Introduction: New approaches to the study of the binge-watching phenomenon require new technology, leading to the development of a non-intrusive and low-cost analytical research software that facilitates a holistic under- standing of binge-watching in an uncontrolled environment remotely (e.g., the home). BWDAT was developed to allow the collection...
Article
In this research, we take an HCI perspective on the opportunities provided by AI techniques in medical imaging, focusing on workflow efficiency and quality, preventing errors and variability of diagnosis in Breast Cancer. Starting from a holistic understanding of the clinical context, we developed BreastScreening to support Multimodality and integr...
Article
Full-text available
As vectors of malaria, dengue, zika, and yellow fever, mosquitoes are considered one of the more severe worldwide health hazards. Widespread surveillance of mosquitoes is essential for understanding their complex ecology and behaviour, and also for predicting and formulating effective control strategies against mosquito-borne diseases. One techniqu...
Article
Full-text available
This paper describes recent work on the development of a wireless-based remote monitoring system for household energy consumption and generation in Madeira Island, Portugal. It contains three different main sections: (1) a monitoring system for consumed and produced energy of residencies equipped with photovoltaic (PV) systems, (2) developing a too...
Conference Paper
Full-text available
This paper describes the field research, design, and comparative deployment of a multimodal medical imaging user interface for breast screening. The main contributions described here are threefold: 1) The design of an advanced visual interface for multimodal diagnosis of breast cancer (BreastScreening); 2) Insights from the field comparison of Sing...
Conference Paper
Peer-to-Peer (P2P) energy trading has emerged as the next-generation energy management mechanism that enables energy consumers and prosumers – i.e., households that function as both energy producers and consumers - to exchange energy directly with each other. The full development of such a decentralized energy market poses several challenges to the...
Conference Paper
Full-text available
A elicitação de requisitos é uma etapa que exige uma intensa comunicação entre engenheiros de requisitos e usuários. Ressalta-se a necessidade dos engenheiros em utilizar técnicas adequadas para favorecer esse momento de comunicação. Uma das recomendações na literatura é que o contato direto com os usuários pode ser beneficiado por meio do Design P...
Conference Paper
Full-text available
In this paper, we introduce the concept of VR Open Scores: aleatoric score-based virtual scenarios where an aleatoric score is embedded in a virtual environment. This idea builds upon the notion of graphic scores and composed instrument , and apply them in a new context. Our proposal also explores possible parallels between open meaning in interact...
Article
Full-text available
The field of Non-Intrusive Load Monitoring (NILM) gained prominence due to its promise of inferring the energy consumption of individual appliances by analyzing only the aggregated consumption. Still, despite some research efforts towards producing meaningful comparisons between approaches, it is not yet possible to find a proven and formally accep...
Preprint
Transportation has become of evermore importance in the last years, affecting people's satisfaction and significantly impacting their quality of life. In this paper we present a low-cost infrastructure to collect passive Wi-Fi probes with the aim of monitoring, optimizing and personalizing public transport, towards a more sustainable mobility. We d...
Preprint
Cities are becoming very congested. There is a need to reduce the number of private cars on the roads, by maximising the potential for local public transport. With the increasing awareness of transport that is sustainable in the sense of environmental impact, but also climate and social, there is the need to create engagement into public transporta...
Preprint
Full-text available
Braindraw is a participatory technique in which participants collab-oratively design the interface for a proposed solution. Conducting braindraw in different design situations is still a factor of difficulty for its use by human-computer interaction professionals in the software industry. In this sense, this article presents a systematic literature...
Conference Paper
Full-text available
Cities are becoming very congested. There is a need to reduce the number of private cars on the roads, by maximising the potential for local public transport. With the increasing awareness of transport that is sustainable in the sense of environmental impact, but also climate and social, there is the need to create engagement into public transporta...
Conference Paper
Full-text available
Transportation has become of evermore importance in the last years, affecting people's satisfaction and significantly impacting their quality of life. In this paper we present a low-cost infrastructure to collect passive Wi-Fi probes with the aim of monitoring, optimizing and personalizing public transport, towards a more sustainable mobility. We...
Preprint
Full-text available
This paper describes the field research, design and comparative deployment of a multimodal medical imaging user interface for breast screening. The main contributions described here are threefold: 1) The design of an advanced visual interface for multimodal diagnosis of breast cancer (BreastScreening); 2) Insights from the field comparison of singl...
Article
Full-text available
Millions of people use mobile map applications like Google Maps on a regular basis. However, despite these applications' ubiquity, the literature contains very little information about how these applications are used in the real world. As such, many researchers and practitioners seeking to improve mobile map applications may not be able to identify...
Chapter
The twin crises of nature and climate is supported by overwhelming scientific evidence and increasing public concern about long-term and potentially irreversible consequences of the Anthropocene. People and wildlife living today, as well as future generations, are at risk unless urgent action is taken to reverse the loss of plants, insects and othe...
Chapter
Full-text available
Whale watching is a prime example of ecotourism services reaching millions of people worldwide. In this paper, we describe a prototype of a mobile application designed to enhance the whale watching experience. Integrating eco-acoustics and entertainment components, the authors designed an App that enhances customer satisfaction even in the case of...
Article
Full-text available
This paper reports on the different engineering, social and financial challenges behind the building and deploying electric energy monitoring and eco-feedback technology in real-world scenarios, which despite being relevant to the research community are seldom reported in the literature. The objectives of this paper are two-fold: First, discuss the...
Chapter
Full-text available
Memories of Carvalhal’s Palace – Haunted Encounters is an Augmented Reality (AR) location-based game which involves players in uncovering the mystery behind the haunted aspects of a museum premises. The game deployed at the Natural History Museum of Funchal makes use of mobile interactive AR and gaming strategies to promote the engagement of teenag...
Chapter
Full-text available
The Internet of Things (IoT) is opening new possibilities for sensing, monitoring and actuating in urban environments. They support a shift to a hybrid network of humans and things collaborating in production, transmission and processing of data through low-cost and low power devices connected via long-range (LoRa) wide area networks (WAN). This pa...
Conference Paper
Full-text available
In this paper, an approach to increase the use of public transportation by tourists, exploiting pervasive technologies and a smart objects infrastructure, is presented. The idea behind our platform is to take advantage of gamification and smart technologies (such as iBeacons technologies and smartphones) to engage users and persuade them to use (mo...
Conference Paper
Full-text available
In this paper, we describe the conceptualization, design and preliminary evaluation of Há-Vita, a participatory platform populated with video interviews about nature and biodiversity preservation, designed primarily for tourists and visitors of a popular Touristic Island destination. The content was selected to raise awareness towards environmental...
Chapter
Full-text available
IoT has been widely adopted by HCI communities and citizen scientists to sense and control the surrounding environments. While their applications are mostly reported in urban settings, they remain scarce in aquatic settings. Oceans are undergoing an immense increase of human generated pollution ranging from noise to marine litter, where current USV...
Chapter
Full-text available
Distributed Ledger Technologies (DLT), such as blockchain, are gaining increasing attention in the energy sector, where they can be used to support Peer-to-Peer (P2P) energy trading. Several proof-of-concept and pilot projects are running all over the world to test this specific use case. However, despite much work addressing the technical and regu...
Conference Paper
Full-text available
Participatory Design has a large number of techniques that can be used for requirements elicitation and interaction design. However, choosing a technique (or set of them) suitable for both processes can be challenging. In this sense, in this paper, we present a semio-participatory methodological process-SPIDe-for requirements elicitation integrated...
Poster
Full-text available
Artificial Intelligence has the potential to alter many application domains fundamentally. One prominent example is clinical radiology. The literature hypothesizes that Deep Learning algorithms will profoundly affect the clinical workflow. In this work, we utilized the unprecedented opportunity presented by developing Radiomics to investigate how a...
Conference Paper
Full-text available
Inspired by HCI research advocating for the inclusion of children in the design process, this pictorial provides a qualitative case study on children's perceptions of urban landscapes. Our goal is to create digital maps in the context of locative systems and wayfinding for children. For this purpose, we engaged 70 students from the city of Funchal...
Conference Paper
Newly emerging urban IoT infrastructures are enabling novel ways of sensing how urban spaces are being used. However, the data produced by these systems are largely context-agnostic, making it difficult to discern what patterns and anomalies in the data mean. We propose a hybrid data approach that combines the quantitative data collected from an ur...
Conference Paper
This pictorial summarizes a qualitative study of children's perceptions of mobility through their own cognitive map drawings of the journey from home to school. We engaged 27 sixth-grade students (11 to 12 year-old) from Lisbon, Portugal, and analyze their drawings extracting 12 different design recommendations. We use these recommendations to prov...
Poster
Full-text available
Artificial Intelligence has the potential to alter many application domains fundamentally. One prominent example is clinical radiology. The literature hypothesizes that Deep Learning algorithms will profoundly affect the clinical workflow. In this work, we utilized the unprecedented opportunity presented by developing Radiomics to investigate how a...
Raw Data
Full-text available
In our research, the DOTS Survey document is a simple item Trust scale. This document aims to measure the Trust on the Radiology Room (RR), into well-defined categories. It is intended to use this document on several User Tests where Researchers can retrieve information from Clinicians regarding the Trust in RR regarding novel systems. Repository:...
Conference Paper
Full-text available
Orientation is an emerging issue in cinematic Virtual Reality (VR), as viewers may fail in locating points of interest. Recent strategies to tackle this research problem have investigated the role of cues, specifically diegetic sound effects. In this paper, we examine the use of sound spatialization for orientation purposes, namely by studying diff...
Chapter
Biodiversity refers to the variety of life on Earth and its biological diversity. It boosts ecosystem productivity, where each species has a role to play. Unfortunately, human activity is causing massive extinctions and biodiversity losses continue. Because of that, nature conservation efforts and environmental monitoring have become increasingly i...
Article
Full-text available
This article describes the design of the Lucid Peninsula, a Physical Narrative Art Installation, developed to engage a wide variety of audiences with a possible future, in which the practice of lucid dreaming plays an important role. In this article, the authors present and discuss the results from the in-the-wild evaluation of the audience recepti...
Conference Paper
Asthma is a complex disease caused by genetic and environmental factors, affecting 235 million people worldwide. The effects of chronic respiratory diseases, such as asthma and respiratory ailments, can be particularly aggressive in islands, due to the optimal climate conditions and the rich nature and flora. Conceived as a case study on Madeira is...
Poster
Full-text available
We present an assistant for a fully automated breast cancer detection and segmentation from multi-modal medical images introducing clinical covariates. This assistant will be able to: 1. Collect a huge amount of ground truth (annotations), concerning two types of lesions (i.e., masses and calcifications) in all image modalities; 2. Provide the cl...
Conference Paper
Full-text available
Recent years demonstrate an increased interest in Passive Acoustic Monitoring (PAM) applications when studying cetaceans. However, they remain expensive underwater systems and targeted for industrial and military purposes. While the usage of smartphones as acoustic sensors has been observed in terrestrial environments, ocean and nautical PAM applic...
Poster
Full-text available
We present an assistant for a fully automated breast cancer detection and segmentation from multi-modal medical images introducing clinical covariates. This assistant will be able to: 1. Collect a huge amount of ground truth (annotations), concerning two types of lesions (i.e., masses and calcifications) in all image modalities; 2. Provide the cl...
Article
Full-text available
Non‐intrusive load monitoring (also known as NILM or energy disaggregation) is the process of estimating the energy consumption of individual appliances from electric power measurements taken at a limited number of locations in the electric distribution of a building. This approach reduces sensing infrastructure costs by relying on machine learning...
Conference Paper
Full-text available
In today’s digital age, massive amounts of data are steadily being generated from various sources, such as smart-phones and social media. Smart-Grids are among the fields that are currently experiencing a burst in the data being generated, in part due to the recent investments in Advanced Metering Infrastructure Systems. In this paper, we present a...