Luís Paulo Reis

Luís Paulo Reis
University of Porto | UP · Faculty of Engineering, Informatics Engineering Dep.

PhD

About

561
Publications
117,612
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
3,828
Citations
Education
September 1995 - September 2003
University of Porto
Field of study
  • Electrical Engineering/Computer Science
September 1993 - September 1995
University of Porto
Field of study
  • Electrical Engineering/Industrial Informatics
September 1988 - July 1993
University of Porto
Field of study
  • Electrical Engineering/Informatics and Systems

Publications

Publications (561)
Article
Full-text available
Bin picking is a challenging problem that involves using a robotic manipulator to remove, one-by-one, a set of objects randomly stacked in a container. In order to provide ground truth data for evaluating heuristic or machine learning perception systems, this paper proposes using simulation to create bin picking environments in which a procedural g...
Chapter
The introduction of Cyber-Physical Systems (CPS) in the industry through the digitalization of equipment, also known as Digital Twins, allows for a more customized production. Due to high market fluctuation, the implementation of a CPS should guarantee a high flexibility in both hardware and software levels to achieve a high responsiveness of the s...
Article
Full-text available
The Natural Language Processing (NLP) community has witnessed huge improvements in the last years. However, most achievements are evaluated on benchmarked curated corpora, with little attention devoted to user-generated content and less-resourced languages. Despite the fact that recent approaches target the development of multi-lingual tools and mo...
Article
This paper proposes a modular framework to generate robust biped locomotion using a tight coupling between an analytical walking approach and deep reinforcement learning. This framework is composed of six main modules which are hierarchically connected to reduce the overall complexity and increase its flexibility. The core of this framework is a sp...
Article
Full-text available
Acquired brain injury (ABI) is associated with severe functional consequences at several levels: personal, psychological, social, physical, economic, and systemic. The main objective of the present study is to show the potential of applying virtual reality (VR) in neuropsychological rehabilitation and the consequent psychological and cognitive impr...
Chapter
Peer-reviewing is considered the main mechanism for quality control of scientific publications. The editors of journals and conferences assign submitted papers to reviewers, who review them. Therefore, inconsistencies between reviewer recommendations and reviewer comments are a problem that the editor needs to handle. However, few studies have expl...
Chapter
Insufficient sleep is a prominent problem in modern society with several negative effects and risks. One of the most serious consequences is traffic accidents caused by drowsy driving. Current solutions are focused on detecting drowsiness, where individuals need to reach a certain drowsiness level to receive an alarm, which may be too late to react...
Article
Full-text available
Gait disabilities empowered intensive research on the field of human-robot interaction to promote effective gait rehabilitation. Assist-as-needed strategies are becoming prominent, appealing to the users’ participation in their rehabilitation therapy. This study proposes and assesses the biomechanical effects of an adaptive impedance control strate...
Article
Full-text available
Knowledge Engineering has become essential in the fields of Medical and Health Care with emphasis for helping citizens to improve their health and quality of life. This includes individual methods and techniques in health‐related knowledge acquisition and representation and their application in the construction of intelligent systems capable of usi...
Article
Full-text available
Robotic soccer simulation is a challenging area, where the development of new techniques is paramount to remain competitive. Robotic skill evolution has accelerated with recent developments in deep learning algorithms, leading to improvements in behavior number and complexity. Shooting a ball towards a defined target is one of the most basic yet in...
Preprint
Full-text available
This paper proposes a modular framework to generate robust biped locomotion using a tight coupling between an analytical walking approach and deep reinforcement learning. This framework is composed of six main modules which are hierarchically connected to reduce the overall complexity and increase its flexibility. The core of this framework is a sp...
Article
Full-text available
In this work, we propose a Dynamic Difficulty Adjustment methodology to achieve automatic video game balance. The balance task is modeled as a meta game, a game where actions change the rules of another base game. Based on the model of Reinforcement Learning (RL), an agent assumes the role of a game master and learns its optimal policy by playing t...
Chapter
Data-driven decision support systems rely on increasing amounts of information that needs to be converted into actionable knowledge in business intelligence processes. The latter have been applied to diverse business areas, including governmental organizations, where they can be used effectively. The Portuguese Food and Economic Safety Authority (A...
Preprint
Full-text available
Humanoid robots are made to resemble humans but their locomotion abilities are far from ours in terms of agility and versatility. When humans walk on complex terrains, or face external disturbances, they combine a set of strategies, unconsciously and efficiently, to regain stability. This paper tackles the problem of developing a robust omnidirecti...
Poster
Full-text available
Fast-growing of the generated data and costly analysis of huge data attract researchers to investigate distributed systems and distributed learning. Knowledge extraction and efficiently utilize distributed data in such complex and noisy system become more challengeable field. Multi-agent systems (MAS) offer an architecture for distributed problem s...
Book
This book includes selecting the articles accepted for presentation and discussion at WCQR2021, held on January 20th to 22nd, 2021 (Virtual Conference). The World Conference on Qualitative Research (WCQR) is an annual event that aims to bring together researchers, academics and professionals, promoting the sharing and discussion of knowledge, new p...
Book
This book constitutes the refereed proceedings of the 20th EPIA Conference on Artificial Intelligence, EPIA 2021, held virtually in September 2021. The 62 full papers and 6 short papers presented were carefully reviewed and selected from a total of 108 submissions. The papers are organized in the following topical sections: artificial intelligence...
Preprint
Full-text available
Although humanoid robots are made to resemble humans, their stability is not yet comparable to ours. When facing external disturbances, humans efficiently and unconsciously combine a set of strategies to regain stability. This work deals with the problem of developing a robust hybrid stabilizer system for biped robots. The Linear Inverted Pendulum...
Conference Paper
Artificial Intelligence (AI) has seen numerous applications in the area of Education. Through the use of educational technologies such as Intelligent Tutoring Systems (ITS), learning possibilities have increased significantly. One of the main challenges for the widespread use of ITS is the ability to automatically generate questions. Bearing in min...
Article
Full-text available
We consider the problem of multi agents cooperating in a partially-observable environment. Agents must learn to coordinate and share relevant information to solve the tasks successfully. This article describes Asynchronous Advantage Actor-Critic with Communication (A3C2), an end-to-end differentiable approach where agents learn policies and communi...
Article
Full-text available
In general, games pose interesting and complex problems for the implementation of intelligent agents and are a popular domain in the study of artificial intelligence. In fact, games have been at the center of some of the most well-known achievements in artificial intelligence. From classical board games such as chess, checkers, backgammon and Go, t...
Chapter
The present work surveys research that integrates successfully a number of complementary fields in Artificial Intelligence. Starting from integrations in Reinforcement Learning: Deep Reinforcement Learning and Relational Reinforcement Learning, we then present Neural-Symbolic Learning and Reasoning since it is applied to Deep Reinforcement Learning...
Chapter
Text categorization is a supervised learning task which aims to assign labels to documents based on the predicted outcome suggested by a classifier trained on a set of labelled documents. The association of text classification to facilitate labelling reports/complaints in the economic and health related fields can have a tremendous impact in the sp...
Chapter
This work presents some approaches to overcome current Reinforcement Learning limits. We implement a simple virtual environment and some state-of-the-art Reinforcement Learning algorithms for testing and producing a baseline for comparison. Then we implement a Relational Reinforcement Learning algorithm that shows superior performance to the baseli...
Chapter
Intelligent wheelchairs allow individuals to move more freely, safely, and facilitate users’ interaction with the wheelchair. This paper presents the results focused on the study and analysis of the state of the art related to topics as interaction, interfaces, intelligent wheelchairs and the analysis of the Intellweelsproject. The main goal is to...
Chapter
Question Answering (QA) and Question Generation (QG) have been subjects of an intensive study in recent years and much progress has been made in both areas. However, works on combining these two topics mainly focus on how QG can be used to improve QA results. Through existing Natural Language Processing (NLP) techniques, we have implemented a tool...
Chapter
This paper describes an application aimed at improving the current state of enforcement in the areas of food safety and economic activities in Portugal. More specifically, the application focuses on a flexible and interactive approach to generate inspection routes, to be followed by surveillance brigades with the aim of verifying Economic Operators...
Chapter
Geocoding is the process of converting an address or a place name into geographic coordinates. This conversion process has become a fundamental subject in many scientific domains and real world applications, from health and crime analysis to route optimization. In this paper, we present a conversion process of over 4.5 million entities, mostly Port...
Chapter
Digital tools with an emphasis on the so-called apps are a current topic whose potential, in school context, is still little explored. On the other hand, the formative evaluation is also very little explored and is of particular importance in the context of inclusive education, as an extended vision, in which all students have specificities. The re...
Chapter
Due to the technological evolution on wearable devices, biosignals, such as inter-cardiac beat interval (RR) time series, are being captured in a non-controlled environment. These RR signals, derived from photoplethysmography (PPG), enable health status assessment in a more continuous, non-invasive, non-obstructive way, and fully integrated into th...
Article
Tackling multi-agent environments where each agent has a local limited observation of the global state is a non-trivial task that often requires hand-tuned solutions. A team of agents coordinating in such scenarios must handle the complex underlying environment, while each agent only has partial knowledge about the environment. Deep reinforcement l...
Article
Multiple real-world problems are naturally modeled as cooperative multi-agent systems, ranging from satellite formation to traffic monitoring. These systems require algorithms that can learn successful policies with independent agents that rely solely on local partial-observations of the environment. However, multi-agent environments are more compl...
Chapter
Current packaging machine vendors do not provide any automated mechanism for blank feeding and the state of the art is to have a human operator dedicated to feed the blank piles to the packaging machine. This is a tedious, repetitive and tiring task. This also results in problems with unintentional errors, such as using the wrong pile of blanks. An...
Article
Full-text available
There has been an increasing attention to the study of stress. Particularly, college students often experience high levels of stress that are linked to several negative outcomes concerning academic functioning, physical, and mental health. In this paper, we introduce the EuStress Solution, that aims to create an Information System to monitor and as...
Chapter
Given the plethora of Reinforcement Learning algorithms available in the literature, it can prove challenging to decide on the most appropriate one to use in order to solve a given Reinforcement Learning task. This work presents a benchmark study on the performance of several Reinforcement Learning algorithms for discrete learning environments. The...
Chapter
In recent years robots have been used as a tool for teaching purposes, motivating the development of fully virtual environments for combined real/simulated robotics teaching. The AlphaBot2 Raspberry Pi (RPi), a robot used for education, has no currently available simulator. A Gazebo simulator was produced and a ROS framework was implemented for har...
Chapter
Full-text available
This article proposes a feature-rich, open hardware, open software inexpensive robot based on a Waveshare AlphaBot 2. The proposal uses a Raspberry Pi and a chrome plated light bulb as a mirror to produce a robot with an omnidirectional vision (catadioptric) system. The system also tackles boot and network issues to allow for monitor-less programmi...
Chapter
This paper investigates the learning of both low-level behaviors for humanoid robot controllers and of high-level coordination strategies for teams of robots engaged in simulated soccer. Regarding controllers, current approaches typically hand-tune behaviors or optimize them without realistic constraints, for example allowing parts of the robot to...
Book
The World Conference on Qualitative Research (WCQR) is an annual event that aims to bring together researchers, academics and professionals, promoting the sharing and discussion of knowledge, new perspectives, experiences and innovations on the field of Qualitative Research. This book includes a selection of the articles accepted for presentation a...
Book
This book gathers selected papers presented at the 2020 World Conference on Information Systems and Technologies (WorldCIST’20), held in Budva, Montenegro, from April 7 to 10, 2020. WorldCIST provides a global forum for researchers and practitioners to present and discuss recent results and innovations, current trends, professional experiences with...
Book
This book gathers selected papers presented at the 2020 World Conference on Information Systems and Technologies (WorldCIST’20), held in Budva, Montenegro, from April 7 to 10, 2020. WorldCIST provides a global forum for researchers and practitioners to present and discuss recent results and innovations, current trends, professional experiences with...
Book
This book gathers selected papers presented at the 2020 World Conference on Information Systems and Technologies (WorldCIST’20), held in Budva, Montenegro, from April 7 to 10, 2020. WorldCIST provides a global forum for researchers and practitioners to present and discuss recent results and innovations, current trends, professional experiences with...
Chapter
Reinforcement learning techniques bring a new perspective to enduring problems. Developing skills from scratch is not only appealing due to the artificial creation of knowledge. It can also replace years of work and refinement in a matter of hours. From all the developed skills in the RoboCup 3D Soccer Simulation League, running is still considerab...
Book
This book gathers a selection of papers presented at ROBOT 2019 – the Fourth Iberian Robotics Conference, held in Porto, Portugal, on November 20th–22nd, 2019. ROBOT 2019 is part of a series of conferences jointly organized by the SPR – Sociedade Portuguesa de Robótica (Portuguese Society for Robotics) and SEIDROB – Sociedad Española para la Invest...
Book
This book gathers a selection of papers presented at ROBOT 2019 – the Fourth Iberian Robotics Conference, held in Porto, Portugal, on November 20th–22nd, 2019. ROBOT 2019 is part of a series of conferences jointly organized by the SPR – Sociedade Portuguesa de Robótica (Portuguese Society for Robotics) and SEIDROB – Sociedad Española para la Invest...
Article
Full-text available
Stochastic search and optimization techniques are used in a vast number of areas, ranging from refining the design of vehicles, determining the effectiveness of new drugs, developing efficient strategies in games, or learning proper behaviors in robotics. However, they specialize for the specific problem they are solving, and if the problem’s conte...
Chapter
In recent years, public institutions have undergone a progressive modernization process, bringing several administrative services to be provided electronically. Some institutions are responsible for analyzing citizen complaints, which come in huge numbers and are mainly provided in free-form text, demanding for some automatic way to process them, a...
Article
Full-text available
Hand gestures are a powerful way for human communication, with lots of potential applications in the area of human computer interaction. Vision-based hand gesture recognition techniques have many proven advantages compared with traditional devices, giving users a simpler and more natural way to communicate with electronic devices. This work propose...
Article
Full-text available
Hand gesture recognition for human computer interaction is an area of active research in computer vision and machine learning. The primary goal of gesture recognition research is to create a system, which can identify specific human gestures and use them to convey information or for device control. This paper presents a comparative study of four cl...
Article
Full-text available
Vision-based hand gesture interfaces require fast and extremely robust hand detection, and gesture recognition. Hand gesture recognition for human computer interaction is an area of active research in computer vision and machine learning. The primary goal of gesture recognition research is to create a system, which can identify specific human gestu...
Chapter
The Weighted Policy Learner (WPL) algorithm has been shown to converge to Nash Equilibria (NE) in several challenging environments with minimum knowledge. However, WPL has trouble converging to deterministic strategies, since the policy update rate approaches zero. We propose a new update rule that bounds this update rate such that, in pure NE game...
Article
Full-text available
Integration in the world of sport is one way for individuals with disabilities or motor disorders to feel more socially integrated, independent, and confident. Boccia is a Paralympic sport, which is increasingly getting more attention around the world. These facts have contributed to the objectives of this work. Including it in the serious games ca...
Article
Assuring the quality control of publications in the scientific literature is one of the main challenges of the peer review process. Consequently, there has been an increasing demand for computing solutions that will help to maintain the quality of this process. Recently, the use of Artificial Intelligence techniques has been highlighted, applied in...
Chapter
We are living in a world of information abundance, surplus, and access. We have technologies to acquire any type of information but we still face the challenge of extracting the underlying valuable knowledge. Data analyses and mining processes may be severely impaired whenever data are corrupted by noise, ambiguity and distortions.
Chapter
In a deeply interconnected world of people and goods, infectious diseases constitute a serious threat. An active vigilance is required. The collection of adequate data is vital and coordinated by surveillance systems. It is widely-acknowledged that every case-reporting system has some degree of under-reporting and reporting delay in particular in H...
Chapter
Surveillance has been defined as the continual scrutiny of all aspects in emerging and the spread of a disease that is pertinent to effective control, involving a systematic collection, analysis, interpretation, and dissemination of health data. Given their fragmentation several problems inherent to data must be recognized. This paper aims to provi...
Chapter
This work aims to present and summarize the identified main research fields about player engagement enhancement with video games. The expansion of video game diversity, complexity and applicability increased development costs. New approaches aim to automatize the design process by developing algorithms that can understand players requirements and r...
Chapter
Most modern solutions for video game balancing are directed towards specific games. We are currently researching general methods for automatic multiplayer game balancing. The problem is modeled as a meta-game, where game-play change the rules from another game. This way, a Machine Learning agent that learns to play a meta-game, learns how to change...