Han Zou

• Ph.D.
• University of California, Berkeley

WiFi fingerprinting-based Indoor Positioning System (IPS) has become the most promising solution for indoor localization. However, there are two major drawbacks that hamper its large-scale implementation. Firstly, an offline site survey process is required which is extremely time-consuming and labor-intensive. Secondly, the RSS fingerprint database...

Indoor Positioning System (IPS) has become one of the most attractive research fields due to the increasing demands on Location Based Services (LBSs) in indoor environments. Various IPSs have been developed under different circumstances, and most of them adopt the fingerprinting technique to mitigate pervasive indoor multipath effects. However, the...

Buildings accounted for half of global electricity consumption in recent years. Accurate occupancy information could improve the energy efficiency and reduce the energy consumption in built environments. Although prior studies have explored various sensing techniques for occupancy sensing, these solutions still suffer from serious drawbacks, e.g. t...

Artificial lighting accounts for a significant proportion (19%) of energy consumption in building environments. This large contribution calls for the creation of energy-efficient lighting control schemes. In this article, we present WinLight, a novel occupancy-driven lighting control system that aims to reduce energy consumption while simultaneousl...

The location and contextual status (indoor or outdoor) is fundamental and critical information for upper-layer applications, such as activity recognition and location-based services (LBS) for individuals. In addition, optimizations of building management systems (BMS), such as the pre-cooling or heating process of the air-conditioning system accord...

Large Language Models (LLMs) have demonstrated remarkable capabilities across textual and visual domains but often generate outputs that violate physical laws, revealing a gap in their understanding of the physical world. Inspired by human cognition, where perception is fundamental to reasoning, we explore augmenting LLMs with enhanced perception a...

Road segmentation is essential to unmanned systems, contributing to road perception and navigation in the field of autonomous driving. While multi-modal road segmentation methods have shown promising results by leveraging the complementary data of RGB and Depth to provide robust 3D geometry information, existing methods suffer from severe efficienc...

In the metaverse, digital avatar plays an important role in representing human beings for various interaction with virtual objects and environments, which puts a high demand on effective pose estimation. Though camera-based solutions yield remarkable performance, they encounter privacy issues and degraded performance caused by varying illumination,...

4D human perception plays an essential role in a myriad of applications, such as home automation and metaverse avatar simulation. However, existing solutions which mainly rely on cameras and wearable devices are either privacy intrusive or inconvenient to use. To address these issues, wireless sensing has emerged as a promising alternative, leverag...

Over the recent years, WiFi sensing has been rapidly developed for privacy-preserving, ubiquitous human-sensing applications, enabled by signal processing and deep-learning methods. However, a comprehensive public benchmark for deep learning in WiFi sensing, similar to that available for visual recognition, does not yet exist. In this article, we r...

Device-free activity recognition plays a crucial role in smart building, security, and human–computer interaction, which shows its strength in its convenience and cost-efficiency. Traditional machine learning has made significant progress by heuristic hand-crafted features and statistical models, but it suffers from the limitation of manual feature...

As an important biomarker for human identification, human gait can be collected at a distance by passive sensors without subject cooperation, which plays an essential role in crime prevention, security detection and other human identification applications. At present, most research works are based on cameras and computer vision techniques to perfor...

Avatar refers to a representative of a physical user in the virtual world that can engage in different activities and interact with other objects in metaverse. Simulating the avatar requires accurate human pose estimation. Though camera-based solutions yield remarkable performance, they encounter the privacy issue and degraded performance caused by...

Unsupervised Domain Adaptation (UDA), a branch of transfer learning where labels for target samples are unavailable, has been widely researched and developed in recent years with the help of adversarially trained models. Although existing UDA algorithms are able to guide neural networks to extract transferable and discriminative features, classifie...

As an important biomarker for human identification, human gait can be collected at a distance by passive sensors without subject cooperation, which plays an essential role in crime prevention, security detection and other human identification applications. At present, most research works are based on cameras and computer vision techniques to perfor...

Deep neural networks have empowered accurate device-free human activity recognition, which has wide applications. Deep models can extract robust features from various sensors and generalize well even in challenging situations such as data-insufficient cases. However, these systems could be vulnerable to input perturbations, i.e. adversarial attacks...

Wi-Fi sensing technology has shown superiority in smart homes among various sensors for its cost-effective and privacy-preserving merits. It is empowered by channel state information (CSI) extracted from Wi-Fi signals and advanced machine learning models to analyze motion patterns in CSI. Many learning-based models have been proposed for kinds of a...

Unsupervised domain adaptation methods have been proposed to tackle the problem of covariate shift by minimizing the distribution discrepancy between the feature embeddings of source domain and target domain. However, the standard evaluation protocols assume that the conditional label distributions of the two domains are invariant, which is usually...

Deep models have achieved prominent results in pattern recognition tasks, especially computer vision and natural language processing. However, the dataset bias caused by the distribution discrepancy between the training and testing data hinders the generalization ability of deep models. Though many domain adaptation approaches have been proposed to...

The recyclability of domestic waste plays a crucial role in the modern society, which helps reduce multiple types of pollution and brings economic effect. To achieve this goal, garbage classification is one of the most important steps during the recycling process. Prevailing deep learning techniques empower high-performance visual recognition model...

Deep convolutional networks (CNNs) are able to learn robust representations and empower many computer vision tasks such as object recognition. However, when applying CNNs to industrial visual systems, they usually suffer from domain shift that exists between the training data and testing data. Such shift can be caused by different environment, type...

Adversarial domain adaptation has made tremendous success by learning domain-invariant feature representations. However, conventional adversarial training pushes two domains together and brings uncertainty to feature learning, which deteriorates the discriminability in the target domain. In this paper, we tackle this problem by designing a simple y...

Indoor localization has attracted more and more attention because of its importance in many applications. One of the most popular techniques for indoor localization is the received signal strength indicator (RSSI) based fingerprinting approach. Since RSSI values are very complicated and noisy, conventional machine learning algorithms often suffer f...

Domain adaptation tackles the problem of transferring knowledge from a label-rich source domain to a label-scarce or even unlabeled target domain. Recently domain-adversarial training (DAT) has shown promising capacity to learn a domain-invariant feature space by reversing the gradient propagation of a domain classifier. However, DAT is still vulne...

Location-based service (LBS) has become an indispensable part of our daily lives. Realizing accurate LBS in indoor environments is still a challenging task. WiFi fingerprinting-based indoor positioning system (IPS) achieves encouraging results recently, but the time and labor overhead of constructing a dense WiFi radio map remain the key bottleneck...

Deep neural networks (DNNs) have made significant advances in computer vision and sensor-based smart sensing. DNNs achieve prominent results based on standard datasets and powerful servers, whereas in real applications with domain-shift data and resource-constrained environments such as Internet of Things (IoT) devices in the edge computing, DNNs a...

We propose a gesture recognition system that leverages existing WiFi infrastructures and learns gestures from Channel State Information (CSI) measurements. Having developed an innovative OpenWrt-based platform for commercial WiFi devices to extract CSI data, we propose a novel deep Siamese representation learning architecture for one-shot gesture r...

We propose a novel domain adaptation framework, namely Consensus Adversarial Domain Adaptation (CADA), that gives freedom to both target encoder and source encoder to embed data from both domains into a common domaininvariant feature space until they achieve consensus during adversarial learning. In this manner, the domain discrepancy can be furthe...

In the research of smart buildings, human activity recognition is an important cornerstone for numerous emerging applications. Although several sensing techniques have been proposed for human activity identification, they require either the user instrumentation or additional infrastructure, that are inconvenient, privacy-intrusive and expensive. To...

We propose a novel domain adaptation framework, namely Consensus Adversarial Domain Adaptation (CADA), that gives freedom to both target encoder and source encoder to embed data from both domains into a common domain-invariant feature space until they achieve consensus during adversarial learning. In this manner, the domain discrepancy can be furth...

A fundamental building block towards personalized location-based service and context-aware service in smart buildings is the knowledge about the identity and mobility of users in indoor environments. Conventional user identification systems require the deployment of dedicated infrastructure or the active user involvement. Motivated by the widesprea...

With the unprecedented advancement of Internet of Things (IoT), automatic occupant activity recognition is becoming realizable for a myriad of emerging applications in smart buildings for energy efficiency and user experience enhancement. Existing activity recognition approaches require either the deployment of extra infrastructure or the cooperati...

Precise occupancy information is extremely valuable for energy savings and optimization in the built environment. Building management systems (BMSs) can automatically turn off the HVAC systems in unoccupied spaces and adjust the ventilation rate based on the number of occupants in each zone for energy saving. Popular commercial occupancy detection...

Intelligent occupancy sensing is becoming a vital underpinning for various emerging applications in smart homes, such as security surveillance and human behavior analysis. However, prevailing approaches mainly rely on video camera, ambient sensors or wearable devices, which either requires arduous deployment or arouses privacy concerns. In this pap...

With the unprecedented advancement of sensing technology, smart city applications now have access to rich measurement data related to system dynamics, states, and the behavior of its users. However, classic data analysis or machine learning tools ignore some unique characteristics of the multi-stream measurement data, in particular, the co-existenc...

Sedentary Behavior (SB) has been proved to be important risk factor for poor health, such as blood pressure and even cancer. However, existing sensor and vision-based SB detection approaches have limitations on practical usage and privacy concerns respectively. In this paper, we take the first attempt to develop a device-free SB monitoring and reco...

A building’s environment has profound influence on occupant comfort and health. Continuous monitoring of building occupancy and environment is essential to fault detection, intelligent control, and building commissioning. Though many solutions for environmental measuring based on wireless sensor networks exist, they are not easily accessible to hou...

In this study we consider the problem of outlier detection with multiple co-evolving time series data. To capture both the temporal dependence and the inter-series relatedness, a multi-task non-parametric model is proposed, which can be extended to data with a broader exponential family distribution by adopting the notion of Bregman divergence. Alb...

We propose AutoID, a human identification system that leverages the measurements from existing WiFi-enabled Internet of Things (IoT) devices and produces the identity estimation via a novel sparse representation learning technique. The key idea is to use the unique fine-grained gait patterns of each person revealed from the WiFi Channel State Infor...

Detecting dangerous riding behaviors is of great importance to improve bicycling safety. Existing bike safety precautionary measures rely on dedicated infrastructures that incur high installation costs. In this work, we propose BikeMate, a ubiquitous bicycling behavior monitoring system with smartphones. BikeMate invokes smartphone sensors to infer...

Predicting blood glucose dynamics is vital for people to take preventive measures in time against health risks. Previous efforts adopt handcrafted features and design prediction models for each person, which result in low accuracy due to ineffective feature representation and the limited training data. This work proposes MT-LSTM, a multi-time-serie...

Existing human activity recognition approaches require either the deployment of extra infrastructure or the cooperation of occupants to carry dedicated devices, which are expensive, intrusive and inconvenient for pervasive implementation. In this paper, we propose SmartSense, a device-free human activity recognition system based on a novel machine...

Inferring abnormal glucose events such as hyperglycemia and hypoglycemia is crucial for the health of both diabetic patients and non-diabetic people. However, regular blood glucose monitoring can be invasive and inconvenient in everyday life. We present SugarMate, a first smartphone-based blood glucose inference system as a temporary alternative to...

Existing WiFi fingerprinting-based Indoor Positioning System (IPS) suffers from the vulnerability of environmental dynamics. To address this issue, we propose TKL-WinSMS as a systematic strategy, which is able to realize robust and adaptive localization in dynamic indoor environments. We developed a WiFi-based Non-intrusive Sensing and Monitoring S...

Pedestrian dead reckoning (PDR) is a promising complementary technique to balance the requirements on both accuracy and costs in outdoor and indoor positioning systems. In this paper, we propose a unified framework to comprehensively tackle the three sub problems involved in PDR, including step detection and counting, heading estimation and step le...

Estimating an occupant's location is arguably the most fundamental sensing task in smart buildings. The applications for fine-grained, responsive building operations require the location sensing systems to provide location estimates in real time, also known as indoor tracking. Existing indoor tracking systems require occupants to carry specialized...

Estimating an occupant's location is arguably the most fundamental sensing task in smart buildings. Existing indoor tracking systems require occupants to carry specialized devices or install programs on their smartphones to collect inertial sensing data. In this paper, we propose MapSentinel, which performs non-intrusive location sensing based on W...

WiFi based Indoor Positioning System (IPS) has become the most popular and practical system to provide Location Based Service (LBS) in indoor environments due to the availability of massive existing WiFi network infrastructures in buildings. WiFi based IPSs leverage received signal strengths (RSSs) from large numbers of WiFi access points (APs) and...

We present the results, experiences and lessons learned from comparing a diverse set of technical approaches to indoor localization during the 2014 Microsoft Indoor Localization Competition. 22 different solutions to indoor localization from different teams around the world were put to test in the same unfamiliar space over the course of 2 days, al...

Nowadays, developing indoor positioning systems (IPSs) has become an attractive research topic due to the increasing demands on location-based service (LBS) in indoor environments. WiFi technology has been studied and explored to provide indoor positioning service for years in view of the wide deployment and availability of existing WiFi infrastruc...

Location-based services (LBS) have attracted a great deal of attention recently. Outdoor localization can be solved by the GPS technique, but how to accurately and efficiently localize pedestrians in indoor environments is still a challenging problem. Recent techniques based on WiFi or pedestrian dead reckoning (PDR) have several limiting problems,...

The increasing demands of location-based services have spurred the rapid development of indoor positioning system and indoor localization system interchangeably (IPSs). However, the performance of IPSs suffers from noisy measurements. In this paper, two kinds of robust extreme learning machines (RELMs), corresponding to the close-to-mean constraint...

Extreme learning machine (ELM) as an emergent technology has shown its good performance in regression applications as well as in large dataset classification applications. It has been broadly embedded in many applications due to its fast speed of computation and accuracy. How to make good use of machine learning techniques in Indoor Positioning Sys...

We propose two kinds of robust extreme learning machines (RELMs) based on the close-to-mean constraint and the small-residual constraint respectively to solve the problem of noisy measurements in indoor positioning systems (IPSs). We formulate both RELMs as second order cone programming problems. The fact that feature mapping in ELM is known to use...

A building's environment has profound influence on occupant comfort and health. Continuous monitoring of building occupancy and environment is essential to fault detection, intelligent control, and building commissioning. Though many solutions for environmental measuring based on wireless sensor networks exist, they are not easily accessible to hou...

In recent years, developing Indoor Positioning System (IPS) has become an attractive research topic due to the increasing demands on Location-Based Service (LBS) in indoor environment. Several advantages of Radio Frequency Identification (RFID) Technology, such as anti-interference, small, light and portable size of RFID tags, and its unique identi...

We present results from a set of experiments in this pilot study to investigate the causal influence of user activity on various environmental parameters monitored by occupant carried multi-purpose sensors. Hypotheses with respect to each type of measurements are verified, including temperature, humidity, and light level collected during eight typi...

This article describes a method for indoor positioning of human-carried active Radio Frequency Identification (RFID) tags based on the Sampling Importance Resampling (SIR) particle filtering algorithm. To use particle filtering methods, it is necessary to furnish statistical state transition and observation distributions. The state transition distr...

Developing Indoor Positioning System (IPS) has become an attractive research topic due to the increasing demands on Location Based Service (LBS) in indoor environment recently. WiFi technology has been studied and explored to provide indoor positioning service for years since existing WiFi infrastructures in indoor environment can be used to greatl...

In recent years, applying RFID technology to develop an Indoor Positioning System (IPS) has become a hot research topic. The most prominent advantage of active RFID IPS comes from its unique identification of different objects in indoor environment. However, certain drawbacks of existing RFID IPSs, such as high cost of RFID readers and active tags,...

Radio Frequency Identification (RFID) technology has been widely used in many application domains. How to apply RFID technology to develop an Indoor Positioning System (IPS) has become a hot research topic in recent years. LANDMARC approach is one of the first IPSs by using active RFID tags and readers to provide location based service in indoor en...