Bei Xiao

Bei Xiao
American University Washington D.C. | AU · Department of Computer Science

PHD

About

40
Publications
8,281
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
806
Citations
Introduction
Perception of physical properties of objects from images and videos.
Additional affiliations
January 2014 - present
American University
Position
  • Professor (Assistant)
Description
  • CSC 589 Introduction to Computer Vision CSC 280 Introduction to Programming CSC 435 Web Programming
December 2010 - January 2014
Massachusetts Institute of Technology
Position
  • PostDoc Position
Description
  • Design and conduct behavioral experiments to understand human perception of object material properties
January 2009 - November 2010
Smith-Kettlewell Eye Research Institute
Position
  • PostDoc Position
Description
  • Conducted steady-state EEG experiments to understand early visual processing of color signals.

Publications

Publications (40)
Conference Paper
Full-text available
Semantic Inpainting on Segmentation Map (SISM) aims to manipulate segmentation maps by semantics. Providing structural assistance, segmentation maps have been broadly used as intermediate interfaces to achieve better image manipulation. We improve the SISM by considering the unique characteristics of segmentation maps in the both training and testi...
Article
Full-text available
The colors that people see depend not only on the surface properties of objects but also on how these properties interact with light as well as on how light reflected from objects interacts with an individual’s visual system. Because individual visual systems vary, the same visual stimulus may elicit different perceptions from different individuals...
Article
Full-text available
The uncertainty measurement of classified results is especially important in areas requiring limited human resources for higher accuracy. For instance, data-driven algorithms diagnosing diseases need accurate uncertainty score to decide whether additional but limited quantity of experts are needed for rectification. However, few uncertainty models...
Preprint
Full-text available
Semantic editing on segmentation map has been proposed as an intermediate interface for image generation, because it provides flexible and strong assistance in various image generation tasks. This paper aims to improve quality of edited segmentation map conditioned on semantic inputs. Even though recent studies apply global and local adversarial lo...
Article
Full-text available
When judging the optical properties of a translucent object, humans often look at sharp geometric features such as edges and thin parts. An analysis of the physics of light transport shows that these sharp geometries are necessary for scientific imaging systems to be able to accurately measure the underlying material optical properties. In this art...
Preprint
Full-text available
Color Constancy entry for Springer encyclopedia of color science and technology
Preprint
Full-text available
When judging optical properties of a translucent object, humans often look at sharp geometric features such as edges and thin parts. Analysis of the physics of light transport shows that these sharp geometries are necessary for scientific imaging systems to be able to accurately measure the underlying material optical properties. In this paper, we...
Article
Full-text available
Cloth is a common material, and humans can visually estimate its mechanical properties by observing how it deforms under external forces. Here, we ask whether and how dynamic deformation can affect the perception of mechanical properties of cloth. In Experiment 1, we find that both intrinsic mechanical properties and optical properties affect stiff...
Preprint
Full-text available
Cloth is a common material and humans can visually estimate its mechanical properties by observing how it deforms under external forces. Here we ask whether, and how, dynamic deformation can affect the perception of mechanical properties of cloth. In Experiment 1, we find that both intrinsic mechanical properties and optical properties affect stiff...
Article
Full-text available
Although product photos and movies are abundantly present in online shopping environments, little is known about how much of the real product experience they capture. While previous studies have shown that movies or interactive imagery give users the impression that these communication forms are more effective, there are no studies addressing this...
Conference Paper
Full-text available
We use force-feedback device and a game engine to measure the effects of material appearance on the perception of mass of virtual objects. We discover that the perceived mass is mainly determined by the ground-truth mass output by the force-feedback device. Different from the classic Material Weight Illusion (MWI), however, heavy-looking objects (e...
Preprint
Full-text available
We use force-feedback device and a game engine to measure the effects of material appearance on the perception of mass of virtual objects. We discover that the perceived mass is mainly determined by the ground-truth mass output by the force-feedback device. Different from the classic Material Weight Illusion (MWI), however, heavy-looking objects (e...
Preprint
Full-text available
One unsolved question in material perception is how visual appearance (e.g. material properties) interacts with haptic (touch) information. We present a pick-and-place task using force-feedback haptic device together with a game engine to measure the influence of visual appearance on the perceived mass of virtual objects. We discover that participa...
Article
Full-text available
Humans can visually estimate the mechanical properties of deformable objects (e.g., cloth stiffness). While much of the recent work on material perception has focused on static image cues (e.g., textures and shape), little is known about whether humans can integrate information over time to make a judgment. Here we investigated the effect of spatio...
Preprint
Full-text available
4 Humans can visually estimate the mechanical properties of deformable objects (e.g. cloth stiffness). While much of the 5 recent work on material perception has focused on static image cues (e.g., textures and shape), little is known whether 6 humans can integrate information over time to make a judgment. Here, we investigate the effect of spatiot...
Preprint
Full-text available
Humans can visually estimate the mechanical properties of deformable objects (e.g. cloth stiffness). While much of the recent work on material perception has focused on static image cues (e.g., textures and shape), little is known whether humans can integrate information over time to make a judgment. Here, we investigate the effect of spatiotempora...
Article
Full-text available
There are many circumstances in which we are unable to touch an object, for example during online shopping. This can be a serious problem when the haptic qualities are an important aspect of the product experience. Here, we investigated whether this inability to touch can be alleviated by using a visual substitute. In Experiment 1, we measured visu...
Conference Paper
Full-text available
Deformable objects such as cloth exhibit their mechanical properties (e.g. stiffness) through shape deformation over time under external forces. Mechanical properties are important because they tell us the affordance of the object and helps us predict what type of action can be done upon it. Previous research shows that motion statistics can be use...
Article
Full-text available
Humans can often estimate tactile properties of objects from vision alone. For example, during online shopping, we can often infer material properties of clothing from images and judge how the material would feel against our skin. What visual information is important for tactile perception? Previous studies in material perception have focused on me...
Chapter
Full-text available
Article
Deformable objects such as fabrics, rubber, and food can be distinguished by their textures, and also by the different motions they exhibit when interacting with external forces. These motion patterns can be used to estimate the intrinsic mechanical properties of the objects (Bouman et al 2013). Little is known however about human perception of mec...
Article
Full-text available
Translucency is an important aspect of material appearance. To some extent, humans are able to estimate translucency in a consistent way across different shapes and lighting conditions, i.e., to exhibit translucency constancy. However, Fleming and Bülthoff (2005) have shown that that there can be large failures of constancy, with lighting direction...
Article
Full-text available
RenderToolbox3 provides MATLAB utilities and prescribes a workflow that should be useful to researchers who want to employ graphics in the study of vision and perhaps in other endeavors as well. In particular, RenderToolbox3 facilitates rendering scene families in which various scene attributes and renderer behaviors are manipulated parametrically,...
Article
Full-text available
Commercial off-the-shelf digital cameras are inexpensive and easy-to-use instruments that can be used for quantitative scientific data acquisition if images are captured in raw format and processed so that they maintain a linear relationship with scene radiance. Here we describe the image-processing steps required for consistent data acquisition wi...
Conference Paper
Full-text available
Bendable ←−−−−−−−−−−−−−−−−−−−−−−−−− Bending Stiffness −−−−−−−−−−−−−−−−−−−−−−−−−→ Stiff Figure 1. A sample of the fabrics in our collected database ranked according to stiffness predicted by our model. The top panel shows physical fabric samples hanging from a rod. The bottom panel shows a horizontal space × time slice of a video when the fabrics ar...
Article
Full-text available
Multiple scattering contributes critically to the characteristic translucent appearance of food, liquids, skin, and crystals; but little is known about how it is perceived by human observers. This article explores the perception of translucency by studying the image effects of variations in one factor of multiple scattering: the phase function. We...
Article
Material perception is typically studied by asking for verbal judgments about properties like gloss. But words are limited. When you shop online for clothing, the picture wordlessly conveys haptic information. By looking at the picture you can (hopefully) predict how the fabric will act and feel. The ability to make such predictions is an important...
Article
Full-text available
Natural materials such as skin, soap, jade, and wax, look translucent because light scatters inside them. Though humans are skilled at discriminating subtle differences in translucent appearance, little is known about translucency perception. We study how translucency perception is related to scattering parameters and object geometry, by measuring...
Article
Full-text available
Human color constancy has been studied for over 100 years, and there is extensive experimental data for the case where a spatially diffuse light source illuminates a set of flat matte surfaces. In natural viewing, however, three-dimensional objects are viewed in three-dimensional scenes. Little is known about color constancy for three-dimensional o...
Article
Cortical responses to spatially discrete patches of achromatic luminance contrast can be altered by the presence of high-contrast, spatially remote "surrounds" and this achromatic "surround suppression" has been the subject of much recent research. However, the nature of long-range contrast normalization in chromatic signals has been less studied....
Article
Full-text available
Two experiments explore the color perception of objects in complex scenes. The first experiment examines the color perception of objects across variation in surface gloss. Observers adjusted the color appearance of a matte sphere to match that of a test sphere. Across conditions we varied the body color and glossiness of the test sphere. The data i...
Article
Full-text available
Vision is difficult because images are ambiguous about the structure of the world. For object color, the ambiguity arises because the same object reflects a different spectrum to the eye under different illuminations. Human vision typically does a good job of resolving this ambiguity-an ability known as color constancy. The past 20 years have seen...
Article
Full-text available
What determines the color appearance of real objects viewed under natural conditions? The light reflected from different locations on a single object can vary enormously. This variation is enhanced when the material properties of the object are changed from matte to glossy. Yet humans have no trouble assigning a color name to most things. We studie...

Questions

Question (1)
Question
I need a dataset of food items. Prefer one object per photo. Any hints are helpful.

Network

Cited By

Projects

Projects (3)
Project
Inference of mechanical properties of cloth from animations and videos