Zhaoyi Jiang

• Zhejiang Gongshang University

Self-supervised monocular depth estimation has opened up exciting possibilities for practical applications, including scene understanding, object detection, and autonomous driving, without the need for expensive depth annotations. However, traditional methods for single-image depth estimation encounter limitations in photometric loss due to a lack...

We present a novel framework that can generate plausible and diverse 3D (3 Dimensions) indoor scenes based on room floor plans and user-specified layout objects. In the framework, we construct a generative neural network with a non-autoregressive transformer to generate a reasonable distribution of layout objects, and then apply a fine-grained opti...

We present a novel framework that can generate plausible and diverse 3D (3 Dimensions) indoor scenes based on room floor plans and user-specified layout objects. In the framework, we construct a generative neural network with a non-autoregressive transformer to generate a reasonable distribution of layout objects, and then apply a fine-grained opti...

Deinterlacing is a classical issue in video processing, aimed at generating progressive video from interlaced content. There are precious videos that are difficult to reshoot and still contain interlaced content. Previous methods have primarily focused on simple interlaced mechanisms and have struggled to handle the complex artifacts present in rea...

A new automatic layout scheme for interior furniture is presented. According to user-specified furniture, an empty room region is divided into several functional areas by use of conditional generative adversarial networks. Each type of functional area can contain some categories of particular furniture objects, while each category of furniture belo...

Dynamic mesh sequence (DMS) is a simple and accurate representation for precisely recording a 3D animation sequence. Despite its simplicity, this representation is typically large in data size, making storage and transmission expensive. This paper presents a novel framework that allows effective DMS compression and progressive streaming by eliminat...

Mobile robots are useful for environment exploration and rescue operations. In such applications, it is crucial to accurately analyse and represent an environment, providing appropriate inputs for motion planning in order to support robot navigation and operations. 2D mapping methods are simple but cannot handle multilevel or multistory environment...

Mesh geometry can be used to model both object shape and details. If texture maps are involved, it is common to let mesh geometry mainly model object shapes and let the texture maps model the most object details, optimising data size and complexity of an object. To support efficient object rendering and transmission, model simplification can be app...

Different from common 2D images, when a texture map image is project to a 3D model in the 3D space, it also implicitly associates with certain 3D geometry information. However, existing common texture map image compression methods do not take this into account. In this paper, we present a visual importance driven selective compression method for te...

Realtime streaming 3D model over wireless network is a challenging proposition due to the characteristic of 3D progressive geometry data and wireless network. In this paper, we propose a perceptual-driven 3D progressive model selective transmission method. For the progressive model, the data including the base mesh and a series of vertex splits wil...

In this chapter, we propose a novel block effect reduction algorithm based on Model based compressive sensing (MCS). Block effect reduction can be considered as image recovery from a degraded image. It is exactly what compressive sensing does. According to MCS, our approach can catch the tree structured sparseness of natural images in wavelet domai...

This paper presents a new progressive mesh simplified algorithm for triangle meshes. We use smallest dihedral and shortest edge as principles for choosing collapsing edges to create progressive mesh. Our method did better in reducing the geometry deformation than some traditional methods like quadratic error measure of volume or distance. The way o...

Railway scene as an important traffic infrastructure usually plays a decisive role in land wars. In this paper, a high dynamic range imaging model is presented to simulate infrared railway scene. At first, a simple numeric model is proposed to calculate the temperature distribution of railway scene based on theoretical analysis of heat transfer. Th...

Imaging guiding and machine vision in the infrared (IR) of military targets on land backgrounds are an extensively studied subject. The railway scene as an important traffic infrastructure usually plays a decisive role in land wars. Real IR images are expensive to obtain, and many researchers cannot afford them. The solution to this problem is gene...

In remote sensing and military affairs, Infrared (IR) simulation of ocean scene has become more and more important nowadays. Stressing requirements for real-time IR scene generation include high performance and high precision. Although a lot of works present infrared simulations, those techniques cover only a few possible ways of water interacting...

Infrared (IR) image synthesis for ocean scene has become more and more important nowadays, especially for remote sensing and military application. Although a number of works present ready-to-use simulations, those techniques cover only a few possible ways of water interacting with the environment. And the detail calculation of ocean temperature is...

In this paper we propose a novel image corner detection method. We use a new feature "flatness" to help find corner at the base of SUSAN method. Our experiments show our method has good performance and it can reject some false corners reported by SUSAN method.

The sea surface as an important form of background usually plays a decisive role in sea applications. Real backgrounds are expensive while sea simulation can generate realistic images under various conditions. In this paper, a physics based model of infrared image synthesis for wind-ruffled sea is proposed. It consists of an integrated process base...

Although many virtual walkthrough system for visible scene have been carried out by now, little work has been reported about the virtual walkthrough of multi-spectral scene. In this paper, we present a virtual walkthrough system which can real-time simulate the dynamic multi-spectral scenes. We first construct the target and non-target areas with d...

Recently infrared signature simulation has been in a state of great interest. Although various models have been developed to generate synthetic image of infrared scenes, little work has been done to create high fidelity infrared image of bridge. In this paper a realistic model for infrared image synthesis of bridge based on its thermal energy trans...

A new model for realistic IR image rendering of city buildings was proposed in this paper. Within the model, We first analyzed the main kinds of factors affecting the infrared characteristic of city buildings such as air temperature, relative humidity, wind speed, sun and sky radiations. Then we established an energy equation based on principle of...

Recently infrared signature simulation has been in a state of great interest. Although various models have been developed to generate synthetic image of infrared scenes, little work has been done to create high fidelity infrared image of bridge. In this paper a realistic model for infrared image synthesis of bridge based on its thermal energy trans...

Recently infrared signature simulation has been in a state of great interest. Although various models have been developed to generate synthetic image of infrared scenes, little work has been done to create high fidelity infrared image of bridge. In this paper a realistic model for infrared image synthesis of bridge based on its thermal energy trans...

Although many models have been put forward to realize static infrared scene, they could not generate dynamic infrared scene real time in interactive way. In this paper a new method is proposed to solve the problem. We first model the targets and background of infrared scene based on the hybrid way of geometry and multi-spectral texture images. Then...

Most of current infrared image synthesis models mainly base on target's quantum self-radiation, they fail to simulate the infrared specular highlight effect and the infrared attenuation effect through atmosphere. This paper presents a new realistic image synthesis model for infrared scene. Within our model, we consider various kinds of infrared rad...

Most of infrared scene models deal with backgrounds, they can't simulate infrared urban scene. This paper presents a global infrared image synthesis model for large-scale complex urban scene which can be applied to various weather conditions and suitable for various parts of the urban scene. We first analysis the influence of all kinds of meteorolo...