Xin Jin

Xin Jin
Beijing Electronic Science and Technology Institute · Computer Science and Technology

PhD

About

103
Publications
13,025
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
1,001
Citations
Additional affiliations
July 2006 - June 2013
Beihang University (BUAA)
Position
  • PhD Student

Publications

Publications (103)
Article
Nowadays, the portrait image aesthetic attribute evaluation is extremely valuable in the research area, but there is no either specialized portrait image aesthetic attribute dataset or specialized portrait image aesthetic dataset. At the same time, the lightweight image aesthetic attribute evaluation model is also valuable in the market. In this pa...
Preprint
Full-text available
Aesthetic assessment of images can be categorized into two main forms: numerical assessment and language assessment. Aesthetics caption of photographs is the only task of aesthetic language assessment that has been addressed. In this paper, we propose a new task of aesthetic language assessment: aesthetic visual question and answering (AVQA) of ima...
Preprint
Full-text available
With the vigorous development of mobile photography technology, major mobile phone manufacturers are scrambling to improve the shooting ability of equipments and the photo beautification algorithm of software. However, the improvement of intelligent equipments and algorithms cannot replace human subjective photography technology. In this paper, we...
Preprint
Full-text available
Image aesthetic quality assessment is popular during the last decade. Besides numerical assessment, nature language assessment (aesthetic captioning) has been proposed to describe the generally aesthetic impression of an image. In this paper, we propose aesthetic attribute assessment, which is the aesthetic attributes captioning, i.e., to assess th...
Preprint
Full-text available
In recent years, image generation has made great strides in improving the quality of images, producing high-fidelity ones. Also, quite recently, there are architecture designs, which enable GAN to unsupervisedly learn the semantic attributes represented in different layers. However, there is still a lack of research on generating face images more c...
Article
There are many tasks on image aesthetic assessment, such as aesthetic classification, scoring, score distribution prediction, and captions. Due to the distribution of the aesthetic score is unbalanced, the assessment models always output scores near the mean score. In this paper, we propose a fine-grained regression method for aesthetics score regr...
Preprint
Full-text available
With the continuous development of social software and multimedia technology, images have become a kind of important carrier for spreading information and socializing. How to evaluate an image comprehensively has become the focus of recent researches. The traditional image aesthetic assessment methods often adopt single numerical overall assessment...
Article
Automatic ultrasound image segmentation plays an important role in early diagnosis of human diseases. This paper introduces a novel and efficient encoder–decoder network, called Lightweight Attention Encoder–Decoder Network (LAEDNet), for automatic ultrasound image segmentation. In contrast to previous encoder–decoder networks that involve complica...
Article
Full-text available
When taking photos of a suspicious missing child in the street and posting them to the social network is becoming a feasible way to find missing children, the exposure of photos may cause privacy issues. To address this problem, we propose Double-Blinded Finder, an efficient and double-blinded system for finding missing children via low-dimensional...
Preprint
Full-text available
In the tasks of image aesthetic quality evaluation, it is difficult to reach both the high score area and low score area due to the normal distribution of aesthetic datasets. To reduce the error in labeling and solve the problem of normal data distribution, we propose a new aesthetic mixed dataset with classification and regression called AMD-CR, a...
Preprint
Full-text available
In industry, there exist plenty of scenarios where old gray photos need to be automatically colored, such as video sites and archives. In this paper, we present the HistoryNet focusing on historical person's diverse high fidelity clothing colorization based on fine grained semantic understanding and prior. Colorization of historical persons is real...
Article
How to realize data transmission between Intranet and extranet devices in physical isolation is an important problem. QR code can be used to identify text, image information, can be used as a carrier of information exchange. In this paper, QR code technology is used to propose a data transmission system between the Internet and the Internet under t...
Article
For indoor scenes, the fourth-order spherical harmonic function is used to model the illumination, resulting in that 48 spherical harmonic coefficients are used to represent the whole scene. The illumination contained in the low dynamic range image is insufficient, so high dynamic range environment maps are adopted in this part, and the aim is to p...
Article
When inserting a virtual object into an outdoor image, the recovery of sun orientation has a critical effect on the fusion of virtual objects and real scenes. For the problem of sun orientation estimation from a single outdoor image, a new end-to-end learning method is proposed in this paper. A luminance channel of sky region is introduced into the...
Article
With the development of big data technology, privacy protection of computer vision algorithm has become a hot research field. To protect privacy of both terminal and cloud in the object detection algorithm, Jin et al. proposed a method to represent an image with multiple random sub-images. The cloud detects objects from these random sub-images inst...
Chapter
Face images contain rich and diverse information and have become the focus of research in the field of computer vision. The current research on facial images includes facial recognition, facial image makeup transfer, facial image segmentation, facial image illumination transfer, facial image beautification and rendering. Among them, the illuminatio...
Article
Full-text available
Viola-Jones algorithm (Viola and Jones 2001; Int J Comput Vis 57(2):137–154, 2004) is a milestone in the development of face detection technology. It greatly improves the efficiency of face detection on the premise of ensuring the accuracy, which indicates that the research results in the field of computer vision have the ability to put into practi...
Article
Full-text available
The huge computational overhead limits the inference of convolutional neural networks on mobile devices for object detection, which plays a critical role in many real-world scenes, such as face identification, autonomous driving, and video surveillance. To solve this problem, this paper introduces a lightweight convolutional neural network, called...
Article
Full-text available
With the development of deep learning technology, many deep learning methods have been applied to font recognition and generation. However, few studies focus on font inpainting problems. This paper is dedicated to repairing damaged fonts based on style to repair damaged fonts in a better way. In this paper, we propose a CGAN (Conditional Generative...
Preprint
Full-text available
With the development of cloud computing, the storage and processing of massive visual media data has gradually transferred to the cloud server. For example, if the intelligent video monitoring system cannot process a large amount of data locally, the data will be uploaded to the cloud. Therefore, how to process data in the cloud without exposing th...
Preprint
The task of aesthetic quality assessment is complicated due to its subjectivity. In recent years, the target representation of image aesthetic quality has changed from a one-dimensional binary classification label or numerical score to a multi-dimensional score distribution. According to current methods, the ground truth score distributions are str...
Article
Full-text available
Nowadays, more and more people choose to upload their data and information to cloud. The cloud saves users’ data and information and starts providing computing services and artificial intelligence analysis. However, the privacy of users’ information and data will be completely exposed to the cloud without any protection. In this paper, we propose t...
Article
The image-based virtual illumination technology directly changes the illumination effect of objects on the image. It does not require complex light propagation simulation calculations, it is an image-based rendering technology. The image mainly relies on the imaging of the visual sensor, and uses the virtual illumination technology of the image to...
Article
Full-text available
With the increasing popularity of multimedia data on the internet and our daily life, the way people get information is becoming more diverse, video is becoming an important part of our dailylife and work. At the same time, the popularity of video also brings new security risks and challenges, more and more people are paying attention to video secu...
Article
Full-text available
Complex object illumination transfer is a special challenge in computer vision. In our paper, we put forward a method for complex object illumination transfer. Firstly, the input object image was divided into object components by semantic analysis, to find the reference object images consistent with the object component material in the physical wor...
Chapter
Complex object illumination transfer presents a particular challenge in computer vision. We took up the challenge and proposed a novel complex object illumination transfer method through semantic and material parsing and composition. Firstly, we parsed the subject complex object into several parts through semantic parsing. We could easier match sim...
Chapter
Posting photos of suspected missing children on the street and posting them to social networks can help find missing children, but posting them to the Internet without protection may create privacy issues. In order to solve this problem, we propose Double-Blinded Finder, which is mainly used for low-dimensional multi-attribute matching of children’...
Article
With the development of cloud computing, the storage and processing of massive visual media data has gradually transferred to the cloud server. For example, if the intelligent video monitoring system cannot process a large amount of data locally, the data will be uploaded to the cloud. Therefore, how to process data in the cloud without exposing th...
Article
Full-text available
When a virtual object is inserted into an outdoor image, the recovery of scene illumination has a critical effect on the mix of virtual objects and actual reality. There are two main parts of the object in the outdoor scene: the sun and the sky. In order to represent the illumination conditions of these two natural illumination, this paper uses the...
Article
Full-text available
The aesthetic quality assessment of image is a challenging work in computer vision field. The recent research work used the deep convolutional neural network to evaluate the aesthetic quality of images. However, the score of image data sets has a strongly normal distribution, which makes the training of neural network easy to be over-fitting. In ad...
Article
Full-text available
Image completion has always been an important research area of image processing. With the continuous development of the deep learning model in recent years, further progress has been made in the repair of images. In this paper, we focused on realistic and painting portrait data, studied on semantic inpainting techniques based on regional completion...
Article
Full-text available
Nowadays, with the maturity and wide application of face recognition technology, the recognition accuracy, recognition efficiency, and data security have attracted people’s attention. However, when face recognition is performed, face information is completely exposed to the cloud server without any protection measures. Therefore, a series of proble...
Article
In spite of great success in many image recognition tasks achieved by recent deep models, directly applying them to recognize low-resolution images may suffer from low accuracy due to the missing of informative details during resolution degradation. However, these images are still recognizable for subjects who are familiar with the corresponding hi...
Chapter
The illumination effect is essential for the realistic results in images which are created by inserting virtual objects into real scene. For outdoor scenes, automatic estimation of sun orientation condition from a single outdoor image is fundamental for inserting 3D models to a single image. Traditional methods for outdoor sun orientation estimatio...
Chapter
The aesthetic quality assessment of image is a challenging work in computer vision field. The recent research work used the deep convolutional neural network to evaluate the aesthetic quality of images. However, the score of image data sets has a strongly normal distribution, which makes the training of neural network easy to be over-fitting. In ad...
Chapter
Occluded face recognition, which has an attractive application in the visual analysis field, is challenged by the missing cues due to heavy occlusions. Recently, several face inpainting methods based on generative adversarial networks (GANs) fill in the occluded parts by generating images fitting the real image distributions. They can lead to a vis...
Article
Full-text available
It is difficult and challenging to evaluate the aesthetics quality of images from multiple angles. Since humans’ perception of images comes from many factors, the integrated image aesthetic quality assessment cannot be easily summarized by few attributes. A comprehensive evaluation is supposed to predict many aesthetic attributes across not only on...
Article
Full-text available
Recently, cloud storage and processing have been widely adopted. Mobile users in one family or one team may automatically backup their photos to the same shared cloud storage space. The powerful face detector trained and provided by a 3rd party may be used to retrieve the photo collection which contains a specific group of persons from the cloud st...
Article
We propose a novel AR CAPTCHA that first uses Augmented Reality to design CAPTCHA. Users should use their cameras on mobile devices to capture a marker in the 3D physical world or PC screens to find the appropriate angle to recognize each 3D character rendered on the marker in a 3D registration manner, which is very hard for machines or robots to d...
Chapter
The recent years have witnessed great advances for semantic segmentation using deep convolutional neural networks (DCNNs). However, a large number of convolutional layers and feature channels lead to semantic segmentation as a computationally heavy task, which is disadvantage to the scenario with limited resources. In this paper, we design an effic...
Conference Paper
Convolutional neural networks (CNNs) have shown vulnerable to adversarial examples which contain imperceptible perturbations. In this paper, we propose an approach to defend against adversarial examples with soft decision trees embedding. Firstly, we extract the semantic features of adversarial examples with a feature extraction network. Then, a sp...
Conference Paper
Image aesthetic quality assessment has been a relatively hot topic during the last decade. Most recently, comments type assessment (aesthetic captions) has been proposed to describe the general aesthetic impression of an image using text. In this paper, we propose Aesthetic Attributes Assessment of Images, which means the aesthetic attributes capti...
Preprint
Image aesthetic quality assessment has been a relatively hot topic during the last decade. Most recently, comments type assessment (aesthetic captions) has been proposed to describe the general aesthetic impression of an image using text. In this paper, we propose Aesthetic Attributes Assessment of Images, which means the aesthetic attributes capti...
Preprint
To meet the women appearance needs, we present a novel virtual experience approach of facial makeup transfer, developed into windows platform application software. The makeup effects could present on the user's input image in real time, with an only single reference image. The input image and reference image are divided into three layers by facial...
Article
Full-text available
To meet the women appearance needs, we present a novel virtual experience approach of facial makeup transfer, developed into windows platform application software. The makeup effects could present on the user’s input image in real time, with an only single reference image. The input image and reference image are divided into three layers by facial...
Chapter
The aesthetic quality assessment of images is a challenging work in the field of computer vision because of its complex subjective semantic information. The recent research work can utilize the deep convolutional neural network to evaluate the overall score of the image. However, the focus in the field of aesthetic is often not limited to the total...
Chapter
Recent deep trackers have achieved impressive performance in visual tracking. Typically, these trackers apply complex deep networks with massive parameters for representing objects, which makes their deployment on resource-limited devices very challenging due to two reasons: (1) high computation complexity, and (2) high storage footprint. To addres...
Article
Full-text available
Image relighting is to change the illumination of an image to a target illumination effect without known the original scene geometry, material information and illumination condition. We propose a novel outdoor scene relighting method, which needs only a single reference image and is based on material constrained layer decomposition. Firstly, the ma...
Article
The illumination effect is essential for the realistic results in images which are created by inserting virtual objects into real scene. For outdoor scenes, automatic estimation of sun orientation condition from a single outdoor image is fundamental for inserting 3D models to a single image. Traditional methods for outdoor sun orientation estimatio...
Article
In this study, the authors address a challenging problem of aesthetic image classification, which is to label an input image as high- or low-aesthetic quality. We take both the local and global features of images into consideration. A novel deep convolutional neural network named ILGNet is proposed, which combines both the inception modules and a c...
Article
Full-text available
To protect the contents of images in the mobile internet era during image storage and transmission, image encryption has achieved a tremendous success during the last decades. Traditional color image encryption method often use the RGB color space. We have the observation that in non-RGB color spaces, the luminance channels often contain more infor...