Sergey Zheltov

Sergey Zheltov
GosNIIAS | GosNIIAS

Prof.

About

87
Publications
6,680
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
283
Citations
Introduction
Sergey Zheltov currently works at GosNIIAS. Sergey does research in Automotive Systems Engineering, Optical Engineering and Aerospace Engineering. Their most recent publication is 'Vision-Based Change Detection Using Comparative Morphology'.

Publications

Publications (87)
Article
Full-text available
A lot of image matching applications require image comparison to be invariant relative to intensity values variations. The Pyt’ev theory for Morphological Image Analysis (MIA) was developed based on image-to-shape matching with mosaic shape models. Within the framework of this theory, the problem of shape-to-shape comparison was previously consider...
Article
Full-text available
The latest advances in technical characteristics of unmanned aerial systems (UAS) and their onboard sensors opened the way for smart flying vehicles exploiting new application areas and allowing to perform missions seemed to be impossible before. One of these complicated tasks is the 3D reconstruction and monitoring of large-size, complex, grid-lik...
Article
Full-text available
Objects and structures realized by connecting and bending wires are common in modern architecture, furniture design, metal sculpting, etc. The 3D reconstruction of such objects with traditional range- or image-based methods is very difficult and poses challenges due to their unique characteristics such as repeated structures, slim elements, holes,...
Article
In this paper we propose and consider different metric approaches to image comparison based on Morpho-Semantic (MS) and Semantic-Morphological (SM) models. The first proposed class-based approach presumes the embedding of MS and SM models to the metric space with weighted Lp metrics. This approach is based on representation of SM models as mosaic v...
Article
Full-text available
A general approach to a structure-functional analysis and synthesis (SFAS) of deep neural networks (CNN). The new approach allows to define regularly: from which structure-functional elements (SFE) CNNs can be constructed; what are required mathematical properties of an SFE; which combinations of SFEs are valid; what are the possible ways of develo...
Article
Full-text available
Speech of the RAS academician S.YU. Zheltov
Article
Full-text available
In a previous work, we proposed a Comparative Morphology (CM) construction scheme that generalized Pytyev's Morphological Image Analysis approach onto a wider range of practical image comparison applications. Within a Guided Contrasting framework, a filtering procedure and a related change detection algorithm were developed. In this work, we propo...
Chapter
The chapter addresses the theoretical and practical aspects of the scene change detection problem with the use of computer vision techniques. It means detecting new or disappeared objects in images registered at different moments of time and possibly in various lighting, weather, and season conditions. In this chapter, we propose the new scheme of...
Article
This article, based on a paper heard at a meeting of the RAS Presidium, analyzes the main problems of and trends in the intellectualization of state-of-the-art aviation complexes. The obtaining and intelligent processing of heterogeneous information, intelligent management, and aircraft “self-sensing,” as well as intelligent interaction within the...
Article
A computational technology for constructing the optimal shape of a power plant three-dimensional blade assembly is presented. The shape of the blade assembly is optimized to improve the power characteristics of the blade assembly taking into account structural constraints. The computational technology is a unified chain of algorithms beginning with...
Article
Full-text available
Change detection scheme based on guided contrasting was previously proposed. Guided contrasting filter takes two images (test and sample) as input and forms the output as filtered version of test image. Such filter preserves the similar details and smooths the non-similar details of test image with respect to sample image. Due to this the differenc...
Article
Full-text available
Accurate measurements of 3D scenes and change detection of spatial distributed data are of great importance in different areas of research and application. For more accurate data analysis it is useful to take into account the all available data from various sensors and sources. The common case is that the different kinds of data available in their...
Article
A new way to interconnect multispectral images by using the methods of diffusive morphology are presented for implementing improved vision systems in aviation. In contrast to the traditional morphological methods, in the presented approach, it is not necessary to segment in advance the image for describing its shape and it ensures strong resistance...
Article
Full-text available
In this paper we propose the new change detection technique based on morphological comparative filtering. This technique generalizes the morphological image analysis scheme proposed by Pytiev. A new class of comparative filters based on guided contrasting is developed. Comparative filtering based on diffusion morphology is implemented too. The chan...
Article
Full-text available
In this paper we propose the new change detection technique based on morphological comparative filtering. This technique generalizes the morphological image analysis scheme proposed by Pytiev. A new class of comparative filters based on guided contrasting is developed. Comparative filtering based on diffusion morphology is implemented too. The chan...
Conference Paper
Existing image fusion methods based on morphological image analysis, that expresses the geometrical idea of image shape as a label image, are quite sensitive to the quality of image segmentation and, therefore, not sufficiently robust to noise and high frequency distortions. On the other hand, there are a number of methods in the field of dimension...
Article
The operational goal setting is the “first control phase” in anthropocentric objects. In terms of the Etap model, this is a change of the typical situation of the current session of the object’s operation. The structure of the operational goal setting is as follows: a priori information: (a) the given sequence of typical situations of the next anth...
Conference Paper
Automated and accurate spatial motion capturing of an object is necessary for a wide variety of applications including industry and science, virtual reality and movie, medicine and sports. For the most part of applications a reliability and an accuracy of the data obtained as well as convenience for a user are the main characteristics defining the...
Article
The perspective of aviation safety improvement is closely tied with the development of novel avionics solutions, aimed to enhance a flight visibility and a situation awareness of a flight crew. Such solutions include Enhanced Vision System (EVS), Synthetic Vision System (SVS), and Combined Vision System (CVS). These systems provide a supplemental v...
Article
Full-text available
The improved stereo-based approach for dynamic road scene understanding in a Driver Assistance System (DAS) is presented. System calibration is addressed. Algorithms for road lane detection, road 3D model generation, obstacle predetection and object (vehicle) detection are described. Lane detection is based on the evidence analysis. Obstacle predet...
Article
Full-text available
From the viewpoint of control of modern complex anthropocentric objects, such objects can be adequately described by the conceptual mathematical model called Etap. This model formalizes both the domain of operation of the anthropocentric objects and the set of tasks to be carried out on the object. Operational goal setting is the first phase of the...
Article
Full-text available
In this paper, we present a new class of tree-structured morphological descriptors of image shape. The notion of a Haar-like function is formalized. It is demonstrated that Pytiev morphology of centered images can be described in terms of a Haar-like basis. The morphology of localized mosaic shapes and corresponding localized Haar-like wavelet syst...
Article
The work is devoted to simulation and visualization of blade assembly for power plant (PP), which is the installation of vertical type and has a very complicated shape. The main goal is simulation of operating mode under load. Constructing of mathematical model and 3D calculation grid (both static and dynamic ones) as well as organization of the vi...
Conference Paper
Full-text available
The paper addresses a promising visualization concept related to combination of sensor and synthetic images in order to enhance situation awareness of a pilot during an aircraft landing. A real-time algorithm for a fusion of a sensor image, acquired by an onboard camera, and a synthetic 3D image of the external view, generated in an onboard compute...
Article
Full-text available
2D image matching problem is often stated as an image-to-shape or shape-to-shape matching problem. Such shape-based matching techniques should provide the matching of scene image fragments registered in various lighting, weather and season conditions or in different spectral bands. Most popular shape-to-shape matching technique is based on mutual i...
Article
The problem of defining the procedure of morphological comparison of mosaic shapes consistent with the Pyt’ev morphological image-to-shape comparison is discussed. Four different techniques for constructing such a procedure are studied, which are based on the search for critical points of the morphological correlation coefficient, on the analysis o...
Article
Full-text available
A technique for automated face detection and its pose estimation using single image is developed. The algorithm includes: face detection, facial features localization, face/background segmentation, face pose estimation, image transformation to frontal view. Automatic face/background segmentation is performed by original graph-cut technique based on...
Article
Information support of a flight crew during approach and landing in poor visibility still remains an important task of flight safety. In recent years, due to the increasing performance of onboard computers in 2D and 3D visual data processing, a Combined Vision System (CVS) has become one of the perspective display concept, aimed to enhance a flight...
Article
The paper describes the current results of a research and development (R&D) project aimed to create the advanced prototypes of Enhanced Vision System and Synthetic Vision System with such distinctive features as intellectual video analysis and scalable architecture based on Integrated Modular Avionics (IMA). The project is being performed by Russia...
Article
Full-text available
The technical problem of creating the new Russian version of an automatic Space Cargo Ship (SCS) for the International Space Station (ISS) is inseparably connected to the development of a digital video system for automatically measuring the SCS position relative to ISS in the process of spacecraft docking. This paper presents a method for estimatin...
Article
Full-text available
The problem of image correspondence measure selection for image comparison and matching is addressed. Many practical applications require image matching “just by shape” with no dependence on the concrete intensity or color values. Most popular technique for image shape comparison utilizes the mutual information measure based on probabilistic reason...
Article
Full-text available
An approach to developing algorithms for detecting and identifying objects in images leaning on the formalism of projective morphology is described. Methods for constructing algorithms of projective morphological analysis of images and the problem of automatic construction of an object model based on a given training sample are considered. For the...
Article
A formalism of projective morphology is proposed, which allows one to compare structural models and structural objects in images irrespective of the dependence on the specific features of the application domain. The main problems of structural analysis of digital images are considered, and the methods for solving them within the framework of projec...
Conference Paper
Full-text available
Commission V, WG-V-6 ABSTRACT: Dentistry is a field which has a need for accurate information about teeth shape, their relative position and their appearance in the face. This information is essentially important for various dentistry fields such as orthodontia, teeth treatment, denture production. Existing methods for analyzing mutual teeth arches...
Article
Full-text available
The original approach to image matching is proposed. The method itself can be classified as contour matching, based on boundary pattern analysis technique. Contours extraction technique is reinforced by combined information from independent contours and boundaries of segmented regions. In this process some general assumptions and simple rules are e...
Article
Full-text available
For realistic virtual model generation two main problems have to be solved: to achieve the required geometric accuracy in object description and to obtain the highest reachable texture similarity. Recently digital close-range photogrammetry offers precise and flexible means for the first problem solution - accurate geometric 3D reconstruction. Besi...
Article
Full-text available
Significant number of applications has a demand for measurement of mutual location of two or more adjacent parts. Measuring outer parameters of adjacent parts is relatively simple task. But it is a problem to determine relative attitude of inner surfaces of adjacent parts and to measure given parameters of conjunction. This problem is very importan...
Article
A method for detecting three-dimensional objects of arbitrary shape located on a relatively smooth surface by way of robot motion is proposed. The problem is solved based on processing stereoscopic images of a three-dimensional scene captured by onboard CCD cameras of the robot. The main idea of the method is that, after constructing special orthog...
Conference Paper
Full-text available
It is well known that the correlation stereo matching algorithms are the basis of most of digital photogrammetric systems. This paper concerns the important problem of increasing of computational speed of automatic stereo matching based on elimination of image parts with low information presence and non-traditional implementation of computations us...
Article
Full-text available
Accurate measurement of wood volume is a very important task at each stage of woodworking process beginning with estimation of volume of cut trees and finishing with determining the volume of resulting product. In most cases, current technology of measurement is based on inexact manual procedures and gives rather rough data. To introduce a new meas...
Article
The paper is devoted to consideration and development of methods of feature extraction on the images for flight vehicle navigation and guidance purpose. The problem of reliable feature extraction is generally discussed. The types of possible features are listed, their characteristics and requirements are outlined. The new robust method for linear f...
Article
The technology for three-dimensional model design of real world scenes and its photorealistic rendering are current topic of investigation. Development of such technology is very attractive to implement in vast variety of applications: military mission planning, crew training, civil engineering, architecture, virtual reality entertainments- just a...
Article
Full-text available
Precise points matching on the images of a stereopair is one of central problems in the area of machine vision and digital photogrammetry. A lot of publications is devoted to investigations of this problem. Among well-known classical approaches the conventional normalized cross-correlation method occupies first place due to its fundamental importan...
Conference Paper
In this paper we propose the complex method of 3D-objects detection based on special orthophoto transformation. Three-dimensional scene is registered by calibrated stereo-system with known relative and interior orientation parameters. The objects of interest are located on the surface of known analytical model. The paper shows that orthophoto trans...
Article
Full-text available
Current GosNIIAS research towards technology of 3D-site model generation is briefly summarized. Most challenging part of the technology that is automatic and semiautomatic methods of man-made object extraction from aerial images is described. The satisfactory results are obtained at extraction of serial type buildings and objects with simple geomet...
Article
The problem of human face shape reconstruction basing on information about human skull is very important for many applications beginning with archeology and finishing with crime expertise. Recent progress in development of D scanning system provides the means and techniques for generation of metric 3D models for a skull thus creating a background f...
Conference Paper
Full-text available
The problem human face shape reconstruction basing on information about human skull is very important for many applications beginning with archeology and finishing with crime expertise. World recognition was received with a face shape reconstruction technique proposed by M. Gerasimov (1). This method up to now is the general method for face reconst...
Article
Wide variety of medical and archeological applications has a demand for skull geometric parameter measurements. Traditional contact measurement technique has some disadvantages such as low accuracy and a need for real skull for processing. Applying of photogrammetric method for non- contact spatial coordinates determination and 3D model generation...
Article
Quickly growing field of planning and decision support systems require effective tools to operate with spatial distributed information. The modern virtual GIS using 3- dimensional representation of the real territories are designed to decide most problems. Nowadays because of difficulties to have a high detailed 3D digital world model due to limite...
Conference Paper
Full-text available
Due to the progress in computers and sensors development the number of virtual reality application (VR) grows significantly. Different sensors and techniques such as laser range finders, still and video cameras, mechanical digitizers are used to obtain spatial object coordinates for producing 3D models. The two main requirements to the produced mod...
Conference Paper
Full-text available
In the paper we propose the method of object detection based on analysis of orthophoto images difference. Object is registered stereoscopically on smooth surface of arbitrary shape. Orthophoto images for some basic plane are generated from left and right images of the stereopair. Orthophoto generation is based on a priori surface model knowledge. I...
Article
A complex of short-basis photogrammetry, methods and software for obtaining and analysis of 3D digital models of relief of dentition and its fragments is presented. This complex is intended for planning and evaluation of tooth preparation and quality of prosthetic treatment. The method was used to assess the correctness of dental shape repair by ar...
Article
The modern passport and visa documents include special machine-readable zones satisfied the ICAO standards. This allows to develop the special passport and visa automatic readers. However, there are some special problems in such OCR systems: low resolution of character images captured by CCD-camera (down to 150 dpi), essential shifts and slopes (up...
Conference Paper
Progress in close-range digital imaging over the recent years provides the basis for creating mobile mapping systems for spatial data acquisition purposes. Applying close-range photogrammetric technique in system based on automobile for road mapping, road surface control etc. looks rather attractive but has some problems. On the one side to obtain...
Conference Paper
Full-text available
This work deals with the subpixel point correspondence problem. Subpixel matching methods such as Least-Squares Correlation [2] or Adaptive Subpixel Cross-Correlation [1] use six-parameter geometric transformation and two-parameter radiometric transformation of the whole image patches to achieve subpixel matching accuracy. However different regions...
Conference Paper
This work deals with the subpixel point correspondence problem. Subpixel matching methods such as Least-Squares Correlation (2) or Adaptive Subpixel Cross-Correlation (1) use six-parameter geometric transformation and two-parameter radiometric transformation of the whole image patches to achieve subpixel matching accuracy. However different regions...
Conference Paper
This paper describes the new image segmentation technique. The suggested algorithm is based on the original histogram- based multi-threshold presegmentation procedure. The advantages of this procedure are the high computational speed and good separability in histogram modes detection. The following segmentation makes it possible to obtain the reaso...
Article
Full-text available
The technology for D model design of real world scenes and its photorealistic rendering are current topics of investigation. Development of such technology is very attractive to implement in vast varieties of applications: military mission planning, crew training, civil engineering, architecture, virtual reality entertainments--just a few were ment...
Article
Virtual reality is a new way to enhance the human interaction with a simulator or another man-machine system. Synthetic environment of virtual reality provides new possibilities of human activity due to the use of various sensor channels. Stereo visualization provides human immersion to virtual space and is the important feature of virtual reality....
Article
The generic technique called the 'Evidences-based Image Analysis' is proposed for a model-based object detection. Real images to be analyzed are considered as the sources of evidences generated by the procedures of low-level image processing. These evidences support or refute hypothesis connected with different objects and their features. The Bayes...
Conference Paper
Full-text available
A new approach for model-based image analysis called the Events-based image Analysis (EA) is proposed. From EA point of view, any certain procedure of image understanding can be interpreted as a procedure of evidence fusion. Any fact about the whole image, about its part or even about one proper pixel can be the evidence, and the any proposition ab...
Article
The complete object-oriented approach is generalized for the photogrammetry-oriented application development. The advantages of the object-oriented data representation and management are discussed. It is shown that the object-oriented programming is very attractive for data simulation, data unification, and fractal data representation in the digita...
Article
A digital stereophotogrammetric system based on PC is being developed. The system uses standard IBM PC-AT/386-/486 as a processing unit. The system is capable to fulfill processes of stereo model's building and terrain reconstruction using aero and space photographs. The peculiarity of this system is its possibility to process the large digital ima...
Article
Multisensory remote sensing requires the simultaneous registration and real-time processing of the time-varying multi-sensor image data. The frame-based programming technique was developed to provide the appropriate multi-sensor data management. Any frame-based processing system supports the automatic data updating since the output of any sensor ha...
Article
The necessity of special and system programming strictly limits the possibilities of image processing specialists developing the program applications if they are not simultaneously the professional programmers. In many respects the efficiency of image processing is determined by the user's interface convenience and saturation and its orientation to...
Conference Paper
Full-text available
This paper presents an image processing application for the welding quality control during the welding pipe manufacturing process. The conjunction angle automatic location and measurement were provided by a special two-stage modular algorithm. At the first stage, the Hough Transform with natural parametrization is used to detect and locate the line...
Article
The problem of processing two gray-level images forming a stereo pair is considered on the basis of treating the sought-for disparity map and the original image pair as, respectively, the hidden and the observable constituent of a two-component random field with known probabilistic properties. The stereo matching algorithm resulting from such an ap...