
Sergey ZheltovState Scientific Research Institute of Aviation Systems | GosNIIAS
Sergey Zheltov
Prof.
About
87
Publications
9,833
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
365
Citations
Introduction
Sergey Zheltov currently works at GosNIIAS. Sergey does research in Automotive Systems Engineering, Optical Engineering and Aerospace Engineering. Their most recent publication is 'Vision-Based Change Detection Using Comparative Morphology'.
Publications
Publications (87)
The concept of an intelligent hybrid aircraft fault-tolerant flight control system operating under complete parametric and structural uncertainty is considered. Fault tolerance in the proposed system is ensured through the efficient integration of model-based and model-free health monitoring and reconfiguring methods.
A lot of image matching applications require image comparison to be invariant relative to intensity values variations. The Pyt’ev theory for Morphological Image Analysis (MIA) was developed based on image-to-shape matching with mosaic shape models. Within the framework of this theory, the problem of shape-to-shape comparison was previously consider...
The latest advances in technical characteristics of unmanned aerial systems (UAS) and their onboard sensors opened the way for smart flying vehicles exploiting new application areas and allowing to perform missions seemed to be impossible before. One of these complicated tasks is the 3D reconstruction and monitoring of large-size, complex, grid-lik...
Objects and structures realized by connecting and bending wires are common in modern architecture, furniture design, metal sculpting, etc. The 3D reconstruction of such objects with traditional range- or image-based methods is very difficult and poses challenges due to their unique characteristics such as repeated structures, slim elements, holes,...
In this paper we propose and consider different metric approaches to image comparison based on Morpho-Semantic (MS) and Semantic-Morphological (SM) models. The first proposed class-based approach presumes the embedding of MS and SM models to the metric space with weighted Lp metrics. This approach is based on representation of SM models as mosaic v...
A general approach to a structure-functional analysis and synthesis (SFAS) of deep neural networks (CNN). The new approach allows to define regularly: from which structure-functional elements (SFE) CNNs can be constructed; what are required mathematical properties of an SFE; which combinations of SFEs are valid; what are the possible ways of develo...
Speech of the RAS academician S.YU. Zheltov
In a previous work, we proposed a Comparative Morphology (CM) construction scheme that generalized Pytyev's Morphological Image Analysis approach onto a wider range of practical image comparison applications. Within a Guided Contrasting framework, a filtering procedure and a related change detection algorithm were developed.
In this work, we propo...
The chapter addresses the theoretical and practical aspects of the scene change detection problem with the use of computer vision techniques. It means detecting new or disappeared objects in images registered at different moments of time and possibly in various lighting, weather, and season conditions. In this chapter, we propose the new scheme of...
This article, based on a paper heard at a meeting of the RAS Presidium, analyzes the main problems of and trends in the intellectualization of state-of-the-art aviation complexes. The obtaining and intelligent processing of heterogeneous information, intelligent management, and aircraft “self-sensing,” as well as intelligent interaction within the...
A computational technology for constructing the optimal shape of a power plant three-dimensional blade assembly is presented. The shape of the blade assembly is optimized to improve the power characteristics of the blade assembly taking into account structural constraints. The computational technology is a unified chain of algorithms beginning with...
Change detection scheme based on guided contrasting was previously proposed. Guided contrasting filter takes two images (test and sample) as input and forms the output as filtered version of test image. Such filter preserves the similar details and smooths the non-similar details of test image with respect to sample image. Due to this the differenc...
Accurate measurements of 3D scenes and change detection of spatial distributed data are of great importance in different areas of research and application. For more accurate data analysis it is useful to take into account the all available data from various sensors and sources. The common case is that the different kinds of data available in their...
A method for counterfeit bill detection based on a digital image for mass-production smartphones is developed. The method under consideration does not require new protective elements to be designed and introduced into the print and is based on the use of digital image analysis and recognition methods, allowing one to carry out an automatic search a...
A new way to interconnect multispectral images by using the methods of diffusive morphology are presented for implementing improved vision systems in aviation. In contrast to the traditional morphological methods, in the presented approach, it is not necessary to segment in advance the image for describing its shape and it ensures strong resistance...
In this paper we propose the new change detection technique based on morphological comparative filtering. This technique generalizes the morphological image analysis scheme proposed by Pytiev. A new class of comparative filters based on guided contrasting is developed. Comparative filtering based on diffusion morphology is implemented too. The chan...
In this paper we propose the new change detection technique based on morphological comparative filtering. This technique generalizes the morphological image analysis scheme proposed by Pytiev. A new class of comparative filters based on guided contrasting is developed. Comparative filtering based on diffusion morphology is implemented too. The chan...
Existing image fusion methods based on morphological image analysis, that expresses the geometrical idea of image shape as a label image, are quite sensitive to the quality of image segmentation and, therefore, not sufficiently robust to noise and high frequency distortions. On the other hand, there are a number of methods in the field of dimension...
The operational goal setting is the “first control phase” in anthropocentric objects. In terms of the Etap model, this is a change of the typical situation of the current session of the object’s operation. The structure of the operational goal setting is as follows: a priori information: (a) the given sequence of typical situations of the next anth...
Automated and accurate spatial motion capturing of an object is necessary for a wide variety of applications including industry and science, virtual reality and movie, medicine and sports. For the most part of applications a reliability and an accuracy of the data obtained as well as convenience for a user are the main characteristics defining the...
The perspective of aviation safety improvement is closely tied with the development of novel avionics solutions, aimed to enhance a flight visibility and a situation awareness of a flight crew. Such solutions include Enhanced Vision System (EVS), Synthetic Vision System (SVS), and Combined Vision System (CVS). These systems provide a supplemental v...
The improved stereo-based approach for dynamic road scene understanding in a Driver Assistance System (DAS) is presented. System calibration is addressed. Algorithms for road lane detection, road 3D model generation, obstacle predetection and object (vehicle) detection are described. Lane detection is based on the evidence analysis. Obstacle predet...
From the viewpoint of control of modern complex anthropocentric objects, such objects can be adequately described by the conceptual mathematical model called Etap. This model formalizes both the domain of operation of the anthropocentric objects and the set of tasks to be carried out on the object. Operational goal setting is the first phase of the...
In this paper, we present a new class of tree-structured morphological descriptors of image shape. The notion of a Haar-like function is formalized. It is demonstrated that Pytiev morphology of centered images can be described in terms of a Haar-like basis. The morphology of localized mosaic shapes and corresponding localized Haar-like wavelet syst...
The work is devoted to simulation and visualization of blade assembly for power plant (PP), which is the installation of vertical type and has a very complicated shape. The main goal is simulation of operating mode under load. Constructing of mathematical model and 3D calculation grid (both static and dynamic ones) as well as organization of the vi...
The paper addresses a promising visualization concept related to combination of sensor and synthetic images in order to enhance situation awareness of a pilot during an aircraft landing. A real-time algorithm for a fusion of a sensor image, acquired by an onboard camera, and a synthetic 3D image of the external view, generated in an onboard compute...
2D image matching problem is often stated as an image-to-shape or shape-to-shape matching problem. Such shape-based matching
techniques should provide the matching of scene image fragments registered in various lighting, weather and season conditions or in
different spectral bands. Most popular shape-to-shape matching technique is based on mutual i...
The problem of defining the procedure of morphological comparison of mosaic shapes consistent with the Pyt’ev morphological image-to-shape comparison is discussed. Four different techniques for constructing such a procedure are studied, which are based on the search for critical points of the morphological correlation coefficient, on the analysis o...
A technique for automated face detection and its pose estimation using single image is developed. The algorithm includes: face
detection, facial features localization, face/background segmentation, face pose estimation, image transformation to frontal view.
Automatic face/background segmentation is performed by original graph-cut technique based on...
Information support of a flight crew during approach and landing in poor visibility still remains an important task of flight safety. In recent years, due to the increasing performance of onboard computers in 2D and 3D visual data processing, a Combined Vision System (CVS) has become one of the perspective display concept, aimed to enhance a flight...
The paper describes the current results of a research and development (R&D) project aimed to create the advanced prototypes of Enhanced Vision System and Synthetic Vision System with such distinctive features as intellectual video analysis and scalable architecture based on Integrated Modular Avionics (IMA). The project is being performed by Russia...
The technical problem of creating the new Russian version of an automatic Space Cargo Ship (SCS) for the International Space Station (ISS) is inseparably connected to the development of a digital video system for automatically measuring the SCS position relative to ISS in the process of spacecraft docking. This paper presents a method for estimatin...
The problem of image correspondence measure selection for image comparison and matching is addressed. Many practical applications require image matching “just by shape” with no dependence on the concrete intensity or color values. Most popular technique for image shape comparison utilizes the mutual information measure based on probabilistic reason...
An approach to developing algorithms for detecting and identifying objects in images leaning on the formalism of projective
morphology is described. Methods for constructing algorithms of projective morphological analysis of images and the problem
of automatic construction of an object model based on a given training sample are considered. For the...
A formalism of projective morphology is proposed, which allows one to compare structural models and structural objects in
images irrespective of the dependence on the specific features of the application domain. The main problems of structural
analysis of digital images are considered, and the methods for solving them within the framework of projec...
Commission V, WG-V-6 ABSTRACT: Dentistry is a field which has a need for accurate information about teeth shape, their relative position and their appearance in the face. This information is essentially important for various dentistry fields such as orthodontia, teeth treatment, denture production. Existing methods for analyzing mutual teeth arches...
The original approach to image matching is proposed. The method itself can be classified as contour matching, based on boundary pattern analysis technique. Contours extraction technique is reinforced by combined information from independent contours and boundaries of segmented regions. In this process some general assumptions and simple rules are e...
For realistic virtual model generation two main problems have to be solved: to achieve the required geometric accuracy in object description and to obtain the highest reachable texture similarity. Recently digital close-range photogrammetry offers precise and flexible means for the first problem solution - accurate geometric 3D reconstruction. Besi...
Significant number of applications has a demand for measurement of mutual location of two or more adjacent parts. Measuring outer parameters of adjacent parts is relatively simple task. But it is a problem to determine relative attitude of inner surfaces of adjacent parts and to measure given parameters of conjunction. This problem is very importan...
A method for detecting three-dimensional objects of arbitrary shape located on a relatively smooth surface by way of robot motion is proposed. The problem is solved based on processing stereoscopic images of a three-dimensional scene captured by onboard CCD cameras of the robot. The main idea of the method is that, after constructing special orthog...
It is well known that the correlation stereo matching algorithms are the basis of most of digital photogrammetric systems. This paper concerns the important problem of increasing of computational speed of automatic stereo matching based on elimination of image parts with low information presence and non-traditional implementation of computations us...
Accurate measurement of wood volume is a very important task at each stage of woodworking process beginning with estimation of volume of cut trees and finishing with determining the volume of resulting product. In most cases, current technology of measurement is based on inexact manual procedures and gives rather rough data. To introduce a new meas...
The paper is devoted to consideration and development of methods of feature extraction on the images for flight vehicle navigation and guidance purpose. The problem of reliable feature extraction is generally discussed. The types of possible features are listed, their characteristics and requirements are outlined. The new robust method for linear f...
The technology for three-dimensional model design of real world scenes and its photorealistic rendering are current topic of investigation. Development of such technology is very attractive to implement in vast variety of applications: military mission planning, crew training, civil engineering, architecture, virtual reality entertainments- just a...
Precise points matching on the images of a stereopair is one of central problems in the area of machine vision and digital photogrammetry. A lot of publications is devoted to investigations of this problem. Among well-known classical approaches the conventional normalized cross-correlation method occupies first place due to its fundamental importan...
In this paper we propose the complex method of 3D-objects detection based on special orthophoto transformation. Three-dimensional scene is registered by calibrated stereo-system with known relative and interior orientation parameters. The objects of interest are located on the surface of known analytical model. The paper shows that orthophoto trans...
Current GosNIIAS research towards technology of 3D-site model generation is briefly summarized. Most challenging part of the technology that is automatic and semiautomatic methods of man-made object extraction from aerial images is described. The satisfactory results are obtained at extraction of serial type buildings and objects with simple geomet...
The problem of human face shape reconstruction basing on information about human skull is very important for many applications beginning with archeology and finishing with crime expertise. Recent progress in development of D scanning system provides the means and techniques for generation of metric 3D models for a skull thus creating a background f...
The problem human face shape reconstruction basing on information about human skull is very important for many applications beginning with archeology and finishing with crime expertise. World recognition was received with a face shape reconstruction technique proposed by M. Gerasimov (1). This method up to now is the general method for face reconst...
Wide variety of medical and archeological applications has a demand for
skull geometric parameter measurements. Traditional contact measurement
technique has some disadvantages such as low accuracy and a need for
real skull for processing. Applying of photogrammetric method for non-
contact spatial coordinates determination and 3D model generation...
Quickly growing field of planning and decision support systems require effective tools to operate with spatial distributed information. The modern virtual GIS using 3- dimensional representation of the real territories are designed to decide most problems. Nowadays because of difficulties to have a high detailed 3D digital world model due to limite...
Due to the progress in computers and sensors development the number of virtual reality application (VR) grows significantly. Different sensors and techniques such as laser range finders, still and video cameras, mechanical digitizers are used to obtain spatial object coordinates for producing 3D models. The two main requirements to the produced mod...
In the paper we propose the method of object detection based on analysis of orthophoto images difference. Object is registered stereoscopically on smooth surface of arbitrary shape. Orthophoto images for some basic plane are generated from left and right images of the stereopair. Orthophoto generation is based on a priori surface model knowledge. I...
A complex of short-basis photogrammetry, methods and software for obtaining and analysis of 3D digital models of relief of dentition and its fragments is presented. This complex is intended for planning and evaluation of tooth preparation and quality of prosthetic treatment. The method was used to assess the correctness of dental shape repair by ar...
The modern passport and visa documents include special machine-readable zones satisfied the ICAO standards. This allows to develop the special passport and visa automatic readers. However, there are some special problems in such OCR systems: low resolution of character images captured by CCD-camera (down to 150 dpi), essential shifts and slopes (up...
Progress in close-range digital imaging over the recent years provides the basis for creating mobile mapping systems for spatial data acquisition purposes. Applying close-range photogrammetric technique in system based on automobile for road mapping, road surface control etc. looks rather attractive but has some problems. On the one side to obtain...
This work deals with the subpixel point correspondence problem. Subpixel matching methods such as Least-Squares Correlation [2] or Adaptive Subpixel Cross-Correlation [1] use six-parameter geometric transformation and two-parameter radiometric transformation of the whole image patches to achieve subpixel matching accuracy. However different regions...
This work deals with the subpixel point correspondence problem. Subpixel matching methods such as Least-Squares Correlation (2) or Adaptive Subpixel Cross-Correlation (1) use six-parameter geometric transformation and two-parameter radiometric transformation of the whole image patches to achieve subpixel matching accuracy. However different regions...
This paper describes the new image segmentation technique. The suggested algorithm is based on the original histogram- based multi-threshold presegmentation procedure. The advantages of this procedure are the high computational speed and good separability in histogram modes detection. The following segmentation makes it possible to obtain the reaso...
The technology for D model design of real world scenes and its photorealistic rendering are current topics of investigation. Development of such technology is very attractive to implement in vast varieties of applications: military mission planning, crew training, civil engineering, architecture, virtual reality entertainments--just a few were ment...
Virtual reality is a new way to enhance the human interaction with a simulator or another man-machine system. Synthetic environment of virtual reality provides new possibilities of human activity due to the use of various sensor channels. Stereo visualization provides human immersion to virtual space and is the important feature of virtual reality....
The generic technique called the 'Evidences-based Image Analysis' is proposed for a model-based object detection. Real images to be analyzed are considered as the sources of evidences generated by the procedures of low-level image processing. These evidences support or refute hypothesis connected with different objects and their features. The Bayes...
A new approach for model-based image analysis called the Events-based image Analysis (EA) is proposed. From EA point of view, any certain procedure of image understanding can be interpreted as a procedure of evidence fusion. Any fact about the whole image, about its part or even about one proper pixel can be the evidence, and the any proposition ab...
The complete object-oriented approach is generalized for the photogrammetry-oriented application development. The advantages of the object-oriented data representation and management are discussed. It is shown that the object-oriented programming is very attractive for data simulation, data unification, and fractal data representation in the digita...
A digital stereophotogrammetric system based on PC is being developed. The system uses standard IBM PC-AT/386-/486 as a processing unit. The system is capable to fulfill processes of stereo model's building and terrain reconstruction using aero and space photographs. The peculiarity of this system is its possibility to process the large digital ima...
Multisensory remote sensing requires the simultaneous registration and real-time processing of the time-varying multi-sensor image data. The frame-based programming technique was developed to provide the appropriate multi-sensor data management. Any frame-based processing system supports the automatic data updating since the output of any sensor ha...
The necessity of special and system programming strictly limits the possibilities of image processing specialists developing the program applications if they are not simultaneously the professional programmers. In many respects the efficiency of image processing is determined by the user's interface convenience and saturation and its orientation to...
This paper presents an image processing application for the welding quality control during the welding pipe manufacturing process. The conjunction angle automatic location and measurement were provided by a special two-stage modular algorithm. At the first stage, the Hough Transform with natural parametrization is used to detect and locate the line...
The problem of processing two gray-level images forming a stereo pair is considered on the basis of treating the sought-for disparity map and the original image pair as, respectively, the hidden and the observable constituent of a two-component random field with known probabilistic properties. The stereo matching algorithm resulting from such an ap...
Correlation techniques are widely used to match corresponding areas in stereo image pairs. This technique provides pixel correspondence that is required for the generation of 3D data. However correlation based approaches can provide false results and inaccurate matching due to noise and geometric and radiometric distortions in the stereo images. Th...
A digital stereophotogrammetric system is being developed to perform
photogrammetric tasks with a minimum of cost and hardware operating
complexity. The standard IBM PC-AT/486 is used as system processing
unit. Two stereo vision modes are available: anagliphic and mirror. With
the use of aerosurvey and spaceaerosurvey photographs of different
proje...