ArticlePDF Available

Virtual Deformable Image Sensors: Towards to a General Framework for Image Sensors with Flexible Grids and Forms

Authors:

Abstract and Figures

Our vision system has a combination of different sensor arrangements from hexagonal to elliptical ones. Inspired from this variation in type of arrangements we propose a general framework by which it becomes feasible to create virtual deformable sensor arrangements. In the framework for a certain sensor arrangement a configuration of three optional variables are used which includes the structure of arrangement, the pixel form and the gap factor. We show that the histogram of gradient orientations of a certain sensor arrangement has a specific distribution (called ANCHOR) which is obtained by using at least two generated images of the configuration. The results showed that ANCHORs change their patterns by the change of arrangement structure. In this relation pixel size changes have 10-fold more impact on ANCHORs than gap factor changes. A set of 23 images; randomly chosen from a database of 1805 images, are used in the evaluation where each image generates twenty-five different images based on the sensor configuration. The robustness of ANCHORs properties is verified by computing ANCHORs for totally 575 images with different sensor configurations. We believe by using the framework and ANCHOR it becomes feasible to plan a sensor arrangement in the relation to a specific application and its requirements where the sensor arrangement can be planed even as combination of different ANCHORs.
Content may be subject to copyright.
A preview of the PDF is not available
... Localization helps to locate, nearest printer when a computer sends a printing command in a building, faulty node, intruder in the network, damaged device, unauthorized connections, and position of a moving robot. Network localization is [1,10,13,25]. In ecology applications, the benefits of utilizing hexagons is available in observation, experiment and simulation, with an exceptional advantage gave in natural displaying [3]. ...
Article
Due to the immense applications of interconnection networks, various new networks are designed and extensively used in computer sciences and engineering fields. Networks can be expressed in the form of graphs, where node become vertex and links between nodes are called edges. To obtain the exact location of a specific node which is unique from all the nodes, several nodes are selected this is called locating/resolving set. Minimum number of nodes in the locating set is called locating number. In this article, we find the exact value of locating number of newly designed hexagonal Möbius ladder network.
... Many applications require production and use of these abovementioned polygonal sensors, especially hexagons [26,27]. One specific application in our focus is the design upgrade of the new CMS detector. ...
Article
Full-text available
In this paper, a problem of packing hexagonal and dodecagonal sensors in a circular container is considered. We concentrate on the sensor manufacturing application, where sensors need to be produced from a circular wafer with maximal silicon efficiency (SE) and minimal number of sensor cuts. Also, a specific application is considered when produced sensors need to cover the circular area of interest with the largest packing efficiency (PE). Even though packing problems are common in many fields of research, not many authors concentrate on packing polygons of known dimensions into a circular shape to optimize a certain objective. We revisit this problem by using some well-known formulations concerning regular hexagons. We provide mathematical expressions to formulate the difference in efficiency between regular and semiregular tessellations. It is well-known that semiregular tessellation will cause larger silicon waste, but it is important to formulate the ratio between the two, as it affects the sensor production cost. The reason why we have replaced the “perfect” regular tessellation with semiregular one is the need to provide spacings at the sensor vertices for placing mechanical apertures in the design of the new CMS detector. Archimedean {3,122} semiregular tessellation and its more flexible variants with irregular dodecagons can provide these triangular spacings but with larger number of sensor cuts. Hence, we construct an irregular convex hexagon that is semiregularly tessellating the targeted area. It enables the sensor to remain symmetric and hexagonal in shape, even though irregular, and produced with minimal number of cuts with respect to dodecagons. Efficiency remains satisfactory, as we show that, by producing the proposed irregular hexagon sensors from the same wafer as a regular hexagon, we can obtain almost the same SE.
Chapter
In view to the current and traditional state of art, all image analyzing device for capturing, recording and display are exclusively meant to utilize square grids. But biological structure models, however, pinpoint an alternative, evolutionary motivated base structure. Motivated by the optical perception system of human, hexagonal image processing (HIP) offers many robust advantages and benefits for the researchers. Hexagonal structure offers decisive advantages like radical symmetry, equidistant and unique neighbours, homogeneity in the lattice and 13.4% increased transformation efficiency. Even though hexagonal image processing is known for good image quality but the implementation approach made it difficult to work as there is no working hardware that applies hexagonal imaging concept. Although with these much of processing power of computers and graphic devices, hexagonal representation has not yet developed to a standardized framework or library for HIP, so the time is ripe to review the various hexagonal grid structure rendering algorithms and hexagonal sampling.KeywordsHexagonal pixelHexagonal samplingSpiral architectureHexagonal grid
Article
Complex networks are not easy to decode and understand to work on it, similarly, the Möbius structure is also considered as a complex structure or geometry. But making a graph of every complex and huge structure either chemical or computer-related networks becomes easy. After making easy of its construction, recognition of each vertex (node or atom) is also not an easy task, in this context resolvability parameters plays an important role in controlling or accessing each vertex with respect to some chosen vertices called as resolving set or sometimes dividing entire cluster of vertices into further subparts (subsets) and then accessing each vertex with respect to build in subsets called as resolving partition set. In these parameters, each vertex has its own unique identification and is easy to access despite the small or huge structures. In this article, we provide a resolving partition of hexagonal Möbius ladder graph and discuss bounds of partition dimension of hexagonal Möbius ladder network.
Article
Full-text available
The arrangement and form of the image sensor have a fundamental effect on any further image processing operation and image visualization. In this paper, we present a software-based method to change the arrangement and form of pixel sensors that generate hexagonal pixel forms on a hexagonal grid. We evaluate four different image sensor forms and structures, including the proposed method. A set of 23 pairs of images; randomly chosen, from a database of 280 pairs of images are used in the evaluation. Each pair of images have the same semantic meaning and general appearance, the major difference between them being the sharp transitions in their contours. The curviness variation is estimated by effect of the first and second order gradient operations, Hessian matrix and critical points detection on the generated images; having different grid structures, different pixel forms and virtual increased of fill factor as three major properties of sensor characteristics. The results show that the grid structure and pixel form are the first and second most important properties. Several dissimilarity parameters are presented for curviness quantification in which using extremum point showed to achieve distinctive results. The results also show that the hexagonal image is the best image type for distinguishing the contours in the images.
Article
Full-text available
Achieving a high fill factor is a bottleneck problem for capturing high-quality images. There are hardware and software solutions to overcome this problem. In the solutions, the fill factor is known. However, this is an industrial secrecy by most image sensor manufacturers due to its direct effect on the assessment of the sensor quality. In this paper, we propose a method to estimate the fill factor of a camera sensor from an arbitrary single image. The virtual response function of the imaging process and sensor irradiance are estimated from the generation of virtual images. Then the global intensity values of the virtual images are obtained, which are the result of fusing the virtual images into a single, high dynamic range radiance map. A non-linear function is inferred from the original and global intensity values of the virtual images. The fill factor is estimated by the conditional minimum of the inferred function. The method is verified using images of two datasets. The results show that our method estimates the fill factor correctly with significant stability and accuracy from one single arbitrary image according to the low standard deviation of the estimated fill factors from each of images and for each camera.
Article
Full-text available
A quanta image sensor (QIS) is a class of single-photon imaging devices that measure light intensity using oversampled binary observations. Because of the stochastic nature of the photon arrivals, data acquired by QIS is a massive stream of random binary bits. The goal of image reconstruction is to recover the underlying image from these bits. In this paper, we present a non-iterative image reconstruction algorithm for QIS. Unlike existing reconstruction methods that formulate the problem from an optimization perspective, the new algorithm directly recovers the images through a pair of nonlinear transformations and an off-the-shelf image denoising algorithm. By skipping the usual optimization procedure, we achieve orders of magnitude improvement in speed and even better image reconstruction quality. We validate the new algorithm on synthetic datasets, as well as real videos collected by one-bit single-photon avalanche diode (SPAD) cameras.
Article
Full-text available
The current camera has made a huge progress in the sensor resolution and the lowluminance performance. However, we are still far from having an optimal camera as powerful as our eye is. The study of the evolution process of our visual system indicates attention to two major issues: the form and the density of the sensor. High contrast and optimal sampling properties of our visual spatial arrangement are related directly to the densely hexagonal form. In this paper, we propose a novel software-based method to create images on a compact dense hexagonal grid, derived from a simulated square sensor array by a virtual increase of the fill factor and a half a pixel shifting. After that, the orbit functions are proposed for a hexagonal image processing. The results show it is possible to achieve an image processing in the orbit domain and the generated hexagonal images are superior, in detection of curvature edges, to the square images. We believe that the orbit domain image processing has a great potential to be the standard processing for hexagonal images.
Article
Full-text available
The Quanta Image Sensor (QIS) was conceived when contemplating shrinking pixel sizes and storage capacities, and the steady increase in digital processing power. In the single-bit QIS, the output of each field is a binary bit plane, where each bit represents the presence or absence of at least one photoelectron in a photodetector. A series of bit planes is generated through high-speed readout, and a kernel or “cubicle” of bits (x, y, t) is used to create a single output image pixel. The size of the cubicle can be adjusted post-acquisition to optimize image quality. The specialized sub-diffraction-limit photodetectors in the QIS are referred to as “jots” and a QIS may have a gigajot or more, read out at 1000 fps, for a data rate exceeding 1 Tb/s. Basically, we are trying to count photons as they arrive at the sensor. This paper reviews the QIS concept and its imaging characteristics. Recent progress towards realizing the QIS for commercial and scientific purposes is discussed. This includes implementation of a pump-gate jot device in a 65 nm CIS BSI process yielding read noise as low as 0.22 e− r.m.s. and conversion gain as high as 420 µV/e−, power efficient readout electronics, currently as low as 0.4 pJ/b in the same process, creating high dynamic range images from jot data, and understanding the imaging characteristics of single-bit and multi-bit QIS devices. The QIS represents a possible major paradigm shift in image capture.
Article
Purpose: To determine the retinal eccentricity at which cones are no longer an observable substitute for ganglion cells on nasal and inferior parafoveal visual acuity. Method: Visual acuities were measured on 12 healthy volunteers, under dynamic adaptive optic aberrations correction (crx1™) in white light, from 0° to 6°, every two degrees, along the nasal and inferior retinal meridians. Cone spacing was measured on images of the retina acquired using an adaptive optic flood illumination retina camera (rtx1™) at the same eccentricity, except at 0°. Results: Cone spacing increased by around 0.13 min of arc per degree of eccentricity and a difference of 7% between both meridians was observed (higher cone spacing in the inferior retinal meridian). Visual resolution was higher in the nasal retinal meridian (difference of around 28% or 0.15 logMAR at 6°). Cone spacing can predict minimum angle of resolution (MAR) at 2° in both semi retinal meridians. In the inferior retinal meridian, MAR measurements are fairly well predicted by Watson's 50% mathematical model based on the midget retinal ganglion cell density. Along the nasal retinal meridian, the measured MAR lies between Watson's 50% and 100% models. Conclusions: At 2° of eccentricity, cone density accurately predicts visual resolution in both the nasal and inferior retina, supporting the idea that only 50% of the foveal midget retinal ganglion cells determine VA. The 50% model can also predict VA in the inferior retinal meridian at 4° and 6° of eccentricity. However, the 50% model underestimated visual acuity in the nasal retinal meridian at 4° and 6° of eccentricity consistent with the partially overlapping ON and OFF midget retinal ganglion cell receptive fields.
We study the question of feature sets for robust visual object recognition, adopting linear SVM based human detection as a test case. After reviewing existing edge and gradient based descriptors, we show experimentally that grids of Histograms of Oriented Gradient (HOG) descriptors significantly outperform existing feature sets for human detection. We study the influence of each stage of the computation on performance, concluding that fine-scale gradients, fine orientation binning, relatively coarse spatial binning, and high-quality local contrast normalization in overlapping descriptor blocks are all important for good results. The new approach gives near-perfect separation on the original MIT pedestrian database, so we introduce a more challenging dataset containing over 1800 annotated human images with a large range of pose variations and backgrounds.
Article
A new sensor for machine vision based on the configuration of the human retina is presented. Three pixel configurations are considered. The image plane (retina) consists of pixels arranged in a log-spiral configuration of increasing size towards the periphery. The image plane is mapped to computation plane via a conformai logarithmic transformation. The sensor has a much smaller number of pixels than a rectangular sensor with the same resolution at the center, yet it is possible to use it for pattern recognition. The new sensor is compared to a conventional rectangular array in terms of resolution, number of elements and field of view. Algorithms for edge and motion detection are developed and applied to real images.