Paracatadioptric Geometry using Conformal Geometric Algebra

Chapter (PDF Available) · November 2008with 55 Reads
DOI: 10.5772/6160
In book: Computer Vision
Cite this publication
In this work a comprehensive geometric model for paracatadioptric sensors has been presented. The model is based on the equivalence between paracatadioptric projection and the inversion. The main reason for using the inversion is that it can be represented by a versor (i.e. a special group of multivectors) in the CGA. The advantage of this representation is that it can be applied not only to points but also to point-pairs, lines, circles, spheres and planes.
Figures - uploaded by Carlos Lopez-Franco
Author content
All content in this area was uploaded by Carlos Lopez-Franco
Content may be subject to copyright.
Paracatadioptric Geometry using
Conformal Geometric Algebra
Carlos López-Franco
Computer Science Department, University of Guadalajara,
1. Introduction
Computer vision provides non-contact measurements of the world, extending the robot
ability to operate in circumstances and environments which can not be accurately
controlled. The use of visual observations to control the motions of robots has been
extensively studied, this approach is referred in literature as visual servoing.
Conventional cameras suffer from a limited field of view. One effective way to increase the
field of view is to use mirrors in combination with conventional cameras. The approach of
combining mirrors with conventional cameras to enhance sensor field of view is referred as
catadioptric image formation.
In order to be able to model the catadioptric sensor geometrically, it must satisfy the
restriction that all the measurements of light intensity pass through only one point in the
space (effective viewpoint). The complete class of mirrors that satisfy such restriction where
analyzed by Baker and Nayar [1]. In [2] the authors deal with the epipolar geometry of two
catadioptric sensors. Later, in [3] a general model for central catadioptric image formation
was given. Also, a representation of this general model using the conformal geometric
algebra was showed in [4].
Visual servoing applications can be benefit from sensors providing large fields of view. This
work will show how a paracatadioptric sensor (parabolic mirror and a camera) can be used
in a visual servoing task for driving a nonholonomic mobile robot.
The work is mainly concerned with the use of projected lines extracted from central
catadioptric images as input of a visual servoing control loop. The paracatadioptric image of
a line is in general a circle but sometimes it could be a line. This is something that should be
taken into account to avoid a singularity in the visual servoing task.
In this work we will give a framework for the representation of image features in parabolic
catadioptric images and their transformations. In particular line images in parabolic
catadioptric images are circles. While of course conics and therefore circles can be
represented in the projective plane we will provide a much more natural representation
utilizing the conformal geometric algebra (CGA).
In CGA the conformal transformations are linearized using the fact that the conformal
group on Rn is isomorphic to the Lorentz group on Rn+1. Hence nonlinear conformal
transformations on Rn can be linearized by representing them as Lorentz transformations
and thereby further simplified as versor representation. These versors can be applied not
Open Access Database
Source: Computer Vision, Book edited by: Xiong Zhihui,
ISBN 978-953-7619-21-3, pp. 538, November 2008, I-Tech, Vienna, Austria
Computer Vision
only to points but also to all the CGA entities (spheres, planes, circles, lines and point-pairs).
In this model a b c represents the circle thought the three points. If one of these points is a
null vector e representing the point at infinity, then a b e represents the straight line
trough a and b as a circle through infinity. This representation could not be available
without the concept of null vector.
In contrast with other catadioptric sensors the paracatadioptric sensors have certain
properties that make them very interesting. One important property is that paracatadioptric
projection is conformal, this motivate us to use the conformal geometric algebra to represent
it. Thus the paracatadioptric projection can be expressed linearly using versors of CGA. The
advantage of our framework is that the projection can be applied to circles and lines in the
same way as it does for points. That advantage has a tremendous consequence since the
nonlinearity of the paracatadioptric image has been removed. As a result the input features
for the visual servoing control loop can be handled effectively in order to design an efficient
vision-based control scheme.
The rest of this paper is organized as follows: The next section will give a brief introduction
to the conformal geometric algebra. In section 3 we show the equivalence between
inversions on the sphere and the parabolic projections. Then, in section 4 we show the
paracatadioptric image formation using the proposed framework. Later, in section 5 an
application of a paracatadioptric stereo sensor is given. Finally, the conclusions are in
section 6.
2. Conformal geometric algebra
In general, a geometric algebra [5] Gn is a n-dimensional vector space Vn over the reals R.
The geometric algebra is generated defining the geometric product as an associative and
multilinear product satisfying the contraction rule
where ε is 1, 0 or 1 and is called the signature of ei. When ei 0 but its magnitude |ei| is
equal to zero, ei is called null vector.
The geometric product of a geometric algebra Gp,q,r for two basis ei and ej is defined as
Thus, given a n-dimensional vector space Vn with an orthonormal basis {e1, e2, ...en} its
corresponding geometric algebra is generated using the geometric product. We can see that
for a n-dimensional vector space, there are 2n ways to combine its basis using the geometric
product. Each of this product is called a basis blade. Together they span all the space of the
geometric algebra Gn.
We also denote with Gp,q a geometric algebra over V p,q where p and q denote the signature of
the algebra. If p 0 and q = 0 the metric is euclidean Gn, if non of them are zero the metric is
Paracatadioptric Geometry using Conformal Geometric Algebra
pseudoeuclidean. A generic element in Gp,q is called a multivector. Every multivector M can
be written in the expanded form
where represents the blade of grade i. The geometric product (denoted juxtaposition)
of vectors is defined with a scalar part called the inner product and an outer product, which
is a non scalar quantity, for example the outer product of a and b is
The conformal geometric algebra [5] is the geometric algebra over an homogeneous
conformal space. This framework extends the functionality of projective geometry to include
circles and spheres. Furthermore, the dilations, inversions, rotations and translations in 3D
becomes rotations in the 5D conformal geometric algebra. These transformations can not
only be applied to points or lines, but to all the conformal entities (points, lines, planes,
point pairs, circles and spheres).
In the conformal geometric algebra (CGA) we firstly add two extra vector basis e+ and e to
our R3 Euclidean space {e1, e2, e3, e, e+}, where = 1 and = 1. We denote this algebra
with G4,1 to show that four basis vectors square to +1 and one basis vector square to 1. In
addition we define
we note that they are null vectors since . The vector e0 can be interpreted as
the origin of the coordinate system, and the vector e as the point at infinity. A few useful
properties (easily proved) about this basis are
Where E = e+ e is called the Minkowski plane.
To specify a 3-dimensional Euclidean point in an unique form in this 5-dimensional space,
we require the definition of two constraints. The first constraint is that the representation
must be homogeneous, that is X and X represent the same point in the Euclidean space.
The second constraint requires that the vector X be a null vector (X2 = 0). The equation that
satisfies these constraints is
Computer Vision
where x Rn and X Nn+1. Note that this is a bijective mapping. From now and in the rest
of the paper the points X are named conformal points and the points x are named Euclidean
points. A conformal point (7) lies on the intersection of the null cone Nn+1 and the
hyperplane Pn+1(e, e0), that is
A sphere on the CGA can be defined as
To test for incidence of a point X with an entity S expressed in the inner product null space
(IPNS) we use
A point in the CGA is represented using (9), but setting the radius r = 0 we get (7). Also note
that if x = 0 in (7) we get the point e0 of (5) corresponding to the origin of Rn. One interesting
thing about the conformal points is that their inner product
is a directly representation of the Euclidean distance between the two points. Thus, the inner
product has now a geometric meaning due to the concept of null vectors. Therefore, the
square of a conformal point X2 = XX = X ·X +X X = X ·X = 0 represents the Euclidean
distance with itself.
In the CGA two multivectors represent the same object if they differ by just a non zero scalar
factor, that is
Thus, multiplying (9) with a scalar λ we get
if we calculate the inner product of the above equation with respect to the point at infinity e
Paracatadioptric Geometry using Conformal Geometric Algebra
we have recover the scalar factor λ. Therefore, if we want to normalize a sphere S (i.e. λ = 1)
we apply
The same equation can be applied to points, remember that they are nothing but spheres of
zero radius. For other objects the common normalization is by its magnitude that is
where represents the i-vector part of the multivector M.
An important operation that is used in the geometric algebra is called reversion, denoted by
”~” and defined by
2.1 Geometric objects representation
The geometric objects can also be defined with the outer product of points that lie on the
object. For example, with four points we define the sphere
The incidence of a point X with the sphere S* expressed in the outer product null space
(OPNS) is
Both representation of the sphere (S and S*) are dual to each other, i.e. orthogonal to each
other in the representative conformal space. Therefore, the representations are equivalent if
we multiply them by the pseudoscalar Ic = e1 e2 e3 e+ e, thus
If one of the points of the sphere (18) is the point at infinity, then the sphere becomes a plane
(a flat sphere with infinite radius)
Similarly, the outer product of three points defines a circle C* = A B C, and if one of the
points of the circle is at infinity (C* = AB e) then the circle becomes a line (a flat circle
with infinite radius), see (Table 1). The line can also be defined as the outer product of two
This research hasn't been cited in any other publications.
  • Aspects of geometric algebra in euclidean, projective and conformal space Paracatadioptric camera calibration
    • C Perwass
    • D Hildenbrand
    • C Geyer
    • K Daniilidis
    Perwass, C., Hildenbrand, D.: Aspects of geometric algebra in euclidean, projective and conformal space. Technical Report Number 0310 (2003) Canudas de Wit, E., S.B., Bastian, G., eds.: Theory of Robot Control. Springer-Verlag (1997) Geyer, C., Daniilidis, K.: Paracatadioptric camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 (2002) 687–695
  • Aspects of geometric algebra in euclidean, projective and conformal space
    • C Perwass
    • D Hildenbrand
    Perwass, C., Hildenbrand, D.: Aspects of geometric algebra in euclidean, projective and conformal space. Technical Report Number 0310 (2003) Canudas de Wit, E., S.B., Bastian, G., eds.: Theory of Robot Control. Springer-Verlag (1997)
  • Article
    Full-text available
    Classical geometry has emerged from efforts to codify perception of space and motion. With roots in ancient times, the great flowering of classical geometry was in the 19th century, when Euclidean, non-Euclidean and projective geometries were given precise mathematical formulations and the rich properties of geometric objects were explored. Though fundamental ideas of classical geometry are permanently imbedded and broadly applied in mathematics and physics, the subject itself has practically disappeared from the modern mathematics curriculum. Many of its results have been consigned to the seldom-visited museum of mathematics history, in part, because they are expressed in splintered and arcane language. To make them readily accessible and useful, they need to be reexamined and integrated into a coherent mathematical system.
  • Article
    Full-text available
    The standard algebraic model for Euclidean space En is an n-dimensional real vector space ℝn or, equivalently, a set of real coordinates. One trouble with this model is that, algebraically, the origin is a distinguished element, whereas all the points of En are identical. This deficiency in the vector space model was corrected early in the 19th century by removing the origin from the plane and placing it one dimension higher. Formally, that was done by introducing homogeneous coordinates [110]. The vector space model also lacks adequate representation for Euclidean points or lines at infinity. We solve both problems here with a new model for En employing the tools of geometric algebra. We call it the homogeneous model of En .
  • Conference Paper
    Full-text available
    This paper presents fundamental theory and design of central panoramic cameras. Panoramic cameras combine a convex hyperbolic or parabolic mirror with a perspective camera to obtain a large field of view. We show how to design a panoramic camera with a tractable geometry and we propose a simple calibration method. We derive the image formation function for such a camera. The main contribution of the paper is the derivation of the epipolar geometry between a pair of panoramic cameras. We show that the mathematical model of a central panoramic camera can be decomposed into two central projections and therefore allows an epipolar geometry formulation. It is shown that epipolar curves are conics and their equations are derived. The theory is tested in experiments with real data.
  • Conference Paper
    Conventional video cameras have limited fields of view which make them restrictive for certain applications in computational vision. A catadioptric sensor uses a combination of lenses and mirrors placed in a carefully arranged configuration to capture a much wider field of view. When designing a catadioptric sensor, the shape of the mirror(s) should ideally be selected to ensure that the complete catadioptric system has a single effective viewpoint. In this paper, we derive the complete class of single-lens single-mirror catadioptric sensors which have a single viewpoint and an expression for the spatial resolution of a catadioptric sensor in terms of the resolution of the camera used to construct it. We also include a preliminary analysis of the defocus blur caused by the use of a curved mirror
  • Article
    Catadioptric sensors refer to the combination of lens-based devices and reflective surfaces. These systems are useful because they may have a field of view which is greater than hemispherical, providing the ability to simultaneously view in any direction. Configurations which have a unique effective viewpoint are of primary interest, among these is the case where the reflective surface is a parabolic mirror and the camera is such that it induces an orthographic projection and which we call paracatadioptric. We present an algorithm for the calibration of such a device using only the images of lines in space. In fact, we show that we may obtain all of the intrinsic parameters from the images of only three lines and that this is possible without any metric information. We propose a closed-form solution for focal length, image center, and aspect ratio for skewless cameras and a polynomial root solution in the presence of skew. We also give a method for determining the orientation of a plane containing two sets of parallel lines from one uncalibrated view. Such an orientation recovery enables a rectification which is impossible to achieve in the case of a single uncalibrated view taken by a conventional camera. We study the performance of the algorithm in simulated setups and compare results on real images with an approach based on the image of the mirror's bounding circle
  • Conference Paper
    Omnidirectional vision systems can provide panoramic alertness in surveillance, improve navigational capabilities, and produce panoramic images for multimedia. Catadioptric realizations of omnidirectional vision combine reflective surfaces and lenses. A particular class of them, the central panoramic systems, preserve the uniqueness of the projection viewpoint. In fact, every central projection system including the well known perspective projection on a plane falls into this category. In this paper, we provide a unifying theory for all central catadioptric systems. We show that all of them are isomorphic to projective mappings from the sphere to a plane with a projection center on the perpendicular to the plane. Subcases are the stereographic projection equivalent to parabolic projection and the central planar projection equivalent to every conventional camera. We define a duality among projections of points and lines as well as among different mappings. This unification is novel and has a a significant impact on the 3D interpretation of images. We present new invariances inherent in parabolic projections and a unifying calibration scheme from one view. We describe the implied advantages of catadioptric systems and explain why images arising in central catadioptric systems contain more information than images from conventional cameras. One example is that intrinsic calibration from a single view is possible for parabolic catadioptric systems given only three lines. Another example is metric rectification using only affine information about the scene.