Conference Paper

The See-Through System: From Implementation to Test-Drive

DOI: 10.1109/VNC.2012.6407443 Conference: 2012 IEEE Vehicular Networking Conference (VNC) (VNC 2012)


Cooperative awereness in vehicular networks is probably the killer application for vehicle-to-vehicle (V2V) communications that cannot be matched by infrastructure-based alternatives even when disregarding communication costs. New and improved driver assistance systems can be introduced by extending their reach to sensors residing in neighboring vehicles, such as windshield-installed cameras. In previous work, we defined theoretical foundations for a driver assistance system that leverages on V2V communication and windshield-installed cameras to transform vision-obstructing vehicles into transparent tubular objects. We now present an implementation of the actual see-through system (STS), where we combine the communication aspects with the control and augmented reality components of the system. We present a validation methodology and test the system with multiple vehicles on closed road segment. This evaluation shows that the STS is able to increase the visibility of drivers intending to overtake, thus increasing the safety of such critical maneuvers. It also shows that Dedicated Short Range Communication (DSRC) provides the required latency for this delay-critical inter-vehicle communication, which could hardly be guaranteed with infrastructure-based communication technologies.

Download full-text


Available from: Pedro Gomes, May 06, 2014
  • Source
    • "[6], we used a transparent LCD installed on the windshield as the HCI architecture that provides the optical AR needed to implement STS. We observed some problems using the transparent LCD technology installed on the windshield. "
    [Show abstract] [Hide abstract]
    ABSTRACT: The confined space of a car and the configuration of its controls and displays towards the driver, offer significant advantages for Augmented Reality (AR) systems in terms of the immersion level provided to the user. In addition, the inherent mobility and virtually unlimited power autonomy transform cars into perfect mobile computing platforms. However, the limited network connectivity that is currently available in automobiles leads to the design of Advanced Driver Assistance Systems (ADAS) that create AR objects based only on the information generated by on-board sensors, stored maps and databases, and eventually high-latency online content for Internet-enabled vehicles. By combining the new paradigm of Vehicular Ad Hoc Networking (VANET) with AR human machine interfaces, we show that it is possible to design novel cooperative ADAS, that base the creation of AR content on the information collected from neighbouring vehicles or roadside infrastructures. We provide a prototype implementation of a visual AR system that can significantly improve the driving experience.
    Full-text · Conference Paper · Oct 2013
  • Source
    • "Optical see-through AR can also be implemented through transparent Liquid Crystal Displays (LCD), embedded in the windshield. In [20] we have implemented an overtaking assistant, known as the See-Through System (STS) [19], which combines such AR technology with low-latency video streaming transmitted between two vehicles using Dedicated Short-Range Communications (DSRC). The result is the transformation of long and vision-obstructing vehicles into see-through tubular objects, which greatly facilitates the overtaking manoeuvre. "
    [Show abstract] [Hide abstract]
    ABSTRACT: With the advent of vehicular communications and new developments in enhanced reality for Advanced Driver Assistance Systems (ADAS), we present in this position paper a new highway revenue model based on digital advertising super-imposed on physical billboards. We show that there is a strong correlation between economic development and an extensive road network. However, the public support for maintaining and expanding the road network is diminishing since these investments mainly rely on taxation. The common approach is to introduce tolls as a revenue generating method for supporting these investments. We argue that virtual billboards could provide an alternative revenue stream and avoid tolls in highways with high volumes of traffic. The key technologies are vehicular-to-infrastructure (V2I) communications and virtual windshields that already provide enhanced reality for ADAS. The physical billboards would transmit targeted advertising to approaching vehicles that would overlay it on top of the billboard sign. We demonstrate that it is already possible to implement this system with existing technologies. These digital ads would combine the flexibility of Internet advertisement with the high exposure of highway billboards and the willingness to receive them as an alternative to paying tolls. Finally, we show that it is viable to provide advertisement sponsored highway segments with very low cost-per-view values, especially in suburban highways that have a high volume of traffic.
    Full-text · Conference Paper · Jan 2013
  • [Show abstract] [Hide abstract]
    ABSTRACT: Visual obstruction caused by a preceding vehicle is one of the key factors threatening driving safety. One possible solution is to share the first-person-view of the preceding vehicle to unveil the blocked field-of-view of the following vehicle. However, the geometric inconsistency caused by the camera-eye discrepancy renders view sharing between different cars a very challenging task. In this paper, we present a first-person-perspective image rendering algorithm to solve this problem. Firstly, we contour unobstructed view as the transferred region, then by iteratively estimating local homography transformations and performing perspective-adaptive warping using the estimated transformations, we are able to locally adjust the shape of the unobstructed view so that its perspective and boundary could be matched to that of the occluded region. Thus, the composited view is seamless in both the perceived perspective and photometric appearance, creating an impression as if the preceding vehicle is transparent. Our system improves the driver's visibility and thus relieves the burden on the driver, which in turn increases comfort. We demonstrate the usability and stability of our system by performing its evaluation with several challenging data sets collected from real-world driving scenarios.
    No preview · Article · Oct 2014 · Computer Graphics Forum
Show more