Eye ball detection can be used for controlling certain applications. In this chapter, we describe the formulation of an eye ball detection system for design of an obstacle detection and avoidance technique. The obstacle detector is used with a vehicle and works by determining the location of an obstacle in the vicinity of a test object. The obstacle's distance is gauged from the test object in terms of corresponding voltages. The system uses image processing to detect the eye of the driver. If the eye of the driver is closed for a longer period than the threshold period then the image processing block sends a signal to the sensor which automatically takes control of the test vehicle.