An approach to user experience oriented interface design (UEOID) is proposed for further exploring the application of interface design in handheld mobile devices. A mapping model between interface providers and receivers is put forward. The interface is divided into explicit factors and tacit factors, and the explicitization design model of tacit factors is presented. By analyzing the knowledge transformation among requirement analysis, development and design and design test, the UEOID process model is built for new software development. Taking the Olympic mobile TV software development as an example, users are asked to participate in the whole design process, and user study and requirement analysis are fulfilled with design ethnography method. With the iteration of prototype design, design assessment, system development and design, the system prototype is built and tested. Thus the UEOID theory is verified.