Recently, the Internet community has been working on extensions to the current Internet protocol suite in order to enable service guarantees or differentiation. However, standardised solutions to integrate IP and ATM still are restricted to best-effort service. Therefore, this paper deals with a framework for QoS based interworking between IP and ATM. Network element state with QoS attributes is thereby controlled by RSVP and ATM and an appropriate translation from and to each other. Signalling and traffic control issues related with that translation are of particular concern for this paper. Moreover, the building blocks of an interworking unit prototype architecture as planned by the ACTS DIANA project are presented.