International Fusion Materials Irradiation Facility (IFMIF) is a proposal of D-Li intense neutron source to cover all aspects of the fusion materials development in the framework of IEA collaboration. The new activity has been started to qualifying the important technical issues called Key Element technology Phase since 2000. Although the neutron spectrum can be adjusted by changing the incident beam energy, it is favorable to be carried out many irradiation tasks at the same time under the unique beam condition. For designing the tailored neutron spectrum, neutron nuclear data for the moderator-reflector materials up to 50 MeV are required. The data for estimating the induced radioactivity is also required to keep the radiation level low enough at maintenance time. The candidate materials and the required accuracy of nuclear data are summarized.