The fluorescence of an atomic transition can generate the elementary particle of light: a single photon. Conversely, the illumination of an atom with a single photon provides a tool to systematically study light-matter interactions on a fundamental level. Furthermore, single photons are a resource for tap-proof quantum communication. The efficient coupling of a single photon to a single atom is at the core of many quantum repeater protocols. Quantum repeaters are required for long-distance quantum communication. Efficient photon-atom interaction requires a matching of the photon and the atom in every spatial, spectral, temporal, and polarization degree of freedom. Widely-used sources of single photons are trapped atoms, rare earth ions in a host crystal, single molecules, vacancy centers in diamond, cadmium selenide nanocrystals, indium gallium arsenide quantum dots, four-wave mixing in either an atomic vapor or a noble-gas-filled photonic crystal fiber, or parametric down-conversion in a nonlinear optical medium. In parametric down conversion, single pump photons can split up into a pair of photons, namely the signal and the idler photon. Parametric frequencies can typically by generated between the near-ultraviolet and the far-infrared part of the electromagnetic spectrum, which may allow for a coupling to a huge variety of atomic transitions. The spectral bandwidth of the photons in single-pass parametric down-conversion, however, is typically at the terahertz scale. This leads to extremely low coupling rates to atomic transitions, when an atomic linewidth at the megahertz scale is given. A small photon bandwidth can be achieved in an optical parametric oscillator, in which the nonlinear effects are enhanced by placing the nonlinear medium in an optical resonator. In our experiments, we combine the nonlinear medium and the optical resonator in one monolithic device: a whispering-gallery mode resonators made of lithium niobate. Light is guided via the effect of total internal reflection around the circumference of these highly transparent microdiscs. One degree of freedom not fixed for our parametric converter is the manifold of eigenmodes, which typically comprises different longitudinal and transversal modes. Therefore, we developed a novel method to identify the different eigenmodes of whispering-gallery mode resonators based on their relative resonance frequencies and spatial emission patterns. In a next step, we could demonstrate the operation of our single photon source in a single parametric mode. This was based on the very low absorption in lithium niobate and the monolithic design of the resonator with the triply resonance for pump, signal, and idler. By selecting specific mode triplets for parametric down-conversion, we demonstrated temperature tuning of the parametric wavelengths from single 790-1630 nm in steps of approximately 8.2 GHz, as well as continuous tuning with megahertz resolution. The latter was achieved by placing a movable dielectric substrate within the evanescent field of the resonator. We then showed the compatibility of our system to an arbitrary atomic transitions by tuning the signal frequency to the D1 lines of rubidium and cesium at a wavelength of 795 nm and 895 nm, respectively. These two alkaline transitions are widely-used in quantum optics, and especially quantum information, due to their strong dipole interactions and favorable structures of the energy levels. In a subsequent experiment, we showed complete absorption of resonant signal photons in cesium and rubidium vapor. The correlation measurement between the fluorescent photons from the cesium D1 line and the idler photons directly gives information on the natural linewidth of this transition. This demonstration of frequency and bandwidth matching is one major step towards practical quantum repeaters. Parametric down-conversion in whispering-gallery mode resonators provides an efficient, low-cost, robust, and non-cryogenic source of tunable single photons and bright squeezed light, when optical parametric oscillator is driven above the oscillation threshold. Narrowband single photons are especially interesting for an investigation of semiconductor or crystalline quantum dots, single atoms, atomic clouds, or optomechanical resonators. The high efficiency of single photon generation reduces respective measurement times and allows to access multiphoton transitions.