We consider jointly modelling a finite collection of quantiles over time under a Bayesian nonparametric framework. Formal Bayesian inference on quantiles is challenging since we need access to both the quantile function and the likelihood (which is given by the derivative of the inverse quantile function). We propose a flexible Bayesian transformation model, which allows the likelihood and the quantile function to be directly calculated, and define a novel stationary process which can be “centred” over a parametric model. Markov chain Monte Carlo (MCMC) methods are employed to illustrate the usefulness of the model in fitting and forecasting on a sample of stock, index, and commodity returns.