The penetration of Electric Vehicles (EVs) is rapidly increasing at the Low Voltage (LV) level, thus increasing the electrification rate of transport. Moreover, Photovoltaic (PV) systems at the LV level have been constantly increasing as well. Buildings with PVs on their roof and EVs as the main transport means may well become the norm the following years, considering additionally that all new buildings in the EU should be Nearly Zero Energy Buildings (NZEBs). Such NZEBs should cover the majority of their low energy demand by Renewable Energy Sources, and PV technology is the main candidate to achieve that. Both these facts pose considerable challenges on the LV networks. In this context, this paper examines the potential of efficiently utilizing the stored energy of Battery Energy Storage Systems (BESSs) in order to face the increased load demand by the penetration of EVs in LV Distribution Networks (DNs), with the presence of PVs. A Particle Swarm Optimization (PSO) algorithm is developed in order to perform optimal charging schedule for the EVs under the aim of optimizing the DN voltage profile. The analysis is performed on a real LV DN with real load data and the results indicate that under proper charging schedule both the voltage profile and the energy losses of the DN could be improved.