Efficient utilization of a residential photovoltaic (PV) array with grid connection is difficult due to power fluctuation and geographical dispersion. Reliable energy management and control system are required for overcoming these obstacles. This study provides a new residential energy management system (REMS) based on the convolution neural network (CNN) including PV array environment. The CNN is used in the estimation of the nonlinear relationship between the residence PV array power and meteorological datasets. REMS has three main stages for the energy management such as forecasting, scheduling, and real functioning. A short term forecasting strategy has been performed in the forecasting stage based on the PV power and the residential load. A coordinated scheduling has been utilized for minimizing the functioning cost. A real-time predictive strategy has been used in the actual functioning stage to minimize the difference between the actual and scheduled power consumption of the building. The proposed approach has been evaluated based on real-time power and meteorological data sets.