Most studies addressing the use of recycled asphalt materials in asphalt paving mixtures are based on experimental tests and performance evaluation. Investigating the effect of adding recycled materials to the microstructure of asphalt mixtures has received little consideration. For example, higher order microstructural information can be used in place of simple volumetric information as input in micromechanical models that can more accurately predict effective properties of asphalt mixtures. In this paper, the influence of adding three different recycled materials, Reclaimed Asphalt Pavement (RAP), Manufacturer Waste Scrap Shingles (MWSS), and Tear-Off Scrap Shingles (TOSS) on the microstructural distribution of the aggregate phase is investigated using digitally processed images of asphalt mixtures and numerical evaluation of 2- and 3-point correlation functions. No significant variations are found among the gradation curves and minimal differences were observed for 2- and 3-point correlation functions. This indicates the addition of the recycled materials does not significantly affect the aggregate spatial distribution of the asphalt mixtures. However, an increase in autocorrelation length was found for some of the mixtures containing recycled shingles.