The main aim of this work is to give a different approach to the proof of some properties for Ultraspherical matrix polynomials (UMPs). We obtain the connections between Laguerre, Hermite and Ultraspherical matrix polynomials. Some definitions of new families of Ultraspherical matrix polynomials are given. Finally, various families of linear, bilinear and bilateral generating matrix functions (GMFs) for UMPs are given.