Since the discovery of gamma rays, its uses are ever increasing in different fields such as in medicine, industry, agriculture, observational astronomy etc. Hence, there is a dire need of systematical study of the gamma ray interaction processes in different type of materials. For the use of a material at the place of radiation application, one must be acquainted with the basic knowledge of the related interaction phenomena that are occurring in a material. The present work deals with the interaction of medium energy gamma radiations with building materials. The gamma ray interaction parameters viz. mass attenuation coefficient, effective atomic number, buildup factor have been studied. Alongwith the computational work of these parameters, there is good amount of experimental work concerning the studies of transmitted photon spectra of Hg-203, Cs-137 and Co-60 isotopes in building materials. The main emphasis has been given on the contribution of multiple Compton scattering of gamma rays in transmitted photon spectra through the building materials. For present studies, the materials selected are the building materials, which always protect the us from the radiation exposure.