The research area we have chosen within Computer Science is an overlapping area between Natural language processing and Machine translation. The main goal is to facilitate the deaf people while interacting with unimpaired. In this regard, we have worked on speech translation into Pakistan Sign Language. Natural language processing can enhance the way of using computers while Machine translation can break the language barrier. Communication is a basic human need. People without hearing impairment have the ability to listen and speak but deaf people cannot hear and if they are by birth deaf then they cannot even speak. So deaf people use signs to communicate, these signs are known as sign language. The main purpose of this research is to explore the challenges currently facing the deaf while interacting with unimpaired people and then providing a solution that can facilitate this communication. One part of this goal is to explore the challenges and possible solutions for computer supported speech translation into Pakistan Sign Language.