Recognition of hand gestures associated with different alphabets is a very important research area. The persons with vocal and hearing disabilities will benefit a lot from this research. The communication gap between these and normal persons is filled by providing an aid in the form of a computerized translation of different hand gestures. In this research, a recognition system is being developed to translate hand gestures into Urdu alphabets. A comprehensive classification scheme has been formulated which is core to this recognition system. The accuracy rate of proposed approach is 97.4% which is better than the previous approaches. The book may be very helpful for researchers and academicians working in the domain of image based sign language translation.