Microarray technology is used for monitoring thousands of genes at a similar time. This work employs feature selection technique to identify the differently expressed genes by selecting a subset of genes, selecting top ranked genes or removing the redundant genes for better classification model. This work presents the efficiency of three feature selection methods namely one-way ANOVA, Kruskall-Wallis and T-Test for gene selection on three publically available microarray dataset followed by classification of those using Naive Bayes, Binary SVM and Multiclass SVM classification algorithms. The results show the effectiveness of feature selection algorithms on three microarray cancer datasets namely MLL_Leukemia, Lung and SRBCT.