k Nearest neighbor, Bayesian methods and genetic algorithms are effective methods of machine learning. In this work a hybrid method is formed by using these methods and algorithm together. The aim is to achieve successful results on classifying by eliminating data that make difficult to learn. Forming new data set approach is proposed according to good data on the hand. Test process is done with five of UCI machine learning datasets. These are iris, breast cancer, glass, yeast and wine data sets. Test results are investigated in collaboration with the previous works, and the success of the study is considered. (C) 2009 Elsevier Ltd. All rights reserved.