Question

Is it possible to improve the performance of KNN using an AdaBoost ensemble classifier that uses KNN as the base classifier? Give the detailed (qualitative) reasons on your assertions

Answer 1

Yes, the ensemble improve the performance of the knn classification, as in ensemble there are multiple trees use to improve the performance of the knn classification compared to use of the knn classification with base classified. The use of the ensemble classification lower the variance and increase the performance.

The KNN classification with ADA booting uses ensemble of tree to boost the classification performance, while the knn classification with base classifier performce on a average compareted to adaboost classifier. The boost in the performance is due to lower variance.

So, knn classification with adaboost is preferred.

-------------------------------------------------------------Please Upvote---------------------------------------------------------------------------------