Feature selection in KNIME
There are many ways to select features for the model calculation. Previously I posted using randome forest importance.
This time I used the "Feature Selection Loop".
Using this loop, you can Forward select, Backward Select, Random select, AND GENETIC ALGORITHM select. What!? GA??? Was this there before in KNIME ver3?
GA is one of my favourite selection technique (not saying it's the best though) because it seems to select features different from the other techniques. So here are the options
In the middle, you just need to select from Fature selection strategy, Genetic Algorithm. I may use upper bound features too depeding on the sample size I guess.
Let it run with my AMES data and got this (sorted by Cohen's kappa).
So it shows on each rounds, what the chosen score was as well as the features used. Sweet, I can probably play around to see which features contributes more and/or just use the best model!
