Would love to see the best simple solution too.

That is, the simplest idea that reaches top 25 with minimal amount of code and no overengineering.

It would be interesting to see the distribution of model types which power the top solutions across all competitions. I have a feeling gradient boosting will be very common.