For a server, I likely don't need or even want most of the stuff that's on a stock android install (or even kernel). GPS, audio, graphics drivers, mic, camera, SMS, etc are all worthless at best. Bluetooth (and maybe wifi, if you're USB-plugged) represent explicit unnecessary attack surface for a device that I'll be running with dodgy ported software inside my home network.