For free atoms, yes. For atoms in a crystal lattice (or other solid), it's quite common for electrons to decay through phonon interactions, i.e. by emitting vibrations (i.e. heat) to the lattice.