> Intentionally or not, the word "eval" has become increasingly vague. I've seen at least 6 distinct definitions of evals

This. I am so tired of people saying evals without defining what they mean. And now even management is asking me for evals and why we are not fine tuning.