> and I would like to be able to tell it not to keep featuring photos of my ex wife years after the divorce.

You can already do that by pressing the three dots menu on a featured photo or memory and selecting the Feature this person less, with then options to not feature at all or just less.