Attention is not salience

Salience is what a screen shouts. Attention is what a person is looking for. Models are good at the first and blind to the second.

Consequence

Predicted heatmaps are useful for spotting noise and useless for judging whether a task can be done. For that, you still need real eyes and a real task.