I think of it as they are additive biased. ie "dont think about the pink elephant ". Not only does this not help llms avoid pink elphants instead it guarantees that pink elephant information is now being considered in its inference when it was not before.
I fear thinking about problem solving in this manner to make llms work is damaging to critical thinking skills.
I fear thinking about problem solving in this manner to make llms work is damaging to critical thinking skills.