One point that I don't find raised much in the NMF literature is how rotational ambiguity (non-uniqueness) is dealt with systematically - is the exploration of factor rotations just not necessary?
From my understanding the vectors don't really matter so much. We care more about the subspace they span (because we want to project our data into it). So any rotation is as fine as any other.