I can see no reason why we'd use the sampler cache; these reads are either scratch data (spilling or variably-indexed arrays) or pull constants. We write through the render cache, so being symmetric is probably a good thing.