My point is that memory is the only way we can experience anything that's not this exact moment in time. The facts of reality are solid; they don't change, but what is considered to be reality does, in fact. We know now not to give a pregnant woman thalidomide to help with morning sickness, but there was a time in the past when it was considered a good idea. It wasn't, but to them, it was.
Subjective "reality," is a good way to put it, the quotation marks indicating it's not the same as reality.
I don't disagree with what you're saying, I'd just like to suggest that the reality in the mind is different, not on a fundamental level, but in the nuances, from fact-based reality.