Good to hear, thought I might have missed some obscure setting somewhere...
That said, I ended up modifying the way I "normally" work ie usually reference the buildings into the site plan.
What I do for the time being is reverse that process - ie rotate the building(s) so as to have ortho view, then Xref the site and rotate the Xref as needed... Which goes against what I was always taught but what to do...