>
> Some kind of overlay that shows citations as they would (at least as close as possible) look in the export?

Something like this?

https://github.com/andras-simonyi/org-cite-csl-activate

I think he was hoping to incorporate that into the oc-csl processor at
some point, and that would indeed be another approach to in-buffer
previewing.