I have built a Library Table out of quarter sawn white oak and made a bad finishing mistake.
I did not use filler and have finished with three coats of Rockhard Table Top Varnish and the grain pores are visible.
Do I have to sand off to bare wood and start over or is there something I can do now to correct. When I finish sanding they were not visible.
If you want to fill the grain pores with a grain filler, the standard practice is to first do a seal coat, then fill the pores. So in short, in your situation I would sand lightly with 220 grit (LOL you already have three seal coats), then apply a grain filler for which there are many options, then do a final two coats.
Linky here:
https://www.canadianwoodworking.com/tipstechniques/3-easy-steps-grain-filling
https://www.youtube.com/watch?v=SHVoXZk-PF0&t=248s