The amount of error you are okay with is job dependent. Chasing a certain number will make you pull your hair out. Every material will be different and if you need better accuracy you can raise the material closer to your gantry.
Sounds like things are very good right now, use it get it dirty, worry about it if you really need to but I have not cut anything yet that I have actually needed calipers to measure. I have a large machine and cut large pieces. If you cut something like a PCB those numbers will be better because the forces on the bit are so much lower.
I’d say just have some fun with it.