The intrinsic size checks were very slow

Now we run them once per render object.

Fixes #2487