[mypyc] Make librt tests resilient to cleaning all .so files (#21682)

If `.so` files have been deleted, don't use cached librt build as it
won't work.