Only propagate physics server transforms when different