Fix panics from spawn_local tasks dropped on other threads in remote server (#21022)

Closes #21020

Release Notes:

- Fixed remote server panic of "local task dropped by a thread that
didn't spawn it"