Restore listening state after empty audio turns