SIGN IN SIGN UP

Feat/implement streaming path in audio transcription (#926)

* implement streaming path in audio transcription endpoint

Signed-off-by: WaelRabah11 <wael.rabah@multiversecomputing.com>

* Refactored proxy_multipart_request to share post call, headers, and error
  handling between streaming and non-streaming paths. Stats hooks
  (on_new_request/on_request_response/on_request_complete) now fire on both paths.
  Tutorial fixed to use with open(...). Tests pass (8/8).

Signed-off-by: WaelRabah11 <wael.rabah@multiversecomputing.com>

* Update src/vllm_router/services/request_service/request.py

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: Wael Rabah <47258198+WaelRabah@users.noreply.github.com>

* update streaming example, refactor try/except to reduce nesting and catch json decode errors

Signed-off-by: WaelRabah11 <wael.rabah@multiversecomputing.com>

* Added backend_response.close() to the non-streaming finally block

Signed-off-by: WaelRabah11 <wael.rabah@multiversecomputing.com>

* fix outdated test

Signed-off-by: WaelRabah11 <wael.rabah@multiversecomputing.com>

---------

Signed-off-by: WaelRabah11 <wael.rabah@multiversecomputing.com>
Signed-off-by: Wael Rabah <47258198+WaelRabah@users.noreply.github.com>
Co-authored-by: WaelRabah11 <wael.rabah@multiversecomputing.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
W
Wael Rabah committed
22112615a47ee3c1ccbcb2c5e7f3e27a87aa1adc
Parent: f4abc4d
Committed by GitHub <noreply@github.com> on 5/6/2026, 6:35:58 PM