SIGN IN SIGN UP

fix: Make VLLM model_impl configurable (#3358)

* Add ResponseFormat.DOCLANG and parsing branch in VLM pipeline

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* fix: Remove bogus preamble from VLM chat template

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* fix: Add include_stop_str_in_output in allowed VLLM sampling params

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* allow vllm model_impl to be defined

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* make VLLM model_impl default to auto

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

---------

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>
C
Christoph Auer committed
a6a37ca895d81979f79cdb71194e51347dc56b4d
Parent: 0f6f8d0
Committed by GitHub <noreply@github.com> on 4/24/2026, 7:53:23 AM