SIGN IN SIGN UP

refactor: auto offload strategy, add vision_quant to PipelineConfig

Remove cpu_offload, layer_offload, adaptive_offload and offload_compression
from QuantFuncPipelineConfig. libquantfunc now picks the VRAM/offload
strategy at runtime based on free VRAM and model size, which avoids users
having to hand-tune parameter combos per machine.

Legacy workflows that still set these keys continue to load — libquantfunc
silently ignores them with a one-time deprecation warning.

Add vision_quant (int8/int4/fp8/fp4/fp16, default int8) to mirror the
existing text_precision and expose vision-encoder quantization.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Y
yejianhui committed
a8d020b6b00c10dec9c4aeb0dcd76e7e91c95e44
Parent: 6c07339