SIGN IN SIGN UP

Make the vision tower a knob instead of a flag-order accident

--language-model-only was hardcoded in both exec lines, so the only way to
serve images was to pass --no-language-model-only through EXTRA_ARGS and rely
on argparse taking the last flag. That breaks silently when the exec line is
edited: images are still accepted and still counted as prompt tokens, and the
model answers from placeholder embeddings.

VISION=0 stays the default and the command line is unchanged. VISION=1 swaps in
--limit-mm-per-prompt and --mm-processor-kwargs; both stay overridable from
EXTRA_ARGS, which is expanded after them, so only the flag that cannot be
countered gets a knob.

Gotcha 9's 2.7 GB for the tower does not hold on these checkpoints. model.visual.*
sums to 0.858 GiB of BF16 in both the base dir and the -fast variant, and a
runtime A/B agrees: model loading 15.13 GiB against 14.26, same server, same
config, with non-weight overhead 0.42 against 0.41 GiB either way. The tower is
BF16 in both dirs, so quantization is not the explanation; where 2.7 GB came
from I could not work out.
P
PassivePicasso committed
56c00cb013080870f89f52d29d22719de34168d6
Parent: 57201c1