COMMITS
/ examples/server/README.md December 11, 2024
C
docs: fix server documentation formatting (#10776)
CentricStorm committed
December 10, 2024
Y
December 7, 2024
X
server : (refactor) no more json in server_task input (#10691)
Xuan Son Nguyen committed
G
server : various fixes (#10704)
Georgi Gerganov committed
December 6, 2024
X
server : (refactoring) do not rely on JSON internally (#10643)
Xuan Son Nguyen committed
December 3, 2024
X
server : (web ui) Various improvements, now use vite as bundler (#10599)
Xuan Son Nguyen committed
N
readme : add option, update default value, fix formatting (#10271)
Nikolaos Pothitos committed
December 2, 2024
X
llama : add enum for built-in chat templates (#10623)
Xuan Son Nguyen committed
G
make : deprecate (#10514)
Georgi Gerganov committed
H
server: Add "tokens per second" information in the backend (#10548)
haopeng committed
November 25, 2024
G
server : enable cache_prompt by default (#10501)
Georgi Gerganov committed
November 16, 2024
J
llama/ex: remove --logdir argument (#10339)
Johannes Gäßler committed
November 13, 2024
A
server : add missing docs (#10269)
Alexey Parfenov committed
November 11, 2024
G
server : enable KV cache defrag by default (#10233)
Georgi Gerganov committed
November 7, 2024
X
server : revamp chat UI with vuejs and daisyui (#10175)
Xuan Son Nguyen committed
November 4, 2024
X
server : clarify /slots endpoint, add is_processing (#10162)
Xuan Son Nguyen committed
October 29, 2024
G
llama : remove Tail-Free sampling (#10071)
Georgi Gerganov committed
October 25, 2024
W
llama : add DRY sampler (#9702)
wwoodsTM committed
October 24, 2024
X
server : refactor slot input data, move tokenizer to HTTP thread (#10023)
Xuan Son Nguyen committed
October 18, 2024
G
server : add n_indent parameter for line indentation requirement (#9929)
Georgi Gerganov committed
October 15, 2024
G
server : improve infill context reuse (#9894)
Georgi Gerganov committed
October 13, 2024
G
server : accept extra_context for the infill endpoint (#9874)
Georgi Gerganov committed
G
server : reuse cached context chunks (#9866)
Georgi Gerganov committed
October 12, 2024
G
server : add option to time limit the generation phase (#9865)
Georgi Gerganov committed
G
server : remove self-extend features (#9860)
Georgi Gerganov committed
G
server : remove legacy system_prompt feature (#9857)
Georgi Gerganov committed
G
llama : improve infill support and special token detection (#9798)
Georgi Gerganov committed
October 8, 2024
X
server : better security control for public deployments (#9776)
Xuan Son Nguyen committed
October 4, 2024
D
Fixed RNG seed docs (#9723)
Daniel Kleine committed
September 28, 2024
G
llama : add reranking support (#9510)
Georgi Gerganov committed
September 25, 2024
X
server : add more env vars, improve gen-docs (#9635)
Xuan Son Nguyen committed
September 23, 2024
X
server : add --no-context-shift option (#9607)
Xuan Son Nguyen committed
September 18, 2024
V
server : match OAI structured output response (#9527)
Vinesh Janarthanan committed
September 17, 2024
B
arg : add env variable for parallel (#9513)
Bert Wagner committed
September 15, 2024
G
common : reimplement logging (#9418)
Georgi Gerganov committed
September 12, 2024
M
server : Add option to return token pieces in /tokenize endpoint (#9108)
Mathijs Henquet committed
September 9, 2024
X
common : move arg parser code to `arg.cpp` (#9388)
Xuan Son Nguyen committed
September 7, 2024
X
common : refactor arg parser (#9308)
Xuan Son Nguyen committed
G
llama : refactor sampling v2 (#9294)
Georgi Gerganov committed
August 27, 2024
X
server : add some missing env variables (#9116)
Xuan Son Nguyen committed
August 21, 2024
X
server : support reading arguments from environment variables (#9105)
Xuan Son Nguyen committed
August 16, 2024
X
server : refactor middleware and /health endpoint (#9056)
Xuan Son Nguyen committed
August 6, 2024
X
server : add lora hotswap endpoint (WIP) (#8857)
Xuan Son Nguyen committed
July 31, 2024
I
server : update llama-server embedding flag documentation (#8779)
Igor Okulist committed
July 25, 2024
U
docs : Quantum -> Quantized (#8666)
Ujjawal Panchal committed
July 22, 2024
J
server : update doc to clarify n_keep when there is bos token (#8619)
Jan Boon committed
July 15, 2024
X
fix ci (#8494)
Xuan Son Nguyen committed
July 7, 2024
B
server: Retrieve prompt template in /props (#8337)
Bjarke Viksøe committed
July 5, 2024
P
readme : fix minor typos [no ci] (#8314)
Pieter Ouwerkerk committed