Morph MORPH
SIGN IN SIGN UP
dhruvhead / open-instruct UNCLAIMED
0 0 0 Python

COMMITS

/ eval/utils.py
human_eval
October 3, 2023
Y
Support batch eval for trutufulqa mc setup.
yizhongw committed
677cbd0
September 22, 2023
Y
Merge pull request #62 from OyvindTafjord/fix-logprobs
Yizhong Wang committed
12950e0
Y
Use fast tokenizer by default.
yizhongw committed
28d5366
O
Fix merge issue
Oyvind Tafjord committed
ef0d437
O
Merge remote-tracking branch 'upstream/main' into fix-logprobs
Oyvind Tafjord committed
0ddab2b
O
Fix MMLU answer prompts and logprobs normalization
Oyvind Tafjord committed
ad2385f
September 4, 2023
Y
Use import_module to dynamically import the chat formatting function, allowing more flexibility for user-defined formatting.
yizhongw committed
1a35973
August 14, 2023
Y
Manually set the max length of OPT/Pythia tokenizers.
yizhongw committed
d97721e
Y
minor fix
yizhongw committed
3af76e3
Y
Fix a bug: when loading models, the code now will use `auto` torch_dtype, and only convert to half if the user explicitly specify that.
yizhongw committed
d649539
Y
Fix a bug: when loading models, the code now will use `auto` torch_dtype, and only convert to half if the user explicitly specify that.
yizhongw committed
9cad3d2
Y
Fix a bug: during evaluation, we add back special token by default.
yizhongw committed
52ed964
July 24, 2023
Y
fix a bug in keyword stopping criteria
yizhongw committed
b156a22
June 9, 2023
H
initial commit
Hamish Ivison committed
e44fcf5