Files

scripts

haileyschoelkopf

and

lintangsutawika

make write_out.py explicitly error if no splits match (EleutherAI#1796 )

Jun 13, 2024

ed72238 · Jun 13, 2024

This branch is 95 commits ahead of, 201 commits behind EleutherAI/lm-evaluation-harness:main.

Name		Name	Last commit message	Last commit date
parent directory ..
clean_training_data		clean_training_data	`samples` is newline delimited (EleutherAI#1930 )	Jun 13, 2024
__init__.py		__init__.py	Add inits	May 12, 2021
build_benchmark.py		build_benchmark.py	Apply some best practices and guideline recommendations to code (Eleu…	Jan 28, 2024
cost_estimate.py		cost_estimate.py	Cleanup and fixes (Task, Instance, and a little bit of *evaluate) (El…	Mar 6, 2024
get_prompts.py		get_prompts.py	Switch Linting to `ruff` (EleutherAI#1166 )	Dec 20, 2023
make_gpt2_test_cases.py		make_gpt2_test_cases.py	Switch Linting to `ruff` (EleutherAI#1166 )	Dec 20, 2023
make_table_results.py		make_table_results.py	`samples` is newline delimited (EleutherAI#1930 )	Jun 13, 2024
make_table_tasks.py		make_table_tasks.py	`samples` is newline delimited (EleutherAI#1930 )	Jun 13, 2024
model_comparator.py		model_comparator.py	Refactor utilities into a separate model utils file. (EleutherAI#1429 )	Feb 14, 2024
regression.py		regression.py	Apply some best practices and guideline recommendations to code (Eleu…	Jan 28, 2024
requests_caching.py		requests_caching.py	Create a means for caching task registration and request building. Ad… (	Feb 26, 2024
write_out.py		write_out.py	make write_out.py explicitly error if no splits match (EleutherAI#1796 )	Jun 13, 2024
zeno_visualize.py		zeno_visualize.py	Results filenames handling fix (EleutherAI#1926 )	Jun 11, 2024