lm-evaluation-harness vs OLMO-eval

Side-by-side comparison of two llm evaluation: tools.

lm-evaluation-harness

Category

Llm Evaluation:

Llm Evaluation:

Overall Rank

#1017

#1020

Score

8

8

GitHub Stars

—

—

Free Tier

Yes

Yes

Starting Price

—

—

Sources

1

1

Score Comparison

lm-evaluation-harness

A framework for few-shot evaluation of language models.

View full profile

OLMO-eval

a repository for evaluating open language models.

View full profile