Benchmarks

All Coding Japanese Knowledge Math Overall Reasoning Vision

Japanese

100 questions requiring Japanese knowledge and reasoning by ELYZA.

Metrics: Score (0-5)

Dataset

Japanese

Japanese commonsense reasoning QA dataset with 5-choice questions.

Metrics: Accuracy (%)

Paper Dataset

Japanese

Japanese General Language Understanding Evaluation - text classification, sentence pairs, QA.

Metrics: Accuracy (%)

Paper Dataset

Japanese

Japanese version of MT-Bench for multi-turn conversation evaluation.

Metrics: Score (1-10)

Dataset

Japanese

Comprehensive Japanese LLM evaluation covering reasoning, knowledge, coding, safety.

Metrics: Score (0-1)

Dataset