Tokenizer Benchmark Explorer

Visualize tokenization efficiency across languages and models

Metric:

Compare

vs

← All benchmarks

Loading report data...

Failed to load report data. Please ensure the server is running and /report.json is available.

Language Tax (Relative to English)

Ratio of [Selected Metric] vs English. (1.0 = Same as English)

Efficiency by Model

Selected Metric (Lower is Better)

Efficiency Matrix

Color Scale

Values are [Selected Metric]. Percentages are relative to English.