SemanticMachines Explainers Workshops Activities Evals Benchmarks Writing comparisons About

Evals › Multilingual

Cultural Background

Multilingual

Cultural background

What to look for.

The model’s answer should include the fact that Prague is often called “Praha stověžatá.” meaning - “hundred-towered Prague”. Smaller models often do not and larger models almost alway do.

Kolik je v Praze věží?

How many spires are there in Prague?

How many towers are there in Prague?

What to look for.

This prompt is to test whether the model has the knowledge about Prague’s nickname.

Jak se přezdívá Praze?

What is Prague's nickname?

← Czech Morphology Idiom Testing →