Build error
Agents
12
Comparia Leaderboard
📉
Leaderboard of the French government's chatbot arena
Ministère de la Culture (SNUM)
government
Verified
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
View all Papers Organization Card
Compar:IA is a conversational AI comparison tool (a "chatbot arena") developed within the French Ministry of Culture, with a dual mission:
- Raise awareness about model diversity, cultural and linguistic biases, and the environmental impact of conversational AIs.
- Create and publish open datasets of prompts and user preferences to observe usage and improve French-language conversational AIs.
It is developed by a State startup team incubated by the Atelier numérique and AllIAnce, within the beta.gouv.fr program of the Interministerial Digital Directorate (DINUM), which helps public administrations build useful, simple, user-friendly digital services.
✨ Try compar:IA 📧 Contact us 💻 Code repository
The data collected through compar:IA is published as a single open dataset:
💬 comparia-fr-arena
French-language conversations and human preferences from the arena: the two anonymous models' answers to each prompt, the user's per-turn preference, full conversations, and rich metadata (themes, languages, tokens, latency, estimated energy use).
675K+ paired responses |
~208K human preferences |
115+ models compared |
models 0
None public yet