posted by user: grupocole || 1629 views || tracked by 2 users: [display]

MME 2026 : First Workshop on Multilingual Multicultural Evaluation

FacebookTwitterLinkedInGoogle

Link: https://multilingual-multicultural-evaluation.github.io/
 
When Mar 24, 2026 - Mar 29, 2026
Where Rabat, Morocco
Submission Deadline Dec 19, 2025
Notification Due Jan 23, 2026
Final Version Due Feb 3, 2026
Categories    NLP   artificial intelligence   computational linguistics
 

Call For Papers

*Workshop co-located with EACL, 24-29 March 2026, Rabat, Morocco*

LLMs in so many languages? When can such a claim be substantiated, and how should it be evaluated? This workshop brings together the community to answer these questions through three goals:
- Establish a dedicated venue for multilingual evaluation, including resources, metrics, and methodologies;
- Advance and standardize evaluation practices to enhance accuracy, scalability, fairness, and cross-system comparability;
- Integrate cultural and social dimensions into multilingual evaluation.

*Call for Papers*
We invite archival (ACL Anthology) or non-archival submissions, in ACL's short or long format. We accept both direct and ARR-reviewed submissions. Topics include, but are not limited to:
- Evaluation resources beyond English or Western-centric perspectives and materials;
- Annotation methodology and procedures;
- Standardised reporting, and scientific comparison of multilingual performance;
- Evaluation protocols: ranking vs direct assessment, rubric-based vs reference-based vs reference-free, prompt variations, etc;
- Metrics, LLM judges, and reward models;
- Complex tasks: multimodality, fairness, long I/O, tool using, code-switching, literary, etc;
- Sociocultural and cognitive variation affecting the use and evaluation across languages;
- Scalable evaluation of cultural and factual knowledge;
- Efficient evaluation of a massive number of languages and tasks;
- AI-assisted evaluation: data, methods, metrics, and standards;
- Other position, application-, or theory-focused contributions.

*Dates* (tentative, all dates are 23:59 AoE)
- Direct submission deadline: 19 Dec 2025
- Pre-reviewed ARR submission deadline: 02 Jan 2026
- Notification of acceptance: 23 Jan 2026
- Camera-ready version due: 03 Feb 2026
- Workshop date: 28 or 29 Mar 2026

Website: https://multilingual-multicultural-evaluation.github.io/
Email: mme-workshop@googlegroups.com
Submission: OpenReview, link TBD

Related Resources

Evaluation and Research in Education 2026   INVALSI Conference 2026 “Evaluation and Research in Education”
IOP-RICAS 2027   2027 International Conference on Robotics, Intelligent Control and Autonomous Systems (RICAS 2027)
AMLDS 2027   IEEE--2027 3rd International Conference on Advanced Machine Learning and Data Science
DEPLING 2023   International Conference on Dependency Linguistics
ACL 2027   The 65th Annual Meeting of the Association for Computational Linguistics
Ei/Scopus-ACEPE 2026   2026 3rd IEEE Asia Conference on Advances in Electrical and Power Engineering (ACEPE 2026)
SCM 2026   9th International Conference on Soft Computing, Control and Mathematics
AVC 2026   Advances in Vision Computing: An International Journal
IJCGA 2026   International Journal of Computer Graphics & Animation
NLPCL 2026   7th International Conference on Natural Language Processing and Computational Linguistics