**************************************************************************
1st Workshop on Benchmarking and Expanding AI Multimodal Approaches (BEAM)
Co-located with CVPR 2025
Dates: June 11th/12th, 2025
Place: Nashville, TN, USA (Co-located with CVPR 2025)
Website: https://beam-workshop2025.github.io/
CMT is open: https://cmt3.research.microsoft.com/BEAM2025/
**************************************************************************

-----------
DESCRIPTION
-----------

The 1st Workshop on Benchmarking and Expanding AI Multimodal Approaches at CVPR 2025 aims to build a forum to discuss ongoing efforts in industry and academia, share best practices, and engage the community in working towards more comprehensive AI evaluation framework incorporating audio, visual, and textual inputs, addressing the limitations of current unimodal benchmarks.
The event will feature discussions highlighting the evolution and future of multimodal AI benchmarks, exploring methodologies and their real-world applications. It will conclude with a dynamic panel discussion, offering insights into the challenges and solutions for creating robust multimodal benchmarks and fostering interdisciplinary collaboration and innovation in AI benchmarking standards.

======
Topics
======

We invite submissions of full-length papers (8 pages excluding the references) for workshop proceedings. The topics covered in the workshop include but are not limited to:
- Challenges in Multimodal AI Evaluation: Current limitations and the need for integrated assessments.
- Designing Multimodal Benchmarks: Strategies for creating realistic and comprehensive tasks.
- Ethical and Fair AI Evaluation: Addressing biases to ensure fairness across different demographic groups.
- Multimodal AI in Real-World Applications: Case studies demonstrating the application of multimodal systems.
- Future Directions in AI Benchmarking: Innovative methods and technologies.

----------
SUBMISSION
----------

All accepted papers will be published as part of CVPR 2025 workshop proceedings, therefore, should follow the same paper guidelines of the conference.
The papers will be subject to a double-blind review process, i.e. authors must not identify themselves on the submitted papers. The reviewing process is single-stage without rebuttals.
https://cvpr.thecvf.com/Conferences/2025/AuthorGuidelines
https://github.com/cvpr-org/author-kit/releases

For paper submission, please use the CMT site:
https://cmt3.research.microsoft.com/BEAM2025/

---------------
IMPORTANT DATES
---------------

March 11: Submission of full papers
March 25: Notification of acceptance
April 5: Camera-ready full paper submission
Workshop Date: June 11th or 12th (half-day)

-------------------
WORKSHOP ORGANIZERS
-------------------

Laszlo A. Jeni (CMU) Xu Zhang (Amazon)
Liuyue Xie (CMU) Morteza Ziyadi (Amazon)
Mosam Dabhi (CMU) Hao Yang (Amazon)
Rohan Choudhury (CMU) Yang Zou (Amazon)
Ananya Bal (CMU) Zhaowei Cai (Amazon)
Ce Zheng (CMU) Maria Zontak (Amazon)
Xiang Yue (CMU) Ashwin Swaminathan (Amazon)
Davide Modolo (Amazon)