POLYSIM 2026 - Participate

Registration and timeline

Registration details for the "POLYSIM Challenge 2026" will be announced soon.

Registration Period: 15 August – 15 October 2026
Progress Phase: 1 September – 31 October 2026
Evaluation Phase: 1 November – 15 November 2026
Challenge Results: 16 November 2026
Submission of System Descriptions: 25 November 2026
ACM MM Grand Challenge Paper Submission: 07 December 2026

Submission guidelines

Participants must submit a CSV file containing predictions for the test set, in the format:

sample_id,predicted_speaker_id

Within the directory containing the submission files, use zip archive.zip *.txt and do not zip the folder. Files should be named as:


                    sub_score_English_heard.txt
                    sub_score_English_unheard.txt
                    sub_score_Urdu_heard.txt
                    sub_score_Urdu_unheard.txt

Files are submitted through Codalab in the evaluation phase, with a maximum of 3 submissions per day.

We provide both train and test splits for v3 of MAV-Celeb dataset. Participants can use this split for fine-tuning their method. However, for v1 the test files are in format as below:


                    ysuvkz41 voices/English/00000.wav faces/English/00000.jpg
                    tog3zj45 voices/English/00001.wav faces/English/00001.jpg
                    ky5xfj1d voices/English/00002.wav faces/English/00002.jpg
                    yx4nfa35 voices/English/01062.wav faces/English/01062.jpg
                    bowsaf5e voices/English/01063.wav faces/English/01063.jpg

We have kept the ground truth for fair evaluation during POLYSIM challenge. Participants are expected to compute and submit a text file including the id and L2 Scores in the following format:


                    ysuvkz41 0.9988
                    tog3zj45 0.1146
                    ky5xfj1d 0.6514
                    yx4nfa35 1.5321
                    bowsaf5e 1.6578

The overall score will be computed as:

Overall Score = (Sum of all EERs) / 4

Rules & policies

Participation

Open to academic and industry researchers
Teams may consist of multiple members
One submission account per team

Model Constraints

A single model must be used for all task settings
Retraining per setting is not allowed

External Data

Use of external data must be clearly declared
Pretrained models are allowed unless otherwise stated

Ethical Use

Dataset is provided strictly for research purposes
Any misuse for surveillance or identity tracking is prohibited

Submission Rules

Limited number of submissions per day (3 submissions maximum)
Only the final submission will be used for ranking
Test labels are never released