Submission Instructions

• - We calculate scores for each of the tasks based on their individual metrics. TThese scores are then averaged to obtain ORCA score.
• - On the main leaderboard, only the submission that covers all 29 tasks is shown or ranked by ORCA score.
• - On the individual task leaderboard, all submissions are shown and ranked by the task's score metric.
• - The results of all 29 tasks are required to obtain the ORCA score and appear on the main/full leaderboard.
• - We provide fine-tuning examples on ORCA's GitHub.
• - Please compress all prediction files (e.g., hate-speech_predictions.txt).
• - Ensure that all submission requirements are complete.
• - Submissions are private by default.
• - Competitors may choose to make their submission public.
• - Submissions are permanent and cannot be deleted.