[Shivam Sharma (ShivamSharma43)]

Description

Fixes #3555.

_RedTeamSocialBiasDataset keeps the user turns of each "Multi Turn" row as SeedPrompts that share a prompt_group_id, with sequence=0, 1, ..., but left their role unset. SeedGroup requires a role on each sequence of a multi-sequence group, so building the seed groups (SeedDataset.seed_groups, or get_seed_groups_async after adding the dataset to memory) raised No roles set for sequence 0 in a multi-sequence group for every multi-turn row, and with it for the whole dataset.

Changes:

• The multi-turn prompts are created with role="user", like the other remote loaders that build multi-sequence groups (for example cyberseceval_prompt_injection_dataset.py and mask_dataset.py).

What the loader keeps is unchanged: it still drops the system and assistant turns, and single prompts are unchanged.

Tests and Documentation

• New test test_fetch_dataset_multi_turn_prompts_form_seed_groups in tests/unit/datasets/test_red_team_social_bias_dataset.py: the multi-turn prompts have role user, and dataset.seed_groups builds the multi-turn group with both turns in order. It fails on main (roles are None, and seed_groups raises).
• Ran the reproduction from BUG: red_team_social_bias multi-turn prompts have no role, so their seed groups fail validation #3555, and the same check on three real "Multi Turn" rows from svannie678/red_team_repo_social_bias_prompts: the seed groups now build, through SeedDataset.seed_groups and through memory.
• pytest tests/unit/datasets tests/unit/models: 7697 passed.
• ruff check, ruff format and ty check pass on the changed files.
• No documentation changes.

🤖 Generated with Claude Code

[Copilot]

Copilot was unable to review this pull request because the user who requested the review has insufficient remaining quota.