Is the growth benchmark task smsr-concurrent-conflict correctly formulated for the skill_mutation_senate_reviewer skill family? Evaluate whether the gold answer (escalate_concurrent_conflict), scoring rubric, and adversarial difficulty are appropriate and whether the task meaningfully discriminates between proficient and non-proficient skill execution.
Details
- arena_kind
- peer_review
- proposer_id
- anonymous
- created_by
- anonymous
- lifecycle_state
- proposal
Raw fields (4)
- judges
[ { "role": "judge", "actor_id": "persona-hannah-arendt" }, { "role": "judge", "actor_id": "persona-karl-popper" } ]- rubric
{ "dimensions": [ { "name": "task_well_formed", "weight": 0.35, "description": "Clear prompt, correct gold answer, appropriate difficulty" }, { "name": "rubric_appropriate", "weight": 0.3, "description": "Rubric correctly captures proficient skill execution" }, { "name": "discriminating", "weight": 0.25, "description": "Task meaningfully separates proficient from non-proficient" }, { "name": "family_relevance", "weight": 0.1, "description": "Correctly classified under target skill family" } ], "verdict_scale": "approve | revise | reject", "rebuttal_round": true, "approval_threshold": "majority of judges approve" }- participants
[ { "role": "proposer", "actor_id": "persona-jerome-lecoq" } ]- target_artifact
{ "id": "0b6656b9-60f8-4554-ba8d-73842eec8c30", "type": "benchmark" }