{"answers": ["4"], "evidence": [{"doc_id": "doc_000171", "sent_id": 4}, {"doc_id": "doc_000171", "sent_id": 5}, {"doc_id": "doc_000007", "sent_id": 2}], "id": "dev_000001", "question": "Using Dr. Theo Grant's data steward assignment as the bridge, how many GPUs did Node Fir-10 allocate on 2026-04-18?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Willow-05"], "evidence": [{"doc_id": "doc_000196", "sent_id": 11}], "id": "dev_000002", "question": "Project Saffron's allocation of 4 GPUs on 2026-04-02 came from what node?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000003", "sent_id": 12}, {"doc_id": "doc_000003", "sent_id": 13}, {"doc_id": "doc_000021", "sent_id": 2}], "id": "dev_000003", "question": "Using Samir Kwan's retrieval owner assignment as the bridge, how many GPUs did Node Fir-10 allocate on 2026-05-13?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["a checkpoint-mismatch error"], "evidence": [{"doc_id": "doc_000068", "sent_id": 4}], "id": "dev_000004", "question": "The failure note for Project Anchor on 2026-06-26 names what cause for the Helix-3B run?", "reasoning_type": "single_hop"}
{"answers": ["River-3B"], "evidence": [{"doc_id": "doc_000249", "sent_id": 5}, {"doc_id": "doc_000249", "sent_id": 6}, {"doc_id": "doc_000001", "sent_id": 11}], "id": "dev_000005", "question": "First identify the project from Felix Brooks's 2026-04-07 assignment as the retrieval owner; which model did that project choose for evidence retrieval on 2026-06-07?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["calibration"], "evidence": [{"doc_id": "doc_000320", "sent_id": 2}, {"doc_id": "doc_000320", "sent_id": 3}], "id": "dev_000006", "question": "The 2026-04-26 selection note ties Nimbus-8B to what purpose for Project Meridian?", "reasoning_type": "single_hop"}
{"answers": ["Vela-7B"], "evidence": [{"doc_id": "doc_000032", "sent_id": 4}, {"doc_id": "doc_000032", "sent_id": 5}, {"doc_id": "doc_000003", "sent_id": 14}, {"doc_id": "doc_000003", "sent_id": 15}], "id": "dev_000007", "question": "The 2026-05-18 assignment names Dr. Theo Grant as data steward; for that project, which reranking model appears on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Nimbus-7B"], "evidence": [{"doc_id": "doc_000248", "sent_id": 2}, {"doc_id": "doc_000248", "sent_id": 3}, {"doc_id": "doc_000031", "sent_id": 5}], "id": "dev_000008", "question": "Two accuracy entries are relevant: Marble-8B on VestaLogs-3 for Project Saffron, and Nimbus-7B on MemoTrace for Project Meridian. Which model is higher?", "reasoning_type": "numeric_comparison"}
{"answers": ["error analysis"], "evidence": [{"doc_id": "doc_000282", "sent_id": 6}, {"doc_id": "doc_000282", "sent_id": 7}], "id": "dev_000009", "question": "The 2026-04-19 selection note ties Finch-3B to what purpose for Project Aster?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000071", "sent_id": 8}, {"doc_id": "doc_000003", "sent_id": 3}], "id": "dev_000010", "question": "The 2026-05-19 assignment names Lena Costa; for that same project, what GPU block did Node Willow-05 supply on 2026-05-01?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["an unstable-validation-loss error"], "evidence": [{"doc_id": "doc_000137", "sent_id": 5}], "id": "dev_000011", "question": "Which problem explains the 2026-05-28 failure for Project Sonata's Mira-3B run on Node Sycamore-13?", "reasoning_type": "single_hop"}
{"answers": ["chain verification"], "evidence": [{"doc_id": "doc_000204", "sent_id": 9}], "id": "dev_000012", "question": "Which earlier approach did Project Meridian retire in the 2026-05-23 method note?", "reasoning_type": "single_hop"}
{"answers": ["Marble-8B"], "evidence": [{"doc_id": "doc_000284", "sent_id": 2}, {"doc_id": "doc_000284", "sent_id": 3}], "id": "dev_000013", "question": "For Project Saffron, what model was used in the 2026-06-19 run that failed from a checkpoint-mismatch error?", "reasoning_type": "single_hop"}
{"answers": ["Orchid-7B"], "evidence": [{"doc_id": "doc_000297", "sent_id": 2}, {"doc_id": "doc_000297", "sent_id": 3}, {"doc_id": "doc_000005", "sent_id": 10}, {"doc_id": "doc_000005", "sent_id": 11}], "id": "dev_000014", "question": "The 2026-05-19 assignment names Iris Lane as evaluation owner; for that project, which reranking model appears on 2026-06-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000142", "sent_id": 8}, {"doc_id": "doc_000142", "sent_id": 9}, {"doc_id": "doc_000013", "sent_id": 9}], "id": "dev_000015", "question": "The 2026-06-08 assignment names Kira Iyer; for that same project, what GPU block did Node Spruce-03 supply on 2026-05-09?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Cedar-8B"], "evidence": [{"doc_id": "doc_000108", "sent_id": 7}, {"doc_id": "doc_000281", "sent_id": 5}, {"doc_id": "doc_000281", "sent_id": 6}], "id": "dev_000016", "question": "Which model wins the evidence F1 comparison between Project Nereid's Cedar-8B run and Project Sonata's Vela-8B run?", "reasoning_type": "numeric_comparison"}
{"answers": ["Lumen-7B"], "evidence": [{"doc_id": "doc_000442", "sent_id": 10}, {"doc_id": "doc_000007", "sent_id": 10}], "id": "dev_000017", "question": "Use the staffing clue for Selene Kim on 2026-05-26 to find the project. What model did it pick for calibration on 2026-06-04?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Project Aster"], "evidence": [{"doc_id": "doc_000253", "sent_id": 12}, {"doc_id": "doc_000253", "sent_id": 13}, {"doc_id": "doc_000399", "sent_id": 5}, {"doc_id": "doc_000399", "sent_id": 6}], "id": "dev_000018", "question": "Looking at both macro F1 result notes, which project should be selected as higher: Project Aster or Project Nereid?", "reasoning_type": "numeric_comparison"}
{"answers": ["Petra Gray"], "evidence": [{"doc_id": "doc_000344", "sent_id": 4}], "id": "dev_000019", "question": "Project Saffron's 2026-04-27 personnel update points to which person for the evaluation owner?", "reasoning_type": "single_hop"}
{"answers": ["Finch-7B"], "evidence": [{"doc_id": "doc_000031", "sent_id": 2}, {"doc_id": "doc_000008", "sent_id": 9}, {"doc_id": "doc_000008", "sent_id": 10}], "id": "dev_000020", "question": "The 2026-04-06 assignment names Anika Sato as lead; for that project, which error analysis model appears on 2026-04-17?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Mira-7B"], "evidence": [{"doc_id": "doc_000278", "sent_id": 2}, {"doc_id": "doc_000004", "sent_id": 4}], "id": "dev_000021", "question": "The 2026-06-15 assignment names Sofia Frost as lead; for that project, which calibration model appears on 2026-06-24?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Marble-3B"], "evidence": [{"doc_id": "doc_000421", "sent_id": 2}, {"doc_id": "doc_000003", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 7}], "id": "dev_000022", "question": "The 2026-06-09 assignment names Owen Marin as data steward; for that project, which error analysis model appears on 2026-04-12?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Nimbus-8B"], "evidence": [{"doc_id": "doc_000088", "sent_id": 5}, {"doc_id": "doc_000088", "sent_id": 6}], "id": "dev_000023", "question": "For Project Nereid, what model was used in the 2026-04-30 run that failed from an out-of-memory error?", "reasoning_type": "single_hop"}
{"answers": ["hard-negative mining"], "evidence": [{"doc_id": "doc_000175", "sent_id": 8}], "id": "dev_000024", "question": "Which method became the replacement in Project Sonata's 2026-04-25 update?", "reasoning_type": "single_hop"}
{"answers": ["Mira-7B"], "evidence": [{"doc_id": "doc_000024", "sent_id": 8}, {"doc_id": "doc_000004", "sent_id": 4}], "id": "dev_000025", "question": "Use the staffing clue for Sofia Frost on 2026-04-20 to find the project. What model did it pick for calibration on 2026-06-24?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000060", "sent_id": 7}, {"doc_id": "doc_000060", "sent_id": 8}], "id": "dev_000026", "question": "The 2026-04-25 allocation note says Node Rowan-09 supplied Project Aster with what GPU count?", "reasoning_type": "single_hop"}
{"answers": ["chain verification"], "evidence": [{"doc_id": "doc_000262", "sent_id": 11}], "id": "dev_000027", "question": "What was the old method named before Project Meridian's 2026-05-28 replacement?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000123", "sent_id": 8}], "id": "dev_000028", "question": "Project Aster's compute allocation on 2026-06-27 links Node Juniper-06 to how many GPUs?", "reasoning_type": "single_hop"}
{"answers": ["sentence pruning"], "evidence": [{"doc_id": "doc_000439", "sent_id": 4}, {"doc_id": "doc_000439", "sent_id": 5}], "id": "dev_000029", "question": "Project Sonata's 2026-05-14 note retired an older method; what replaced it?", "reasoning_type": "single_hop"}
{"answers": ["Orchid-7B"], "evidence": [{"doc_id": "doc_000078", "sent_id": 6}, {"doc_id": "doc_000078", "sent_id": 7}, {"doc_id": "doc_000005", "sent_id": 10}, {"doc_id": "doc_000005", "sent_id": 11}], "id": "dev_000030", "question": "The 2026-06-30 assignment names Kira Iyer as evaluation owner; for that project, which reranking model appears on 2026-06-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Mira-7B"], "evidence": [{"doc_id": "doc_000277", "sent_id": 10}, {"doc_id": "doc_000004", "sent_id": 4}], "id": "dev_000031", "question": "The 2026-06-09 assignment names Samir Kwan as retrieval owner; for that project, which calibration model appears on 2026-06-24?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000366", "sent_id": 6}, {"doc_id": "doc_000366", "sent_id": 7}, {"doc_id": "doc_000007", "sent_id": 3}], "id": "dev_000032", "question": "First identify the project from Dr. Ravi Nadir's 2026-06-22 assignment as the data steward; which model did that project choose for claim classification on 2026-05-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["the retrieval owner"], "evidence": [{"doc_id": "doc_000228", "sent_id": 8}], "id": "dev_000033", "question": "The 2026-06-01 personnel note connects Felix Brooks to which role for Project Aster?", "reasoning_type": "single_hop"}
{"answers": ["Nova-3B"], "evidence": [{"doc_id": "doc_000422", "sent_id": 10}], "id": "dev_000034", "question": "Which model should be matched to Project Meridian's Node Aspen-01 failure from 2026-06-26?", "reasoning_type": "single_hop"}
{"answers": ["contrastive tuning"], "evidence": [{"doc_id": "doc_000330", "sent_id": 7}], "id": "dev_000035", "question": "Which earlier approach did Project Nereid retire in the 2026-05-02 method note?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000160", "sent_id": 7}, {"doc_id": "doc_000033", "sent_id": 3}], "id": "dev_000036", "question": "Identify the project from Mara Quinn's 2026-04-21 staffing entry, then read the Node Sycamore-13 allocation on 2026-04-02; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Darian Grant"], "evidence": [{"doc_id": "doc_000418", "sent_id": 4}, {"doc_id": "doc_000418", "sent_id": 5}], "id": "dev_000037", "question": "In the 2026-04-13 staffing note for Project Nereid, who took lead duties?", "reasoning_type": "single_hop"}
{"answers": ["Atlas-8B"], "evidence": [{"doc_id": "doc_000015", "sent_id": 4}, {"doc_id": "doc_000007", "sent_id": 4}], "id": "dev_000038", "question": "Use the staffing clue for Dr. Julian Gray on 2026-04-19 to find the project. What model did it pick for evidence retrieval on 2026-04-16?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000414", "sent_id": 9}, {"doc_id": "doc_000414", "sent_id": 10}, {"doc_id": "doc_000033", "sent_id": 3}], "id": "dev_000039", "question": "Using Samir Ames's lead assignment as the bridge, how many GPUs did Node Sycamore-13 allocate on 2026-04-02?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000383", "sent_id": 5}, {"doc_id": "doc_000001", "sent_id": 3}, {"doc_id": "doc_000001", "sent_id": 4}], "id": "dev_000040", "question": "The 2026-05-04 assignment names Dr. Julian Gray; for that same project, what GPU block did Node Birch-04 supply on 2026-04-03?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000324", "sent_id": 8}, {"doc_id": "doc_000013", "sent_id": 9}], "id": "dev_000041", "question": "The 2026-05-25 assignment names Dr. Arun Bauer; for that same project, what GPU block did Node Spruce-03 supply on 2026-05-09?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["late interaction"], "evidence": [{"doc_id": "doc_000281", "sent_id": 7}], "id": "dev_000042", "question": "What was the old method named before Project Sonata's 2026-04-04 replacement?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000296", "sent_id": 9}, {"doc_id": "doc_000296", "sent_id": 10}, {"doc_id": "doc_000005", "sent_id": 8}, {"doc_id": "doc_000005", "sent_id": 9}], "id": "dev_000043", "question": "Using Evan Iyer's retrieval owner assignment as the bridge, how many GPUs did Node Birch-04 allocate on 2026-05-23?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["query rewriting"], "evidence": [{"doc_id": "doc_000178", "sent_id": 10}], "id": "dev_000044", "question": "What was the old method named before Project Meridian's 2026-05-30 replacement?", "reasoning_type": "single_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000157", "sent_id": 3}, {"doc_id": "doc_000007", "sent_id": 2}], "id": "dev_000045", "question": "Using Dr. Theo Lind's evaluation owner assignment as the bridge, how many GPUs did Node Fir-10 allocate on 2026-04-18?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Mira-8B"], "evidence": [{"doc_id": "doc_000356", "sent_id": 5}, {"doc_id": "doc_000356", "sent_id": 6}, {"doc_id": "doc_000143", "sent_id": 7}, {"doc_id": "doc_000143", "sent_id": 8}], "id": "dev_000046", "question": "Reading both result notes, which model has the larger evidence F1: Mira-8B from Project Sonata or River-8B from Project Aster?", "reasoning_type": "numeric_comparison"}
{"answers": ["the retrieval owner"], "evidence": [{"doc_id": "doc_000292", "sent_id": 6}], "id": "dev_000047", "question": "What responsibility label did Project Sonata give Rohan Singh in the 2026-05-18 entry?", "reasoning_type": "single_hop"}
{"answers": ["Finch-7B"], "evidence": [{"doc_id": "doc_000360", "sent_id": 12}], "id": "dev_000048", "question": "In the 2026-05-22 model-selection note, what did Project Anchor pick for error analysis?", "reasoning_type": "single_hop"}
{"answers": ["2026-07-03"], "evidence": [{"doc_id": "doc_000404", "sent_id": 4}], "id": "dev_000049", "question": "What was the prior Milestone D1 deadline before Project Meridian's 2026-06-11 update?", "reasoning_type": "single_hop"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000190", "sent_id": 4}, {"doc_id": "doc_000007", "sent_id": 3}], "id": "dev_000050", "question": "First identify the project from Camila Quinn's 2026-04-21 assignment as the evaluation owner; which model did that project choose for claim classification on 2026-05-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Atlas-3B"], "evidence": [{"doc_id": "doc_000107", "sent_id": 7}, {"doc_id": "doc_000107", "sent_id": 8}, {"doc_id": "doc_000297", "sent_id": 5}, {"doc_id": "doc_000297", "sent_id": 6}], "id": "dev_000051", "question": "Reading both result notes, which model has the larger macro F1: Atlas-3B from Project Nereid or Mira-3B from Project Sonata?", "reasoning_type": "numeric_comparison"}
{"answers": ["Atlas-8B"], "evidence": [{"doc_id": "doc_000251", "sent_id": 6}, {"doc_id": "doc_000251", "sent_id": 7}, {"doc_id": "doc_000126", "sent_id": 10}], "id": "dev_000052", "question": "Two accuracy entries are relevant: Atlas-8B on SignalSet-3 for Project Meridian, and Mira-8B on MemoTrace-2 for Project Saffron. Which model is higher?", "reasoning_type": "numeric_comparison"}
{"answers": ["document chunking"], "evidence": [{"doc_id": "doc_000170", "sent_id": 8}, {"doc_id": "doc_000170", "sent_id": 9}], "id": "dev_000053", "question": "After the 2026-05-21 method change, what approach was Project Saffron using?", "reasoning_type": "single_hop"}
{"answers": ["the data steward"], "evidence": [{"doc_id": "doc_000313", "sent_id": 10}], "id": "dev_000054", "question": "In Project Anchor's 2026-04-20 staffing entry, what duties were assigned to Leo Hale?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000005", "sent_id": 2}, {"doc_id": "doc_000002", "sent_id": 4}], "id": "dev_000055", "question": "Using Elian Shah's data steward assignment as the bridge, how many GPUs did Node Birch-04 allocate on 2026-06-27?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000187", "sent_id": 7}, {"doc_id": "doc_000021", "sent_id": 8}], "id": "dev_000056", "question": "Using Dr. Ravi Nadir's data steward assignment as the bridge, how many GPUs did Node Hazel-14 allocate on 2026-04-03?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000190", "sent_id": 7}, {"doc_id": "doc_000001", "sent_id": 3}, {"doc_id": "doc_000001", "sent_id": 4}], "id": "dev_000057", "question": "Using Vera Torres's retrieval owner assignment as the bridge, how many GPUs did Node Birch-04 allocate on 2026-04-03?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000158", "sent_id": 3}, {"doc_id": "doc_000003", "sent_id": 3}], "id": "dev_000058", "question": "The 2026-04-13 assignment names Dr. Theo Grant; for that same project, what GPU block did Node Willow-05 supply on 2026-05-01?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2026-06-19"], "evidence": [{"doc_id": "doc_000227", "sent_id": 7}], "id": "dev_000059", "question": "Which old date was removed from Project Aster's Milestone Z1 schedule on 2026-05-27?", "reasoning_type": "single_hop"}
{"answers": ["2026-05-08"], "evidence": [{"doc_id": "doc_000105", "sent_id": 8}], "id": "dev_000060", "question": "Which deadline replaced the old one for Project Anchor's Milestone Z1 on 2026-04-14?", "reasoning_type": "single_hop"}
{"answers": ["Marble-3B"], "evidence": [{"doc_id": "doc_000268", "sent_id": 4}, {"doc_id": "doc_000003", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 7}], "id": "dev_000061", "question": "The 2026-06-29 assignment names Dr. Theo Grant as data steward; for that project, which error analysis model appears on 2026-04-12?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2026-04-13"], "evidence": [{"doc_id": "doc_000414", "sent_id": 11}, {"doc_id": "doc_000414", "sent_id": 12}], "id": "dev_000062", "question": "Which deadline replaced the old one for Project Saffron's Milestone F1 on 2026-04-01?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000385", "sent_id": 2}, {"doc_id": "doc_000385", "sent_id": 3}, {"doc_id": "doc_000004", "sent_id": 11}, {"doc_id": "doc_000004", "sent_id": 12}], "id": "dev_000063", "question": "The 2026-06-09 assignment names Talia Reed; for that same project, what GPU block did Node Spruce-03 supply on 2026-04-23?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000427", "sent_id": 2}, {"doc_id": "doc_000427", "sent_id": 3}, {"doc_id": "doc_000003", "sent_id": 3}], "id": "dev_000064", "question": "Identify the project from Priya Vale's 2026-06-15 staffing entry, then read the Node Willow-05 allocation on 2026-05-01; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["a checkpoint-mismatch error"], "evidence": [{"doc_id": "doc_000173", "sent_id": 6}], "id": "dev_000065", "question": "Project Saffron's 2026-06-04 failed run used Aster-7B on Node Willow-05; what issue was recorded?", "reasoning_type": "single_hop"}
{"answers": ["Vela-3B"], "evidence": [{"doc_id": "doc_000076", "sent_id": 8}, {"doc_id": "doc_000076", "sent_id": 9}], "id": "dev_000066", "question": "Project Saffron recorded a reranking model choice on 2026-04-15; which model was chosen?", "reasoning_type": "single_hop"}
{"answers": ["Elm-08"], "evidence": [{"doc_id": "doc_000253", "sent_id": 6}, {"doc_id": "doc_000253", "sent_id": 7}], "id": "dev_000067", "question": "The 2026-06-23 result for Project Meridian reports Nimbus-7B at 0.783 accuracy; which node handled that MemoTrace run?", "reasoning_type": "single_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000391", "sent_id": 6}, {"doc_id": "doc_000007", "sent_id": 2}], "id": "dev_000068", "question": "Identify the project from Owen Marin's 2026-06-01 staffing entry, then read the Node Fir-10 allocation on 2026-04-18; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["1"], "evidence": [{"doc_id": "doc_000318", "sent_id": 4}], "id": "dev_000069", "question": "Project Nereid's compute allocation on 2026-06-22 links Node Elm-08 to how many GPUs?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000178", "sent_id": 14}, {"doc_id": "doc_000007", "sent_id": 5}], "id": "dev_000070", "question": "Identify the project from Dr. Arun Bauer's 2026-05-05 staffing entry, then read the Node Rowan-09 allocation on 2026-04-11; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["hybrid retrieval"], "evidence": [{"doc_id": "doc_000170", "sent_id": 8}, {"doc_id": "doc_000170", "sent_id": 9}], "id": "dev_000071", "question": "What was the old method named before Project Saffron's 2026-05-21 replacement?", "reasoning_type": "single_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000176", "sent_id": 2}], "id": "dev_000072", "question": "Project Saffron's compute allocation on 2026-06-27 links Node Willow-05 to how many GPUs?", "reasoning_type": "single_hop"}
{"answers": ["teacher distillation"], "evidence": [{"doc_id": "doc_000163", "sent_id": 6}, {"doc_id": "doc_000163", "sent_id": 7}], "id": "dev_000073", "question": "Which earlier approach did Project Nereid retire in the 2026-04-05 method note?", "reasoning_type": "single_hop"}
{"answers": ["Lumen-7B"], "evidence": [{"doc_id": "doc_000377", "sent_id": 6}, {"doc_id": "doc_000007", "sent_id": 10}], "id": "dev_000074", "question": "Use the staffing clue for Leo Park on 2026-04-21 to find the project. What model did it pick for calibration on 2026-06-04?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["a missing-index error"], "evidence": [{"doc_id": "doc_000139", "sent_id": 5}], "id": "dev_000075", "question": "Project Anchor's 2026-04-16 failed run used River-8B on Node Rowan-09; what issue was recorded?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000312", "sent_id": 4}, {"doc_id": "doc_000004", "sent_id": 11}, {"doc_id": "doc_000004", "sent_id": 12}], "id": "dev_000076", "question": "Using Talia Marin's lead assignment as the bridge, how many GPUs did Node Spruce-03 allocate on 2026-04-23?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Aspen-01"], "evidence": [{"doc_id": "doc_000088", "sent_id": 4}], "id": "dev_000077", "question": "Project Meridian's 2026-06-30 LumenFacts-2 entry links Nova-8B's 0.735 accuracy to what node?", "reasoning_type": "single_hop"}
{"answers": ["Project Nereid"], "evidence": [{"doc_id": "doc_000283", "sent_id": 10}, {"doc_id": "doc_000283", "sent_id": 11}, {"doc_id": "doc_000332", "sent_id": 2}, {"doc_id": "doc_000332", "sent_id": 3}], "id": "dev_000078", "question": "Which project wins the evidence F1 comparison, Project Sonata or Project Nereid?", "reasoning_type": "numeric_comparison"}
{"answers": ["Priya Moss"], "evidence": [{"doc_id": "doc_000244", "sent_id": 12}], "id": "dev_000079", "question": "Project Saffron's 2026-06-21 personnel update points to which person for the data steward?", "reasoning_type": "single_hop"}
{"answers": ["Project Aster"], "evidence": [{"doc_id": "doc_000190", "sent_id": 8}, {"doc_id": "doc_000293", "sent_id": 7}], "id": "dev_000080", "question": "The two runs use River-3B and Marble-3B; which project has the larger macro F1 value?", "reasoning_type": "numeric_comparison"}
{"answers": ["2026-07-10"], "evidence": [{"doc_id": "doc_000180", "sent_id": 7}], "id": "dev_000081", "question": "In the 2026-06-24 schedule revision, which earlier date did Project Anchor replace for Milestone B1?", "reasoning_type": "single_hop"}
{"answers": ["Juniper-06"], "evidence": [{"doc_id": "doc_000422", "sent_id": 3}], "id": "dev_000082", "question": "The 2026-06-13 allocation for Project Aster lists 3 GPUs; which node supplied them?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000343", "sent_id": 6}, {"doc_id": "doc_000343", "sent_id": 7}, {"doc_id": "doc_000003", "sent_id": 3}], "id": "dev_000083", "question": "Using Priya Moss's data steward assignment as the bridge, how many GPUs did Node Willow-05 allocate on 2026-05-01?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Mina Adler"], "evidence": [{"doc_id": "doc_000375", "sent_id": 2}], "id": "dev_000084", "question": "Project Aster's 2026-05-04 personnel update points to which person for the retrieval owner?", "reasoning_type": "single_hop"}
{"answers": ["a missing-index error"], "evidence": [{"doc_id": "doc_000056", "sent_id": 6}, {"doc_id": "doc_000056", "sent_id": 7}], "id": "dev_000085", "question": "The failure note for Project Meridian on 2026-05-21 names what cause for the Atlas-8B run?", "reasoning_type": "single_hop"}
{"answers": ["an unstable-validation-loss error"], "evidence": [{"doc_id": "doc_000217", "sent_id": 3}, {"doc_id": "doc_000217", "sent_id": 4}], "id": "dev_000086", "question": "Which problem explains the 2026-05-21 failure for Project Aster's River-8B run on Node Rowan-09?", "reasoning_type": "single_hop"}
{"answers": ["Sycamore-13"], "evidence": [{"doc_id": "doc_000249", "sent_id": 2}], "id": "dev_000087", "question": "The 2026-05-16 allocation for Project Sonata lists 3 GPUs; which node supplied them?", "reasoning_type": "single_hop"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000393", "sent_id": 6}, {"doc_id": "doc_000007", "sent_id": 3}], "id": "dev_000088", "question": "First identify the project from Dr. Ravi Nadir's 2026-04-21 assignment as the data steward; which model did that project choose for claim classification on 2026-05-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Lumen-7B"], "evidence": [{"doc_id": "doc_000126", "sent_id": 11}, {"doc_id": "doc_000007", "sent_id": 10}], "id": "dev_000089", "question": "Use the staffing clue for Iris Lane on 2026-05-04 to find the project. What model did it pick for calibration on 2026-06-04?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000332", "sent_id": 10}, {"doc_id": "doc_000332", "sent_id": 11}, {"doc_id": "doc_000007", "sent_id": 5}], "id": "dev_000090", "question": "Using Kira Iyer's evaluation owner assignment as the bridge, how many GPUs did Node Rowan-09 allocate on 2026-04-11?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Project Meridian"], "evidence": [{"doc_id": "doc_000061", "sent_id": 5}, {"doc_id": "doc_000300", "sent_id": 6}], "id": "dev_000091", "question": "Which project wins the accuracy comparison, Project Saffron or Project Meridian?", "reasoning_type": "numeric_comparison"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000379", "sent_id": 9}, {"doc_id": "doc_000379", "sent_id": 10}, {"doc_id": "doc_000005", "sent_id": 8}, {"doc_id": "doc_000005", "sent_id": 9}], "id": "dev_000092", "question": "The 2026-05-26 assignment names Darian Grant; for that same project, what GPU block did Node Birch-04 supply on 2026-05-23?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Orchid-7B"], "evidence": [{"doc_id": "doc_000092", "sent_id": 5}, {"doc_id": "doc_000092", "sent_id": 6}, {"doc_id": "doc_000005", "sent_id": 10}, {"doc_id": "doc_000005", "sent_id": 11}], "id": "dev_000093", "question": "Use the staffing clue for Leo Park on 2026-05-04 to find the project. What model did it pick for reranking on 2026-06-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000089", "sent_id": 8}, {"doc_id": "doc_000007", "sent_id": 5}], "id": "dev_000094", "question": "The 2026-06-02 assignment names Iris Lane; for that same project, what GPU block did Node Rowan-09 supply on 2026-04-11?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["1"], "evidence": [{"doc_id": "doc_000213", "sent_id": 6}, {"doc_id": "doc_000213", "sent_id": 7}, {"doc_id": "doc_000005", "sent_id": 4}], "id": "dev_000095", "question": "The 2026-05-12 assignment names Dr. Noah Vale; for that same project, what GPU block did Node Spruce-03 supply on 2026-05-30?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["the retrieval owner"], "evidence": [{"doc_id": "doc_000375", "sent_id": 3}], "id": "dev_000096", "question": "The 2026-06-28 personnel note connects Rohan Singh to which role for Project Sonata?", "reasoning_type": "single_hop"}
{"answers": ["document chunking"], "evidence": [{"doc_id": "doc_000270", "sent_id": 7}, {"doc_id": "doc_000270", "sent_id": 8}], "id": "dev_000097", "question": "Which earlier approach did Project Nereid retire in the 2026-04-04 method note?", "reasoning_type": "single_hop"}
{"answers": ["Mira Nolan"], "evidence": [{"doc_id": "doc_000144", "sent_id": 9}, {"doc_id": "doc_000144", "sent_id": 10}], "id": "dev_000098", "question": "In the 2026-05-25 staffing note for Project Meridian, who took evaluation owner duties?", "reasoning_type": "single_hop"}
{"answers": ["2026-05-10"], "evidence": [{"doc_id": "doc_000321", "sent_id": 7}], "id": "dev_000099", "question": "In the 2026-04-29 schedule revision, which earlier date did Project Aster replace for Milestone B1?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000359", "sent_id": 6}, {"doc_id": "doc_000013", "sent_id": 9}], "id": "dev_000100", "question": "The 2026-06-23 assignment names Dr. Arun Bauer; for that same project, what GPU block did Node Spruce-03 supply on 2026-05-09?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Atlas-8B"], "evidence": [{"doc_id": "doc_000001", "sent_id": 2}, {"doc_id": "doc_000007", "sent_id": 4}], "id": "dev_000101", "question": "The 2026-06-15 assignment names Nora Bauer as lead; for that project, which evidence retrieval model appears on 2026-04-16?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["River-3B"], "evidence": [{"doc_id": "doc_000156", "sent_id": 4}, {"doc_id": "doc_000001", "sent_id": 11}], "id": "dev_000102", "question": "First identify the project from Anika Sato's 2026-05-18 assignment as the lead; which model did that project choose for evidence retrieval on 2026-06-07?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["cross-encoder reranking"], "evidence": [{"doc_id": "doc_000043", "sent_id": 2}], "id": "dev_000103", "question": "Which method became the replacement in Project Aster's 2026-05-28 update?", "reasoning_type": "single_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000307", "sent_id": 14}, {"doc_id": "doc_000307", "sent_id": 15}, {"doc_id": "doc_000007", "sent_id": 2}], "id": "dev_000104", "question": "The 2026-06-02 assignment names Owen Torres; for that same project, what GPU block did Node Fir-10 supply on 2026-04-18?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000195", "sent_id": 4}, {"doc_id": "doc_000021", "sent_id": 8}], "id": "dev_000105", "question": "Using Nadia Chen's evaluation owner assignment as the bridge, how many GPUs did Node Hazel-14 allocate on 2026-04-03?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000174", "sent_id": 9}, {"doc_id": "doc_000174", "sent_id": 10}, {"doc_id": "doc_000021", "sent_id": 2}], "id": "dev_000106", "question": "Identify the project from Rohan Park's 2026-05-05 staffing entry, then read the Node Fir-10 allocation on 2026-05-13; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["1"], "evidence": [{"doc_id": "doc_000228", "sent_id": 8}, {"doc_id": "doc_000005", "sent_id": 4}], "id": "dev_000107", "question": "Identify the project from Felix Brooks's 2026-06-01 staffing entry, then read the Node Spruce-03 allocation on 2026-05-30; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2026-05-06"], "evidence": [{"doc_id": "doc_000421", "sent_id": 9}], "id": "dev_000108", "question": "Project Nereid's 2026-04-02 schedule note gives what new date for Milestone J1?", "reasoning_type": "single_hop"}
{"answers": ["Camila Quinn"], "evidence": [{"doc_id": "doc_000214", "sent_id": 7}, {"doc_id": "doc_000214", "sent_id": 8}], "id": "dev_000109", "question": "In the 2026-04-13 staffing note for Project Meridian, who took evaluation owner duties?", "reasoning_type": "single_hop"}
{"answers": ["Orchid-7B"], "evidence": [{"doc_id": "doc_000208", "sent_id": 5}], "id": "dev_000110", "question": "The 2026-06-05 failure note ties a checkpoint-mismatch error on Node Cedar-02 to which Project Anchor model?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000174", "sent_id": 9}, {"doc_id": "doc_000174", "sent_id": 10}, {"doc_id": "doc_000033", "sent_id": 3}], "id": "dev_000111", "question": "The 2026-05-05 assignment names Rohan Park; for that same project, what GPU block did Node Sycamore-13 supply on 2026-04-02?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Laurel-11"], "evidence": [{"doc_id": "doc_000216", "sent_id": 7}], "id": "dev_000112", "question": "The 2026-05-26 result for Project Meridian reports Cedar-7B at 0.741 latency efficiency score; which node handled that VestaLogs-2 run?", "reasoning_type": "single_hop"}
{"answers": ["Project Anchor"], "evidence": [{"doc_id": "doc_000337", "sent_id": 10}, {"doc_id": "doc_000119", "sent_id": 2}], "id": "dev_000113", "question": "Looking at both accuracy result notes, which project should be selected as higher: Project Anchor or Project Saffron?", "reasoning_type": "numeric_comparison"}
{"answers": ["1"], "evidence": [{"doc_id": "doc_000006", "sent_id": 2}], "id": "dev_000114", "question": "Project Nereid's compute allocation on 2026-04-04 links Node Elm-08 to how many GPUs?", "reasoning_type": "single_hop"}
{"answers": ["Marble-3B"], "evidence": [{"doc_id": "doc_000034", "sent_id": 3}, {"doc_id": "doc_000034", "sent_id": 4}, {"doc_id": "doc_000003", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 7}], "id": "dev_000115", "question": "Use the staffing clue for Priya Moss on 2026-06-30 to find the project. What model did it pick for error analysis on 2026-04-12?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Cedar-3B"], "evidence": [{"doc_id": "doc_000058", "sent_id": 10}, {"doc_id": "doc_000340", "sent_id": 3}], "id": "dev_000116", "question": "Reading both result notes, which model has the larger evidence F1: Lumen-3B from Project Aster or Cedar-3B from Project Nereid?", "reasoning_type": "numeric_comparison"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000039", "sent_id": 5}, {"doc_id": "doc_000004", "sent_id": 11}, {"doc_id": "doc_000004", "sent_id": 12}], "id": "dev_000117", "question": "The 2026-06-30 assignment names Dr. Noah Chen; for that same project, what GPU block did Node Spruce-03 supply on 2026-04-23?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2026-07-11"], "evidence": [{"doc_id": "doc_000097", "sent_id": 10}, {"doc_id": "doc_000097", "sent_id": 11}], "id": "dev_000118", "question": "In the 2026-06-23 schedule revision, which earlier date did Project Saffron replace for Milestone F1?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000231", "sent_id": 3}, {"doc_id": "doc_000231", "sent_id": 4}, {"doc_id": "doc_000021", "sent_id": 2}], "id": "dev_000119", "question": "Identify the project from Dr. Jonas Rios's 2026-06-08 staffing entry, then read the Node Fir-10 allocation on 2026-05-13; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["River-3B"], "evidence": [{"doc_id": "doc_000148", "sent_id": 4}, {"doc_id": "doc_000001", "sent_id": 11}], "id": "dev_000120", "question": "First identify the project from Dr. Noah Chen's 2026-06-22 assignment as the retrieval owner; which model did that project choose for evidence retrieval on 2026-06-07?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Mira-7B"], "evidence": [{"doc_id": "doc_000236", "sent_id": 8}, {"doc_id": "doc_000236", "sent_id": 9}, {"doc_id": "doc_000004", "sent_id": 4}], "id": "dev_000121", "question": "The 2026-04-28 assignment names Samir Ames as lead; for that project, which calibration model appears on 2026-06-24?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["0.595"], "evidence": [{"doc_id": "doc_000002", "sent_id": 6}], "id": "dev_000122", "question": "Which latency efficiency score value is attached to the 2026-04-28 Vela-8B run on LumenFacts-3 for Project Saffron?", "reasoning_type": "single_hop"}
{"answers": ["late interaction"], "evidence": [{"doc_id": "doc_000026", "sent_id": 9}], "id": "dev_000123", "question": "In Project Meridian's 2026-04-25 update, what method was being moved away from?", "reasoning_type": "single_hop"}
{"answers": ["claim classification"], "evidence": [{"doc_id": "doc_000056", "sent_id": 8}, {"doc_id": "doc_000056", "sent_id": 9}], "id": "dev_000124", "question": "The 2026-06-05 selection note ties Helix-7B to what purpose for Project Aster?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000108", "sent_id": 9}, {"doc_id": "doc_000007", "sent_id": 5}], "id": "dev_000125", "question": "The 2026-05-12 assignment names Leo Park; for that same project, what GPU block did Node Rowan-09 supply on 2026-04-11?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Marble-3B"], "evidence": [{"doc_id": "doc_000359", "sent_id": 3}, {"doc_id": "doc_000003", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 7}], "id": "dev_000126", "question": "Use the staffing clue for Dr. Theo Lind on 2026-04-05 to find the project. What model did it pick for error analysis on 2026-04-12?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Mira-7B"], "evidence": [{"doc_id": "doc_000183", "sent_id": 4}, {"doc_id": "doc_000183", "sent_id": 5}, {"doc_id": "doc_000004", "sent_id": 4}], "id": "dev_000127", "question": "Use the staffing clue for Dr. Jonas Rios on 2026-05-19 to find the project. What model did it pick for calibration on 2026-06-24?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000316", "sent_id": 6}, {"doc_id": "doc_000001", "sent_id": 3}, {"doc_id": "doc_000001", "sent_id": 4}], "id": "dev_000128", "question": "Identify the project from Nora Sol's 2026-05-18 staffing entry, then read the Node Birch-04 allocation on 2026-04-03; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000389", "sent_id": 6}, {"doc_id": "doc_000389", "sent_id": 7}, {"doc_id": "doc_000007", "sent_id": 3}], "id": "dev_000129", "question": "Use the staffing clue for Nadia Chen on 2026-06-30 to find the project. What model did it pick for claim classification on 2026-05-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["a checkpoint-mismatch error"], "evidence": [{"doc_id": "doc_000373", "sent_id": 10}], "id": "dev_000130", "question": "Project Meridian's 2026-04-02 failed run used Nova-3B on Node Aspen-01; what issue was recorded?", "reasoning_type": "single_hop"}
{"answers": ["Vela-7B"], "evidence": [{"doc_id": "doc_000378", "sent_id": 4}, {"doc_id": "doc_000378", "sent_id": 5}, {"doc_id": "doc_000003", "sent_id": 14}, {"doc_id": "doc_000003", "sent_id": 15}], "id": "dev_000131", "question": "First identify the project from Priya Moss's 2026-05-05 assignment as the data steward; which model did that project choose for reranking on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["the retrieval owner"], "evidence": [{"doc_id": "doc_000202", "sent_id": 4}], "id": "dev_000132", "question": "What responsibility label did Project Sonata give Mara Lane in the 2026-06-02 entry?", "reasoning_type": "single_hop"}
{"answers": ["Laurel-11"], "evidence": [{"doc_id": "doc_000400", "sent_id": 2}], "id": "dev_000133", "question": "The 2026-06-27 result for Project Meridian reports Cedar-8B at 0.711 latency efficiency score; which node handled that VestaLogs-2 run?", "reasoning_type": "single_hop"}
{"answers": ["Atlas-8B"], "evidence": [{"doc_id": "doc_000078", "sent_id": 4}, {"doc_id": "doc_000078", "sent_id": 5}, {"doc_id": "doc_000007", "sent_id": 4}], "id": "dev_000134", "question": "Use the staffing clue for Nora Sol on 2026-05-12 to find the project. What model did it pick for evidence retrieval on 2026-04-16?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["0.747"], "evidence": [{"doc_id": "doc_000172", "sent_id": 7}], "id": "dev_000135", "question": "Project Meridian's 2026-05-04 result put Kestrel-8B on CedarQA; what latency efficiency score was reported?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000285", "sent_id": 6}, {"doc_id": "doc_000285", "sent_id": 7}, {"doc_id": "doc_000033", "sent_id": 3}], "id": "dev_000136", "question": "Using Dr. Jonas Nolan's retrieval owner assignment as the bridge, how many GPUs did Node Sycamore-13 allocate on 2026-04-02?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Fir-10"], "evidence": [{"doc_id": "doc_000395", "sent_id": 10}, {"doc_id": "doc_000395", "sent_id": 11}], "id": "dev_000137", "question": "The 2026-06-04 allocation for Project Saffron lists 4 GPUs; which node supplied them?", "reasoning_type": "single_hop"}
{"answers": ["Elm-08"], "evidence": [{"doc_id": "doc_000418", "sent_id": 7}, {"doc_id": "doc_000418", "sent_id": 8}], "id": "dev_000138", "question": "Which compute node is tied to Project Nereid's 2026-05-29 allocation of 1 GPU?", "reasoning_type": "single_hop"}
{"answers": ["Mira-3B"], "evidence": [{"doc_id": "doc_000013", "sent_id": 2}], "id": "dev_000139", "question": "In the 2026-05-08 model-selection note, what did Project Saffron pick for calibration?", "reasoning_type": "single_hop"}
{"answers": ["Finch-7B"], "evidence": [{"doc_id": "doc_000091", "sent_id": 13}, {"doc_id": "doc_000091", "sent_id": 14}, {"doc_id": "doc_000008", "sent_id": 9}, {"doc_id": "doc_000008", "sent_id": 10}], "id": "dev_000140", "question": "First identify the project from Felix Brooks's 2026-04-13 assignment as the retrieval owner; which model did that project choose for error analysis on 2026-04-17?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000009", "sent_id": 9}, {"doc_id": "doc_000033", "sent_id": 3}], "id": "dev_000141", "question": "The 2026-06-01 assignment names Mara Quinn; for that same project, what GPU block did Node Sycamore-13 supply on 2026-04-02?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000225", "sent_id": 4}, {"doc_id": "doc_000004", "sent_id": 11}, {"doc_id": "doc_000004", "sent_id": 12}], "id": "dev_000142", "question": "Identify the project from Anika Costa's 2026-06-23 staffing entry, then read the Node Spruce-03 allocation on 2026-04-23; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Cedar-02"], "evidence": [{"doc_id": "doc_000313", "sent_id": 7}, {"doc_id": "doc_000313", "sent_id": 8}], "id": "dev_000143", "question": "Which compute node is tied to Project Aster's 2026-04-18 allocation of 1 GPU?", "reasoning_type": "single_hop"}
{"answers": ["Cedar-8B"], "evidence": [{"doc_id": "doc_000175", "sent_id": 14}, {"doc_id": "doc_000175", "sent_id": 15}, {"doc_id": "doc_000106", "sent_id": 5}, {"doc_id": "doc_000106", "sent_id": 6}], "id": "dev_000144", "question": "Which model wins the latency efficiency score comparison between Project Meridian's Cedar-8B run and Project Saffron's Aster-8B run?", "reasoning_type": "numeric_comparison"}
{"answers": ["Marble-7B"], "evidence": [{"doc_id": "doc_000235", "sent_id": 2}, {"doc_id": "doc_000002", "sent_id": 5}], "id": "dev_000145", "question": "First identify the project from Mara Quinn's 2026-04-27 assignment as the lead; which model did that project choose for error analysis on 2026-04-22?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["reward reranking"], "evidence": [{"doc_id": "doc_000166", "sent_id": 5}], "id": "dev_000146", "question": "After the 2026-05-23 method change, what approach was Project Sonata using?", "reasoning_type": "single_hop"}
{"answers": ["Project Sonata"], "evidence": [{"doc_id": "doc_000140", "sent_id": 11}, {"doc_id": "doc_000396", "sent_id": 12}], "id": "dev_000147", "question": "Which project wins the macro F1 comparison, Project Nereid or Project Sonata?", "reasoning_type": "numeric_comparison"}
{"answers": ["Vela-7B"], "evidence": [{"doc_id": "doc_000283", "sent_id": 8}, {"doc_id": "doc_000003", "sent_id": 14}, {"doc_id": "doc_000003", "sent_id": 15}], "id": "dev_000148", "question": "The 2026-04-06 assignment names Owen Marin as data steward; for that project, which reranking model appears on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["0.869"], "evidence": [{"doc_id": "doc_000220", "sent_id": 9}], "id": "dev_000149", "question": "In the 2026-04-07 result note, what accuracy did River-8B produce for Project Anchor on SignalSet-2?", "reasoning_type": "single_hop"}
{"answers": ["2026-07-22"], "evidence": [{"doc_id": "doc_000021", "sent_id": 3}, {"doc_id": "doc_000021", "sent_id": 4}], "id": "dev_000150", "question": "Which deadline replaced the old one for Project Anchor's Milestone B1 on 2026-06-16?", "reasoning_type": "single_hop"}
{"answers": ["River-3B"], "evidence": [{"doc_id": "doc_000151", "sent_id": 7}, {"doc_id": "doc_000001", "sent_id": 11}], "id": "dev_000151", "question": "Use the staffing clue for Mina Adler on 2026-06-02 to find the project. What model did it pick for evidence retrieval on 2026-06-07?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["reranking"], "evidence": [{"doc_id": "doc_000098", "sent_id": 9}], "id": "dev_000152", "question": "When Project Sonata picked Vela-7B on 2026-06-03, which work track was it for?", "reasoning_type": "single_hop"}
{"answers": ["1"], "evidence": [{"doc_id": "doc_000307", "sent_id": 10}], "id": "dev_000153", "question": "The 2026-05-08 allocation note says Node Laurel-11 supplied Project Nereid with what GPU count?", "reasoning_type": "single_hop"}
{"answers": ["structured prompting"], "evidence": [{"doc_id": "doc_000351", "sent_id": 2}], "id": "dev_000154", "question": "In Project Anchor's 2026-04-16 update, what method was being moved away from?", "reasoning_type": "single_hop"}
{"answers": ["reranking"], "evidence": [{"doc_id": "doc_000247", "sent_id": 3}], "id": "dev_000155", "question": "When Project Anchor picked Orchid-8B on 2026-04-14, which work track was it for?", "reasoning_type": "single_hop"}
{"answers": ["Vela-7B"], "evidence": [{"doc_id": "doc_000018", "sent_id": 3}, {"doc_id": "doc_000018", "sent_id": 4}, {"doc_id": "doc_000003", "sent_id": 14}, {"doc_id": "doc_000003", "sent_id": 15}], "id": "dev_000156", "question": "First identify the project from Petra Gray's 2026-04-26 assignment as the evaluation owner; which model did that project choose for reranking on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000322", "sent_id": 3}, {"doc_id": "doc_000322", "sent_id": 4}], "id": "dev_000157", "question": "The 2026-04-02 allocation note says Node Cedar-02 supplied Project Anchor with what GPU count?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000307", "sent_id": 11}, {"doc_id": "doc_000033", "sent_id": 3}], "id": "dev_000158", "question": "The 2026-05-11 assignment names Samir Kwan; for that same project, what GPU block did Node Sycamore-13 supply on 2026-04-02?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2026-05-23"], "evidence": [{"doc_id": "doc_000087", "sent_id": 6}, {"doc_id": "doc_000087", "sent_id": 7}], "id": "dev_000159", "question": "After Project Nereid revised Milestone J1 on 2026-05-12, what date became the deadline?", "reasoning_type": "single_hop"}
{"answers": ["River-3B"], "evidence": [{"doc_id": "doc_000362", "sent_id": 8}], "id": "dev_000160", "question": "Which model should be matched to Project Aster's Node Rowan-09 failure from 2026-06-04?", "reasoning_type": "single_hop"}
{"answers": ["Marble-3B"], "evidence": [{"doc_id": "doc_000120", "sent_id": 5}, {"doc_id": "doc_000120", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 7}], "id": "dev_000161", "question": "Use the staffing clue for Lena Costa on 2026-05-25 to find the project. What model did it pick for error analysis on 2026-04-12?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Lumen-7B"], "evidence": [{"doc_id": "doc_000393", "sent_id": 4}, {"doc_id": "doc_000007", "sent_id": 10}], "id": "dev_000162", "question": "First identify the project from Dr. Arun Kwan's 2026-06-08 assignment as the data steward; which model did that project choose for calibration on 2026-06-04?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["1"], "evidence": [{"doc_id": "doc_000249", "sent_id": 5}, {"doc_id": "doc_000249", "sent_id": 6}, {"doc_id": "doc_000005", "sent_id": 4}], "id": "dev_000163", "question": "Using Felix Brooks's retrieval owner assignment as the bridge, how many GPUs did Node Spruce-03 allocate on 2026-05-30?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Aster-8B"], "evidence": [{"doc_id": "doc_000395", "sent_id": 6}], "id": "dev_000164", "question": "Which model should be matched to Project Saffron's 2026-05-31 evidence retrieval track?", "reasoning_type": "single_hop"}
{"answers": ["Orchid-7B"], "evidence": [{"doc_id": "doc_000213", "sent_id": 11}, {"doc_id": "doc_000213", "sent_id": 12}, {"doc_id": "doc_000005", "sent_id": 10}, {"doc_id": "doc_000005", "sent_id": 11}], "id": "dev_000165", "question": "First identify the project from Kira Iyer's 2026-05-05 assignment as the evaluation owner; which model did that project choose for reranking on 2026-06-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000178", "sent_id": 7}, {"doc_id": "doc_000178", "sent_id": 8}, {"doc_id": "doc_000021", "sent_id": 8}], "id": "dev_000166", "question": "Using Elian Shah's data steward assignment as the bridge, how many GPUs did Node Hazel-14 allocate on 2026-04-03?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Cedar-7B"], "evidence": [{"doc_id": "doc_000009", "sent_id": 11}], "id": "dev_000167", "question": "The 2026-04-24 failure note ties an unstable-validation-loss error on Node Laurel-11 to which Project Nereid model?", "reasoning_type": "single_hop"}
{"answers": ["Marble-3B"], "evidence": [{"doc_id": "doc_000341", "sent_id": 6}], "id": "dev_000168", "question": "Project Sonata recorded a error analysis model choice on 2026-06-23; which model was chosen?", "reasoning_type": "single_hop"}
{"answers": ["calibrated voting"], "evidence": [{"doc_id": "doc_000177", "sent_id": 9}, {"doc_id": "doc_000177", "sent_id": 10}], "id": "dev_000169", "question": "After the 2026-05-06 method change, what approach was Project Saffron using?", "reasoning_type": "single_hop"}
{"answers": ["calibration"], "evidence": [{"doc_id": "doc_000154", "sent_id": 12}], "id": "dev_000170", "question": "When Project Nereid picked Nimbus-8B on 2026-06-03, which work track was it for?", "reasoning_type": "single_hop"}
{"answers": ["Vela-7B"], "evidence": [{"doc_id": "doc_000363", "sent_id": 11}, {"doc_id": "doc_000002", "sent_id": 3}], "id": "dev_000171", "question": "Which model wins the accuracy comparison between Project Saffron's Vela-7B run and Project Anchor's Orchid-3B run?", "reasoning_type": "numeric_comparison"}
{"answers": ["Vela-7B"], "evidence": [{"doc_id": "doc_000251", "sent_id": 3}, {"doc_id": "doc_000003", "sent_id": 14}, {"doc_id": "doc_000003", "sent_id": 15}], "id": "dev_000172", "question": "The 2026-05-12 assignment names Petra Adler as data steward; for that project, which reranking model appears on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Lumen-7B"], "evidence": [{"doc_id": "doc_000209", "sent_id": 7}, {"doc_id": "doc_000209", "sent_id": 8}], "id": "dev_000173", "question": "In the 2026-05-15 model-selection note, what did Project Aster pick for calibration?", "reasoning_type": "single_hop"}
{"answers": ["River-3B"], "evidence": [{"doc_id": "doc_000094", "sent_id": 8}, {"doc_id": "doc_000001", "sent_id": 11}], "id": "dev_000174", "question": "First identify the project from Felix Brooks's 2026-05-18 assignment as the retrieval owner; which model did that project choose for evidence retrieval on 2026-06-07?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000129", "sent_id": 6}], "id": "dev_000175", "question": "The 2026-06-20 allocation note says Node Birch-04 supplied Project Meridian with what GPU count?", "reasoning_type": "single_hop"}
{"answers": ["an out-of-memory error"], "evidence": [{"doc_id": "doc_000316", "sent_id": 7}], "id": "dev_000176", "question": "Which problem explains the 2026-05-08 failure for Project Nereid's Nimbus-3B run on Node Elm-08?", "reasoning_type": "single_hop"}
{"answers": ["0.570"], "evidence": [{"doc_id": "doc_000418", "sent_id": 6}], "id": "dev_000177", "question": "Project Nereid's 2026-04-07 result put Nova-3B on LabQA; what macro F1 was reported?", "reasoning_type": "single_hop"}
{"answers": ["Atlas-8B"], "evidence": [{"doc_id": "doc_000316", "sent_id": 6}, {"doc_id": "doc_000007", "sent_id": 4}], "id": "dev_000178", "question": "First identify the project from Nora Sol's 2026-05-18 assignment as the retrieval owner; which model did that project choose for evidence retrieval on 2026-04-16?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000076", "sent_id": 11}, {"doc_id": "doc_000003", "sent_id": 3}], "id": "dev_000179", "question": "Identify the project from Dr. Theo Lind's 2026-04-06 staffing entry, then read the Node Willow-05 allocation on 2026-05-01; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Atlas-3B"], "evidence": [{"doc_id": "doc_000368", "sent_id": 2}, {"doc_id": "doc_000005", "sent_id": 6}], "id": "dev_000180", "question": "The 2026-06-01 assignment names Camila Quinn as evaluation owner; for that project, which evidence retrieval model appears on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Vela-7B"], "evidence": [{"doc_id": "doc_000301", "sent_id": 5}, {"doc_id": "doc_000003", "sent_id": 14}, {"doc_id": "doc_000003", "sent_id": 15}], "id": "dev_000181", "question": "First identify the project from Owen Marin's 2026-05-26 assignment as the data steward; which model did that project choose for reranking on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2026-05-08"], "evidence": [{"doc_id": "doc_000186", "sent_id": 8}, {"doc_id": "doc_000186", "sent_id": 9}], "id": "dev_000182", "question": "In the 2026-04-21 schedule revision, which earlier date did Project Sonata replace for Milestone X1?", "reasoning_type": "single_hop"}
{"answers": ["the evaluation owner"], "evidence": [{"doc_id": "doc_000332", "sent_id": 10}, {"doc_id": "doc_000332", "sent_id": 11}], "id": "dev_000183", "question": "In Project Anchor's 2026-04-21 staffing entry, what duties were assigned to Kira Iyer?", "reasoning_type": "single_hop"}
{"answers": ["late interaction"], "evidence": [{"doc_id": "doc_000178", "sent_id": 11}, {"doc_id": "doc_000178", "sent_id": 12}], "id": "dev_000184", "question": "In Project Anchor's 2026-06-13 update, what method was being moved away from?", "reasoning_type": "single_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000327", "sent_id": 4}, {"doc_id": "doc_000007", "sent_id": 2}], "id": "dev_000185", "question": "Using Lena Sol's evaluation owner assignment as the bridge, how many GPUs did Node Fir-10 allocate on 2026-04-18?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000257", "sent_id": 5}, {"doc_id": "doc_000013", "sent_id": 9}], "id": "dev_000186", "question": "Using Iris Stone's data steward assignment as the bridge, how many GPUs did Node Spruce-03 allocate on 2026-05-09?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000367", "sent_id": 6}, {"doc_id": "doc_000005", "sent_id": 8}, {"doc_id": "doc_000005", "sent_id": 9}], "id": "dev_000187", "question": "Using Dr. Julian Gray's lead assignment as the bridge, how many GPUs did Node Birch-04 allocate on 2026-05-23?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Cedar-3B"], "evidence": [{"doc_id": "doc_000109", "sent_id": 3}, {"doc_id": "doc_000109", "sent_id": 4}], "id": "dev_000188", "question": "Which model should be matched to Project Nereid's Node Laurel-11 failure from 2026-05-01?", "reasoning_type": "single_hop"}
{"answers": ["Dr. Theo Grant"], "evidence": [{"doc_id": "doc_000171", "sent_id": 4}, {"doc_id": "doc_000171", "sent_id": 5}], "id": "dev_000189", "question": "The 2026-04-12 entry lists a data steward for Project Saffron; who is it?", "reasoning_type": "single_hop"}
{"answers": ["Kestrel-7B"], "evidence": [{"doc_id": "doc_000169", "sent_id": 2}, {"doc_id": "doc_000169", "sent_id": 3}, {"doc_id": "doc_000049", "sent_id": 12}, {"doc_id": "doc_000049", "sent_id": 13}], "id": "dev_000190", "question": "Two macro F1 entries are relevant: Kestrel-7B on OrionBench-3 for Project Nereid, and Vela-7B on LabQA-2 for Project Sonata. Which model is higher?", "reasoning_type": "numeric_comparison"}
{"answers": ["the evaluation owner"], "evidence": [{"doc_id": "doc_000066", "sent_id": 8}], "id": "dev_000191", "question": "In Project Meridian's 2026-05-05 staffing entry, what duties were assigned to Nadia Chen?", "reasoning_type": "single_hop"}
{"answers": ["2026-06-25"], "evidence": [{"doc_id": "doc_000399", "sent_id": 9}, {"doc_id": "doc_000399", "sent_id": 10}], "id": "dev_000192", "question": "Which deadline replaced the old one for Project Nereid's Milestone V1 on 2026-05-26?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000434", "sent_id": 2}, {"doc_id": "doc_000434", "sent_id": 3}, {"doc_id": "doc_000021", "sent_id": 2}], "id": "dev_000193", "question": "Using Sofia Nadir's retrieval owner assignment as the bridge, how many GPUs did Node Fir-10 allocate on 2026-05-13?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Juniper-06"], "evidence": [{"doc_id": "doc_000066", "sent_id": 11}, {"doc_id": "doc_000066", "sent_id": 12}], "id": "dev_000194", "question": "Which node is named with the 0.791 accuracy result for Finch-3B on VestaLogs in Project Anchor?", "reasoning_type": "single_hop"}
{"answers": ["Mira-8B"], "evidence": [{"doc_id": "doc_000120", "sent_id": 9}, {"doc_id": "doc_000120", "sent_id": 10}], "id": "dev_000195", "question": "Which model should be matched to Project Saffron's 2026-05-31 calibration track?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000252", "sent_id": 12}, {"doc_id": "doc_000252", "sent_id": 13}, {"doc_id": "doc_000004", "sent_id": 11}, {"doc_id": "doc_000004", "sent_id": 12}], "id": "dev_000196", "question": "The 2026-05-05 assignment names Dr. Noah Chen; for that same project, what GPU block did Node Spruce-03 supply on 2026-04-23?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["the evaluation owner"], "evidence": [{"doc_id": "doc_000349", "sent_id": 2}], "id": "dev_000197", "question": "The 2026-05-11 personnel note connects Mira Nolan to which role for Project Meridian?", "reasoning_type": "single_hop"}
{"answers": ["Cedar-8B"], "evidence": [{"doc_id": "doc_000212", "sent_id": 4}, {"doc_id": "doc_000016", "sent_id": 3}, {"doc_id": "doc_000016", "sent_id": 4}], "id": "dev_000198", "question": "The 2026-04-13 assignment names Vera Torres as retrieval owner; for that project, which error analysis model appears on 2026-05-06?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Hazel-14"], "evidence": [{"doc_id": "doc_000140", "sent_id": 4}], "id": "dev_000199", "question": "Which node is named with the 0.714 macro F1 result for Atlas-8B on RiverBench-2 in Project Nereid?", "reasoning_type": "single_hop"}
{"answers": ["Marble-3B"], "evidence": [{"doc_id": "doc_000427", "sent_id": 2}, {"doc_id": "doc_000427", "sent_id": 3}, {"doc_id": "doc_000003", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 7}], "id": "dev_000200", "question": "Use the staffing clue for Priya Vale on 2026-06-15 to find the project. What model did it pick for error analysis on 2026-04-12?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000297", "sent_id": 4}, {"doc_id": "doc_000033", "sent_id": 3}], "id": "dev_000201", "question": "Using Samir Kwan's retrieval owner assignment as the bridge, how many GPUs did Node Sycamore-13 allocate on 2026-04-02?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Birch-04"], "evidence": [{"doc_id": "doc_000442", "sent_id": 6}, {"doc_id": "doc_000442", "sent_id": 7}], "id": "dev_000202", "question": "Project Meridian's allocation of 4 GPUs on 2026-06-12 came from what node?", "reasoning_type": "single_hop"}
{"answers": ["2026-05-18"], "evidence": [{"doc_id": "doc_000255", "sent_id": 8}], "id": "dev_000203", "question": "Which deadline replaced the old one for Project Saffron's Milestone D2 on 2026-04-20?", "reasoning_type": "single_hop"}
{"answers": ["Nova-7B"], "evidence": [{"doc_id": "doc_000408", "sent_id": 8}, {"doc_id": "doc_000440", "sent_id": 5}, {"doc_id": "doc_000440", "sent_id": 6}], "id": "dev_000204", "question": "Reading both result notes, which model has the larger accuracy: Nova-7B from Project Meridian or Mira-7B from Project Saffron?", "reasoning_type": "numeric_comparison"}
{"answers": ["Atlas-8B"], "evidence": [{"doc_id": "doc_000136", "sent_id": 11}, {"doc_id": "doc_000136", "sent_id": 12}, {"doc_id": "doc_000007", "sent_id": 4}], "id": "dev_000205", "question": "Use the staffing clue for Evan Moss on 2026-04-06 to find the project. What model did it pick for evidence retrieval on 2026-04-16?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["BM25 retrieval"], "evidence": [{"doc_id": "doc_000266", "sent_id": 2}, {"doc_id": "doc_000266", "sent_id": 3}], "id": "dev_000206", "question": "Project Meridian's 2026-04-30 note retired an older method; what replaced it?", "reasoning_type": "single_hop"}
{"answers": ["alias expansion"], "evidence": [{"doc_id": "doc_000166", "sent_id": 2}, {"doc_id": "doc_000166", "sent_id": 3}], "id": "dev_000207", "question": "Which method became the replacement in Project Sonata's 2026-04-29 update?", "reasoning_type": "single_hop"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000436", "sent_id": 6}, {"doc_id": "doc_000007", "sent_id": 3}], "id": "dev_000208", "question": "Use the staffing clue for Nadia Singh on 2026-04-28 to find the project. What model did it pick for claim classification on 2026-05-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["calibration"], "evidence": [{"doc_id": "doc_000441", "sent_id": 2}], "id": "dev_000209", "question": "Project Meridian's 2026-04-23 entry says Nimbus-7B was chosen for which use?", "reasoning_type": "single_hop"}
{"answers": ["River-8B"], "evidence": [{"doc_id": "doc_000200", "sent_id": 2}, {"doc_id": "doc_000200", "sent_id": 3}], "id": "dev_000210", "question": "Which model should be matched to Project Aster's 2026-06-30 evidence retrieval track?", "reasoning_type": "single_hop"}
{"answers": ["Project Meridian"], "evidence": [{"doc_id": "doc_000275", "sent_id": 11}, {"doc_id": "doc_000413", "sent_id": 7}, {"doc_id": "doc_000413", "sent_id": 8}], "id": "dev_000211", "question": "Which project wins the accuracy comparison, Project Meridian or Project Saffron?", "reasoning_type": "numeric_comparison"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000070", "sent_id": 11}, {"doc_id": "doc_000021", "sent_id": 2}], "id": "dev_000212", "question": "Using Samir Ames's lead assignment as the bridge, how many GPUs did Node Fir-10 allocate on 2026-05-13?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000405", "sent_id": 13}, {"doc_id": "doc_000002", "sent_id": 4}], "id": "dev_000213", "question": "Identify the project from Nadia Singh's 2026-04-07 staffing entry, then read the Node Birch-04 allocation on 2026-06-27; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2026-05-24"], "evidence": [{"doc_id": "doc_000334", "sent_id": 9}, {"doc_id": "doc_000334", "sent_id": 10}], "id": "dev_000214", "question": "Which deadline replaced the old one for Project Nereid's Milestone J1 on 2026-05-13?", "reasoning_type": "single_hop"}
{"answers": ["Nimbus-7B"], "evidence": [{"doc_id": "doc_000253", "sent_id": 6}, {"doc_id": "doc_000253", "sent_id": 7}, {"doc_id": "doc_000044", "sent_id": 11}], "id": "dev_000215", "question": "Two accuracy entries are relevant: Nimbus-7B on MemoTrace for Project Meridian, and Marble-7B on VestaLogs-3 for Project Saffron. Which model is higher?", "reasoning_type": "numeric_comparison"}
{"answers": ["Marble-7B"], "evidence": [{"doc_id": "doc_000014", "sent_id": 8}], "id": "dev_000216", "question": "Project Sonata recorded a error analysis model choice on 2026-06-16; which model was chosen?", "reasoning_type": "single_hop"}
{"answers": ["Vela-7B"], "evidence": [{"doc_id": "doc_000377", "sent_id": 7}, {"doc_id": "doc_000377", "sent_id": 8}, {"doc_id": "doc_000003", "sent_id": 14}, {"doc_id": "doc_000003", "sent_id": 15}], "id": "dev_000217", "question": "Use the staffing clue for Priya Vale on 2026-06-23 to find the project. What model did it pick for reranking on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Aster-7B"], "evidence": [{"doc_id": "doc_000421", "sent_id": 3}], "id": "dev_000218", "question": "Which model should be matched to Project Saffron's 2026-06-07 evidence retrieval track?", "reasoning_type": "single_hop"}
{"answers": ["Nadia Chen"], "evidence": [{"doc_id": "doc_000373", "sent_id": 2}], "id": "dev_000219", "question": "In the 2026-04-06 staffing note for Project Meridian, who took evaluation owner duties?", "reasoning_type": "single_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000215", "sent_id": 2}, {"doc_id": "doc_000215", "sent_id": 3}, {"doc_id": "doc_000007", "sent_id": 2}], "id": "dev_000220", "question": "Using Owen Marin's data steward assignment as the bridge, how many GPUs did Node Fir-10 allocate on 2026-04-18?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Camila Quinn"], "evidence": [{"doc_id": "doc_000351", "sent_id": 8}], "id": "dev_000221", "question": "In the 2026-05-26 staffing note for Project Meridian, who took evaluation owner duties?", "reasoning_type": "single_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000435", "sent_id": 3}, {"doc_id": "doc_000435", "sent_id": 4}, {"doc_id": "doc_000007", "sent_id": 2}], "id": "dev_000222", "question": "Using Petra Adler's data steward assignment as the bridge, how many GPUs did Node Fir-10 allocate on 2026-04-18?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["a checkpoint-mismatch error"], "evidence": [{"doc_id": "doc_000208", "sent_id": 5}], "id": "dev_000223", "question": "Which problem explains the 2026-06-05 failure for Project Anchor's Orchid-7B run on Node Cedar-02?", "reasoning_type": "single_hop"}
{"answers": ["Marble-3B"], "evidence": [{"doc_id": "doc_000018", "sent_id": 3}, {"doc_id": "doc_000018", "sent_id": 4}, {"doc_id": "doc_000003", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 7}], "id": "dev_000224", "question": "First identify the project from Petra Gray's 2026-04-26 assignment as the evaluation owner; which model did that project choose for error analysis on 2026-04-12?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000228", "sent_id": 3}, {"doc_id": "doc_000007", "sent_id": 3}], "id": "dev_000225", "question": "First identify the project from Mira Nolan's 2026-06-02 assignment as the evaluation owner; which model did that project choose for claim classification on 2026-05-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Quartz-8B"], "evidence": [{"doc_id": "doc_000139", "sent_id": 4}], "id": "dev_000226", "question": "Which model should be matched to Project Sonata's Node Pine-07 failure from 2026-04-03?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000027", "sent_id": 7}, {"doc_id": "doc_000001", "sent_id": 3}, {"doc_id": "doc_000001", "sent_id": 4}], "id": "dev_000227", "question": "The 2026-04-27 assignment names Evan Moss; for that same project, what GPU block did Node Birch-04 supply on 2026-04-03?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000346", "sent_id": 7}, {"doc_id": "doc_000004", "sent_id": 11}, {"doc_id": "doc_000004", "sent_id": 12}], "id": "dev_000228", "question": "The 2026-05-11 assignment names Mina Shah; for that same project, what GPU block did Node Spruce-03 supply on 2026-04-23?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["River-3B"], "evidence": [{"doc_id": "doc_000215", "sent_id": 9}, {"doc_id": "doc_000001", "sent_id": 11}], "id": "dev_000229", "question": "The 2026-06-29 assignment names Dr. Noah Vale as lead; for that project, which evidence retrieval model appears on 2026-06-07?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Rowan-09"], "evidence": [{"doc_id": "doc_000258", "sent_id": 2}], "id": "dev_000230", "question": "Which compute node is tied to Project Aster's 2026-04-20 allocation of 1 GPU?", "reasoning_type": "single_hop"}
{"answers": ["Cedar-02"], "evidence": [{"doc_id": "doc_000311", "sent_id": 2}, {"doc_id": "doc_000311", "sent_id": 3}], "id": "dev_000231", "question": "The 2026-04-29 allocation for Project Anchor lists 4 GPUs; which node supplied them?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000322", "sent_id": 2}, {"doc_id": "doc_000013", "sent_id": 9}], "id": "dev_000232", "question": "Identify the project from Kira Iyer's 2026-04-27 staffing entry, then read the Node Spruce-03 allocation on 2026-05-09; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Marble-7B"], "evidence": [{"doc_id": "doc_000166", "sent_id": 6}, {"doc_id": "doc_000166", "sent_id": 7}, {"doc_id": "doc_000002", "sent_id": 5}], "id": "dev_000233", "question": "The 2026-04-20 assignment names Mara Lane as retrieval owner; for that project, which error analysis model appears on 2026-04-22?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Project Nereid"], "evidence": [{"doc_id": "doc_000088", "sent_id": 8}, {"doc_id": "doc_000257", "sent_id": 9}], "id": "dev_000234", "question": "Looking at both evidence F1 result notes, which project should be selected as higher: Project Nereid or Project Aster?", "reasoning_type": "numeric_comparison"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000425", "sent_id": 4}, {"doc_id": "doc_000001", "sent_id": 3}, {"doc_id": "doc_000001", "sent_id": 4}], "id": "dev_000235", "question": "Using Nora Sol's retrieval owner assignment as the bridge, how many GPUs did Node Birch-04 allocate on 2026-04-03?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000132", "sent_id": 11}, {"doc_id": "doc_000021", "sent_id": 2}], "id": "dev_000236", "question": "The 2026-05-25 assignment names Mara Lane; for that same project, what GPU block did Node Fir-10 supply on 2026-05-13?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Marble-3B"], "evidence": [{"doc_id": "doc_000176", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 7}], "id": "dev_000237", "question": "The 2026-05-04 assignment names Priya Vale as evaluation owner; for that project, which error analysis model appears on 2026-04-12?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000257", "sent_id": 6}], "id": "dev_000238", "question": "How large was the GPU block from Node Maple-01 for Project Saffron in the 2026-04-24 entry?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000351", "sent_id": 4}, {"doc_id": "doc_000002", "sent_id": 4}], "id": "dev_000239", "question": "Using Dr. Ravi Reed's evaluation owner assignment as the bridge, how many GPUs did Node Birch-04 allocate on 2026-06-27?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Birch-04"], "evidence": [{"doc_id": "doc_000189", "sent_id": 4}], "id": "dev_000240", "question": "Which node is named with the 0.867 latency efficiency score result for Kestrel-7B on CedarQA in Project Meridian?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000380", "sent_id": 11}, {"doc_id": "doc_000380", "sent_id": 12}, {"doc_id": "doc_000007", "sent_id": 5}], "id": "dev_000241", "question": "Identify the project from Iris Stone's 2026-04-27 staffing entry, then read the Node Rowan-09 allocation on 2026-04-11; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000311", "sent_id": 11}, {"doc_id": "doc_000001", "sent_id": 3}, {"doc_id": "doc_000001", "sent_id": 4}], "id": "dev_000242", "question": "Using Vera Kim's lead assignment as the bridge, how many GPUs did Node Birch-04 allocate on 2026-04-03?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["an unstable-validation-loss error"], "evidence": [{"doc_id": "doc_000054", "sent_id": 4}], "id": "dev_000243", "question": "Which problem explains the 2026-05-09 failure for Project Sonata's Vela-8B run on Node Fir-10?", "reasoning_type": "single_hop"}
{"answers": ["0.732"], "evidence": [{"doc_id": "doc_000159", "sent_id": 7}, {"doc_id": "doc_000159", "sent_id": 8}], "id": "dev_000244", "question": "Project Nereid's 2026-06-02 result put Kestrel-8B on OrionBench-3; what evidence F1 was reported?", "reasoning_type": "single_hop"}
{"answers": ["0.577"], "evidence": [{"doc_id": "doc_000414", "sent_id": 7}, {"doc_id": "doc_000414", "sent_id": 8}], "id": "dev_000245", "question": "In the 2026-05-25 result note, what latency efficiency score did Quartz-3B produce for Project Saffron on CedarQA-2?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000115", "sent_id": 6}, {"doc_id": "doc_000004", "sent_id": 11}, {"doc_id": "doc_000004", "sent_id": 12}], "id": "dev_000246", "question": "Identify the project from Talia Marin's 2026-06-16 staffing entry, then read the Node Spruce-03 allocation on 2026-04-23; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000260", "sent_id": 7}, {"doc_id": "doc_000260", "sent_id": 8}, {"doc_id": "doc_000007", "sent_id": 3}], "id": "dev_000247", "question": "First identify the project from Elian Shah's 2026-06-09 assignment as the data steward; which model did that project choose for claim classification on 2026-05-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Orchid-7B"], "evidence": [{"doc_id": "doc_000343", "sent_id": 2}, {"doc_id": "doc_000005", "sent_id": 10}, {"doc_id": "doc_000005", "sent_id": 11}], "id": "dev_000248", "question": "The 2026-05-19 assignment names Leo Hale as data steward; for that project, which reranking model appears on 2026-06-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Atlas-3B"], "evidence": [{"doc_id": "doc_000126", "sent_id": 3}, {"doc_id": "doc_000005", "sent_id": 6}], "id": "dev_000249", "question": "Use the staffing clue for Mira Sato on 2026-06-30 to find the project. What model did it pick for evidence retrieval on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Maple-01"], "evidence": [{"doc_id": "doc_000278", "sent_id": 7}, {"doc_id": "doc_000278", "sent_id": 8}], "id": "dev_000250", "question": "The 2026-04-13 result for Project Saffron reports Marble-8B at 0.631 accuracy; which node handled that VestaLogs-3 run?", "reasoning_type": "single_hop"}
{"answers": ["Lumen-7B"], "evidence": [{"doc_id": "doc_000099", "sent_id": 13}, {"doc_id": "doc_000099", "sent_id": 14}, {"doc_id": "doc_000007", "sent_id": 10}], "id": "dev_000251", "question": "Use the staffing clue for Dr. Arun Bauer on 2026-05-19 to find the project. What model did it pick for calibration on 2026-06-04?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["an out-of-memory error"], "evidence": [{"doc_id": "doc_000123", "sent_id": 6}], "id": "dev_000252", "question": "Project Nereid's 2026-05-15 failed run used Nova-7B on Node Aspen-01; what issue was recorded?", "reasoning_type": "single_hop"}
{"answers": ["Lumen-7B"], "evidence": [{"doc_id": "doc_000125", "sent_id": 6}, {"doc_id": "doc_000125", "sent_id": 7}, {"doc_id": "doc_000007", "sent_id": 10}], "id": "dev_000253", "question": "The 2026-06-01 assignment names Selene Kim as evaluation owner; for that project, which calibration model appears on 2026-06-04?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Maple-01"], "evidence": [{"doc_id": "doc_000308", "sent_id": 2}], "id": "dev_000254", "question": "The 2026-05-17 result for Project Saffron reports Marble-8B at 0.721 latency efficiency score; which node handled that VestaLogs-3 run?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000187", "sent_id": 5}, {"doc_id": "doc_000187", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 3}], "id": "dev_000255", "question": "Identify the project from Dr. Theo Lind's 2026-06-30 staffing entry, then read the Node Willow-05 allocation on 2026-05-01; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Nova-7B"], "evidence": [{"doc_id": "doc_000180", "sent_id": 2}, {"doc_id": "doc_000124", "sent_id": 4}], "id": "dev_000256", "question": "Which model wins the latency efficiency score comparison between Project Meridian's Nova-7B run and Project Saffron's Mira-7B run?", "reasoning_type": "numeric_comparison"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000341", "sent_id": 3}, {"doc_id": "doc_000341", "sent_id": 4}, {"doc_id": "doc_000004", "sent_id": 11}, {"doc_id": "doc_000004", "sent_id": 12}], "id": "dev_000257", "question": "The 2026-06-23 assignment names Dr. Noah Vale; for that same project, what GPU block did Node Spruce-03 supply on 2026-04-23?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000183", "sent_id": 4}, {"doc_id": "doc_000183", "sent_id": 5}, {"doc_id": "doc_000021", "sent_id": 2}], "id": "dev_000258", "question": "The 2026-05-19 assignment names Dr. Jonas Rios; for that same project, what GPU block did Node Fir-10 supply on 2026-05-13?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["1"], "evidence": [{"doc_id": "doc_000190", "sent_id": 2}], "id": "dev_000259", "question": "How large was the GPU block from Node Fir-10 for Project Sonata in the 2026-06-27 entry?", "reasoning_type": "single_hop"}
{"answers": ["Project Nereid"], "evidence": [{"doc_id": "doc_000108", "sent_id": 7}, {"doc_id": "doc_000281", "sent_id": 5}, {"doc_id": "doc_000281", "sent_id": 6}], "id": "dev_000260", "question": "The two runs use Cedar-8B and Vela-8B; which project has the larger evidence F1 value?", "reasoning_type": "numeric_comparison"}
{"answers": ["Aster-7B"], "evidence": [{"doc_id": "doc_000113", "sent_id": 2}], "id": "dev_000261", "question": "For Project Sonata, what model was used in the 2026-04-30 run that failed from an unstable-validation-loss error?", "reasoning_type": "single_hop"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000390", "sent_id": 14}, {"doc_id": "doc_000007", "sent_id": 3}], "id": "dev_000262", "question": "The 2026-04-28 assignment names Dr. Ravi Reed as evaluation owner; for that project, which claim classification model appears on 2026-05-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000390", "sent_id": 2}, {"doc_id": "doc_000390", "sent_id": 3}, {"doc_id": "doc_000002", "sent_id": 4}], "id": "dev_000263", "question": "Identify the project from Dr. Ravi Nadir's 2026-06-07 staffing entry, then read the Node Birch-04 allocation on 2026-06-27; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Nimbus-7B"], "evidence": [{"doc_id": "doc_000049", "sent_id": 7}, {"doc_id": "doc_000049", "sent_id": 8}, {"doc_id": "doc_000191", "sent_id": 11}, {"doc_id": "doc_000191", "sent_id": 12}], "id": "dev_000264", "question": "Which model wins the accuracy comparison between Project Meridian's Nimbus-7B run and Project Saffron's Quartz-7B run?", "reasoning_type": "numeric_comparison"}
{"answers": ["0.818"], "evidence": [{"doc_id": "doc_000232", "sent_id": 7}], "id": "dev_000265", "question": "Which macro F1 value is attached to the 2026-04-25 Lumen-3B run on TraceEval for Project Aster?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000111", "sent_id": 7}, {"doc_id": "doc_000021", "sent_id": 2}], "id": "dev_000266", "question": "Using Dr. Jonas Nolan's retrieval owner assignment as the bridge, how many GPUs did Node Fir-10 allocate on 2026-05-13?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Marble-8B"], "evidence": [{"doc_id": "doc_000201", "sent_id": 13}, {"doc_id": "doc_000201", "sent_id": 14}], "id": "dev_000267", "question": "In the 2026-06-05 model-selection note, what did Project Sonata pick for error analysis?", "reasoning_type": "single_hop"}
{"answers": ["Project Anchor"], "evidence": [{"doc_id": "doc_000194", "sent_id": 9}, {"doc_id": "doc_000385", "sent_id": 10}], "id": "dev_000268", "question": "Looking at both accuracy result notes, which project should be selected as higher: Project Saffron or Project Anchor?", "reasoning_type": "numeric_comparison"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000107", "sent_id": 5}, {"doc_id": "doc_000021", "sent_id": 2}], "id": "dev_000269", "question": "Identify the project from Rohan Singh's 2026-04-13 staffing entry, then read the Node Fir-10 allocation on 2026-05-13; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Finch-8B"], "evidence": [{"doc_id": "doc_000326", "sent_id": 7}, {"doc_id": "doc_000140", "sent_id": 4}], "id": "dev_000270", "question": "Which model wins the macro F1 comparison between Project Aster's Finch-8B run and Project Nereid's Atlas-8B run?", "reasoning_type": "numeric_comparison"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000425", "sent_id": 2}, {"doc_id": "doc_000425", "sent_id": 3}, {"doc_id": "doc_000033", "sent_id": 3}], "id": "dev_000271", "question": "Using Sofia Nadir's retrieval owner assignment as the bridge, how many GPUs did Node Sycamore-13 allocate on 2026-04-02?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Juniper-06"], "evidence": [{"doc_id": "doc_000406", "sent_id": 3}], "id": "dev_000272", "question": "Which node is named with the 0.821 latency efficiency score result for Finch-8B on VestaLogs in Project Anchor?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000125", "sent_id": 6}, {"doc_id": "doc_000125", "sent_id": 7}, {"doc_id": "doc_000007", "sent_id": 5}], "id": "dev_000273", "question": "Using Selene Kim's evaluation owner assignment as the bridge, how many GPUs did Node Rowan-09 allocate on 2026-04-11?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["River-3B"], "evidence": [{"doc_id": "doc_000169", "sent_id": 12}, {"doc_id": "doc_000001", "sent_id": 11}], "id": "dev_000274", "question": "First identify the project from Anika Sato's 2026-06-30 assignment as the lead; which model did that project choose for evidence retrieval on 2026-06-07?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["sentence pruning"], "evidence": [{"doc_id": "doc_000227", "sent_id": 9}], "id": "dev_000275", "question": "After the 2026-04-08 method change, what approach was Project Sonata using?", "reasoning_type": "single_hop"}
{"answers": ["2026-07-01"], "evidence": [{"doc_id": "doc_000436", "sent_id": 7}], "id": "dev_000276", "question": "In the 2026-06-11 schedule revision, which earlier date did Project Saffron replace for Milestone D2?", "reasoning_type": "single_hop"}
{"answers": ["2026-06-24"], "evidence": [{"doc_id": "doc_000139", "sent_id": 13}], "id": "dev_000277", "question": "What was the prior Milestone Z1 deadline before Project Aster's 2026-06-01 update?", "reasoning_type": "single_hop"}
{"answers": ["Atlas-8B"], "evidence": [{"doc_id": "doc_000212", "sent_id": 4}, {"doc_id": "doc_000007", "sent_id": 4}], "id": "dev_000278", "question": "Use the staffing clue for Vera Torres on 2026-04-13 to find the project. What model did it pick for evidence retrieval on 2026-04-16?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Atlas-3B"], "evidence": [{"doc_id": "doc_000144", "sent_id": 9}, {"doc_id": "doc_000144", "sent_id": 10}, {"doc_id": "doc_000005", "sent_id": 6}], "id": "dev_000279", "question": "First identify the project from Mira Nolan's 2026-05-25 assignment as the evaluation owner; which model did that project choose for evidence retrieval on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Finch-7B"], "evidence": [{"doc_id": "doc_000381", "sent_id": 10}], "id": "dev_000280", "question": "Which model should be matched to Project Anchor's 2026-04-01 error analysis track?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000285", "sent_id": 8}, {"doc_id": "doc_000285", "sent_id": 9}, {"doc_id": "doc_000007", "sent_id": 5}], "id": "dev_000281", "question": "The 2026-05-11 assignment names Leo Hale; for that same project, what GPU block did Node Rowan-09 supply on 2026-04-11?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["a missing-index error"], "evidence": [{"doc_id": "doc_000193", "sent_id": 4}, {"doc_id": "doc_000193", "sent_id": 5}], "id": "dev_000282", "question": "The failure note for Project Meridian on 2026-04-02 names what cause for the Nimbus-7B run?", "reasoning_type": "single_hop"}
{"answers": ["Laurel-11"], "evidence": [{"doc_id": "doc_000013", "sent_id": 12}], "id": "dev_000283", "question": "The 2026-06-08 result for Project Meridian reports Cedar-3B at 0.741 accuracy; which node handled that VestaLogs-2 run?", "reasoning_type": "single_hop"}
{"answers": ["Mira-8B"], "evidence": [{"doc_id": "doc_000442", "sent_id": 2}, {"doc_id": "doc_000442", "sent_id": 3}], "id": "dev_000284", "question": "For Project Saffron, what model was used in the 2026-04-24 run that failed from a checkpoint-mismatch error?", "reasoning_type": "single_hop"}
{"answers": ["Poplar-12"], "evidence": [{"doc_id": "doc_000211", "sent_id": 4}], "id": "dev_000285", "question": "The 2026-04-07 result for Project Anchor reports Helix-7B at 0.557 latency efficiency score; which node handled that CedarQA-3 run?", "reasoning_type": "single_hop"}
{"answers": ["2026-05-29"], "evidence": [{"doc_id": "doc_000295", "sent_id": 13}], "id": "dev_000286", "question": "Project Nereid's 2026-05-08 schedule note gives what new date for Milestone P1?", "reasoning_type": "single_hop"}
{"answers": ["Orchid-7B"], "evidence": [{"doc_id": "doc_000257", "sent_id": 5}, {"doc_id": "doc_000005", "sent_id": 10}, {"doc_id": "doc_000005", "sent_id": 11}], "id": "dev_000287", "question": "Use the staffing clue for Iris Stone on 2026-05-26 to find the project. What model did it pick for reranking on 2026-06-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Finch-7B"], "evidence": [{"doc_id": "doc_000021", "sent_id": 11}, {"doc_id": "doc_000008", "sent_id": 9}, {"doc_id": "doc_000008", "sent_id": 10}], "id": "dev_000288", "question": "First identify the project from Anika Costa's 2026-05-25 assignment as the retrieval owner; which model did that project choose for error analysis on 2026-04-17?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2026-06-29"], "evidence": [{"doc_id": "doc_000298", "sent_id": 9}], "id": "dev_000289", "question": "What was the prior Milestone R1 deadline before Project Sonata's 2026-06-10 update?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000061", "sent_id": 8}, {"doc_id": "doc_000001", "sent_id": 3}, {"doc_id": "doc_000001", "sent_id": 4}], "id": "dev_000290", "question": "Identify the project from Darian Grant's 2026-04-07 staffing entry, then read the Node Birch-04 allocation on 2026-04-03; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Kestrel-7B"], "evidence": [{"doc_id": "doc_000175", "sent_id": 9}, {"doc_id": "doc_000175", "sent_id": 10}], "id": "dev_000291", "question": "The 2026-05-08 failure note ties a missing-index error on Node Birch-04 to which Project Meridian model?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000177", "sent_id": 11}, {"doc_id": "doc_000177", "sent_id": 12}, {"doc_id": "doc_000001", "sent_id": 3}, {"doc_id": "doc_000001", "sent_id": 4}], "id": "dev_000292", "question": "The 2026-06-29 assignment names Evan Iyer; for that same project, what GPU block did Node Birch-04 supply on 2026-04-03?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["reward reranking"], "evidence": [{"doc_id": "doc_000045", "sent_id": 11}], "id": "dev_000293", "question": "In Project Saffron's 2026-04-23 update, what method was being moved away from?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000253", "sent_id": 3}, {"doc_id": "doc_000013", "sent_id": 9}], "id": "dev_000294", "question": "Using Dr. Arun Bauer's evaluation owner assignment as the bridge, how many GPUs did Node Spruce-03 allocate on 2026-05-09?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["0.833"], "evidence": [{"doc_id": "doc_000402", "sent_id": 2}], "id": "dev_000295", "question": "Project Anchor's 2026-05-18 result put Lumen-3B on MemoTrace-3; what latency efficiency score was reported?", "reasoning_type": "single_hop"}
{"answers": ["Project Anchor"], "evidence": [{"doc_id": "doc_000424", "sent_id": 4}, {"doc_id": "doc_000284", "sent_id": 4}], "id": "dev_000296", "question": "Looking at both accuracy result notes, which project should be selected as higher: Project Anchor or Project Meridian?", "reasoning_type": "numeric_comparison"}
{"answers": ["Cedar-8B"], "evidence": [{"doc_id": "doc_000190", "sent_id": 7}, {"doc_id": "doc_000016", "sent_id": 3}, {"doc_id": "doc_000016", "sent_id": 4}], "id": "dev_000297", "question": "Use the staffing clue for Vera Torres on 2026-05-25 to find the project. What model did it pick for error analysis on 2026-05-06?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000425", "sent_id": 9}, {"doc_id": "doc_000001", "sent_id": 3}, {"doc_id": "doc_000001", "sent_id": 4}], "id": "dev_000298", "question": "The 2026-04-20 assignment names Dr. Julian Gray; for that same project, what GPU block did Node Birch-04 supply on 2026-04-03?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Mira-7B"], "evidence": [{"doc_id": "doc_000231", "sent_id": 3}, {"doc_id": "doc_000231", "sent_id": 4}, {"doc_id": "doc_000004", "sent_id": 4}], "id": "dev_000299", "question": "Use the staffing clue for Dr. Jonas Rios on 2026-06-08 to find the project. What model did it pick for calibration on 2026-06-24?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Atlas-3B"], "evidence": [{"doc_id": "doc_000015", "sent_id": 7}, {"doc_id": "doc_000256", "sent_id": 5}], "id": "dev_000300", "question": "Which model wins the macro F1 comparison between Project Aster's Finch-3B run and Project Nereid's Atlas-3B run?", "reasoning_type": "numeric_comparison"}
{"answers": ["Finch-7B"], "evidence": [{"doc_id": "doc_000028", "sent_id": 8}, {"doc_id": "doc_000008", "sent_id": 9}, {"doc_id": "doc_000008", "sent_id": 10}], "id": "dev_000301", "question": "Use the staffing clue for Mina Shah on 2026-04-21 to find the project. What model did it pick for error analysis on 2026-04-17?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Orchid-7B"], "evidence": [{"doc_id": "doc_000263", "sent_id": 9}, {"doc_id": "doc_000263", "sent_id": 10}, {"doc_id": "doc_000005", "sent_id": 10}, {"doc_id": "doc_000005", "sent_id": 11}], "id": "dev_000302", "question": "Use the staffing clue for Iris Stone on 2026-05-05 to find the project. What model did it pick for reranking on 2026-06-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2026-05-27"], "evidence": [{"doc_id": "doc_000151", "sent_id": 12}, {"doc_id": "doc_000151", "sent_id": 13}], "id": "dev_000303", "question": "After Project Meridian revised Milestone D1 on 2026-04-29, what date became the deadline?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000058", "sent_id": 3}, {"doc_id": "doc_000013", "sent_id": 9}], "id": "dev_000304", "question": "The 2026-05-10 assignment names Dr. Arun Bauer; for that same project, what GPU block did Node Spruce-03 supply on 2026-05-09?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Dr. Julian Stone"], "evidence": [{"doc_id": "doc_000318", "sent_id": 10}, {"doc_id": "doc_000318", "sent_id": 11}], "id": "dev_000305", "question": "The 2026-04-27 entry lists a retrieval owner for Project Nereid; who is it?", "reasoning_type": "single_hop"}
{"answers": ["calibration"], "evidence": [{"doc_id": "doc_000013", "sent_id": 2}], "id": "dev_000306", "question": "Project Saffron's 2026-05-08 entry says Mira-3B was chosen for which use?", "reasoning_type": "single_hop"}
{"answers": ["2026-05-20"], "evidence": [{"doc_id": "doc_000394", "sent_id": 5}, {"doc_id": "doc_000394", "sent_id": 6}], "id": "dev_000307", "question": "Which old date was removed from Project Anchor's Milestone H1 schedule on 2026-05-06?", "reasoning_type": "single_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000064", "sent_id": 5}], "id": "dev_000308", "question": "The 2026-06-06 allocation note says Node Elm-08 supplied Project Meridian with what GPU count?", "reasoning_type": "single_hop"}
{"answers": ["Atlas-8B"], "evidence": [{"doc_id": "doc_000425", "sent_id": 9}, {"doc_id": "doc_000007", "sent_id": 4}], "id": "dev_000309", "question": "The 2026-04-20 assignment names Dr. Julian Gray as lead; for that project, which evidence retrieval model appears on 2026-04-16?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["a missing-index error"], "evidence": [{"doc_id": "doc_000337", "sent_id": 3}], "id": "dev_000310", "question": "The failure note for Project Saffron on 2026-06-20 names what cause for the Vela-7B run?", "reasoning_type": "single_hop"}
{"answers": ["2026-05-02"], "evidence": [{"doc_id": "doc_000167", "sent_id": 11}], "id": "dev_000311", "question": "In the 2026-04-22 schedule revision, which earlier date did Project Saffron replace for Milestone D2?", "reasoning_type": "single_hop"}
{"answers": ["0.872"], "evidence": [{"doc_id": "doc_000427", "sent_id": 6}], "id": "dev_000312", "question": "Which macro F1 value is attached to the 2026-05-05 Helix-8B run on OrionBench-2 for Project Aster?", "reasoning_type": "single_hop"}
{"answers": ["Hazel-14"], "evidence": [{"doc_id": "doc_000188", "sent_id": 11}], "id": "dev_000313", "question": "Which node is named with the 0.729 accuracy result for Atlas-3B on SignalSet-3 in Project Meridian?", "reasoning_type": "single_hop"}
{"answers": ["structured prompting"], "evidence": [{"doc_id": "doc_000164", "sent_id": 3}], "id": "dev_000314", "question": "What was the old method named before Project Nereid's 2026-05-20 replacement?", "reasoning_type": "single_hop"}
{"answers": ["2026-07-02"], "evidence": [{"doc_id": "doc_000301", "sent_id": 10}], "id": "dev_000315", "question": "Which deadline replaced the old one for Project Saffron's Milestone F1 on 2026-06-16?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000160", "sent_id": 7}, {"doc_id": "doc_000021", "sent_id": 2}], "id": "dev_000316", "question": "Identify the project from Mara Quinn's 2026-04-21 staffing entry, then read the Node Fir-10 allocation on 2026-05-13; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000408", "sent_id": 6}, {"doc_id": "doc_000007", "sent_id": 3}], "id": "dev_000317", "question": "First identify the project from Elian Shah's 2026-04-27 assignment as the data steward; which model did that project choose for claim classification on 2026-05-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["0.723"], "evidence": [{"doc_id": "doc_000241", "sent_id": 5}], "id": "dev_000318", "question": "Project Meridian's 2026-04-18 result put Nimbus-3B on MemoTrace; what latency efficiency score was reported?", "reasoning_type": "single_hop"}
{"answers": ["document chunking"], "evidence": [{"doc_id": "doc_000337", "sent_id": 4}], "id": "dev_000319", "question": "Which method became the replacement in Project Nereid's 2026-06-06 update?", "reasoning_type": "single_hop"}
{"answers": ["Atlas-3B"], "evidence": [{"doc_id": "doc_000244", "sent_id": 7}, {"doc_id": "doc_000005", "sent_id": 6}], "id": "dev_000320", "question": "Use the staffing clue for Nadia Singh on 2026-06-23 to find the project. What model did it pick for evidence retrieval on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Atlas-3B"], "evidence": [{"doc_id": "doc_000366", "sent_id": 3}, {"doc_id": "doc_000005", "sent_id": 6}], "id": "dev_000321", "question": "Use the staffing clue for Mira Sato on 2026-04-06 to find the project. What model did it pick for evidence retrieval on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["error analysis"], "evidence": [{"doc_id": "doc_000264", "sent_id": 7}], "id": "dev_000322", "question": "When Project Sonata picked Marble-3B on 2026-06-25, which work track was it for?", "reasoning_type": "single_hop"}
{"answers": ["Hazel-14"], "evidence": [{"doc_id": "doc_000158", "sent_id": 6}], "id": "dev_000323", "question": "The 2026-06-11 allocation for Project Meridian lists 4 GPUs; which node supplied them?", "reasoning_type": "single_hop"}
{"answers": ["Marble-3B"], "evidence": [{"doc_id": "doc_000244", "sent_id": 12}, {"doc_id": "doc_000003", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 7}], "id": "dev_000324", "question": "Use the staffing clue for Priya Moss on 2026-06-21 to find the project. What model did it pick for error analysis on 2026-04-12?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["error analysis"], "evidence": [{"doc_id": "doc_000402", "sent_id": 10}, {"doc_id": "doc_000402", "sent_id": 11}], "id": "dev_000325", "question": "When Project Aster picked Finch-7B on 2026-04-23, which work track was it for?", "reasoning_type": "single_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000214", "sent_id": 7}, {"doc_id": "doc_000214", "sent_id": 8}, {"doc_id": "doc_000021", "sent_id": 8}], "id": "dev_000326", "question": "Using Camila Quinn's evaluation owner assignment as the bridge, how many GPUs did Node Hazel-14 allocate on 2026-04-03?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000199", "sent_id": 9}, {"doc_id": "doc_000199", "sent_id": 10}, {"doc_id": "doc_000003", "sent_id": 3}], "id": "dev_000327", "question": "Using Owen Torres's evaluation owner assignment as the bridge, how many GPUs did Node Willow-05 allocate on 2026-05-01?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Mira-7B"], "evidence": [{"doc_id": "doc_000407", "sent_id": 9}, {"doc_id": "doc_000004", "sent_id": 4}], "id": "dev_000328", "question": "The 2026-06-16 assignment names Sofia Nadir as retrieval owner; for that project, which calibration model appears on 2026-06-24?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Vela-7B"], "evidence": [{"doc_id": "doc_000028", "sent_id": 9}, {"doc_id": "doc_000028", "sent_id": 10}, {"doc_id": "doc_000003", "sent_id": 14}, {"doc_id": "doc_000003", "sent_id": 15}], "id": "dev_000329", "question": "First identify the project from Owen Torres's 2026-04-21 assignment as the evaluation owner; which model did that project choose for reranking on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000149", "sent_id": 3}, {"doc_id": "doc_000149", "sent_id": 4}, {"doc_id": "doc_000007", "sent_id": 3}], "id": "dev_000330", "question": "Use the staffing clue for Dr. Ravi Nadir on 2026-04-07 to find the project. What model did it pick for claim classification on 2026-05-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Marble-7B"], "evidence": [{"doc_id": "doc_000253", "sent_id": 5}, {"doc_id": "doc_000002", "sent_id": 5}], "id": "dev_000331", "question": "First identify the project from Rohan Park's 2026-06-22 assignment as the lead; which model did that project choose for error analysis on 2026-04-22?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000244", "sent_id": 7}, {"doc_id": "doc_000007", "sent_id": 3}], "id": "dev_000332", "question": "The 2026-06-23 assignment names Nadia Singh as data steward; for that project, which claim classification model appears on 2026-05-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Project Saffron"], "evidence": [{"doc_id": "doc_000400", "sent_id": 2}, {"doc_id": "doc_000277", "sent_id": 13}], "id": "dev_000333", "question": "Looking at both latency efficiency score result notes, which project should be selected as higher: Project Meridian or Project Saffron?", "reasoning_type": "numeric_comparison"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000393", "sent_id": 10}, {"doc_id": "doc_000001", "sent_id": 3}, {"doc_id": "doc_000001", "sent_id": 4}], "id": "dev_000334", "question": "Using Darian Grant's lead assignment as the bridge, how many GPUs did Node Birch-04 allocate on 2026-04-03?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Project Saffron"], "evidence": [{"doc_id": "doc_000391", "sent_id": 10}, {"doc_id": "doc_000391", "sent_id": 11}, {"doc_id": "doc_000433", "sent_id": 4}], "id": "dev_000335", "question": "The two runs use Mira-3B and River-3B; which project has the larger accuracy value?", "reasoning_type": "numeric_comparison"}
{"answers": ["Nova-3B"], "evidence": [{"doc_id": "doc_000237", "sent_id": 3}, {"doc_id": "doc_000024", "sent_id": 5}], "id": "dev_000336", "question": "Reading both result notes, which model has the larger latency efficiency score: Mira-3B from Project Saffron or Nova-3B from Project Meridian?", "reasoning_type": "numeric_comparison"}
{"answers": ["Project Meridian"], "evidence": [{"doc_id": "doc_000111", "sent_id": 2}, {"doc_id": "doc_000111", "sent_id": 3}, {"doc_id": "doc_000241", "sent_id": 5}], "id": "dev_000337", "question": "Which project wins the latency efficiency score comparison, Project Anchor or Project Meridian?", "reasoning_type": "numeric_comparison"}
{"answers": ["Project Nereid"], "evidence": [{"doc_id": "doc_000108", "sent_id": 8}, {"doc_id": "doc_000147", "sent_id": 7}], "id": "dev_000338", "question": "The two runs use Quartz-7B and Atlas-8B; which project has the larger macro F1 value?", "reasoning_type": "numeric_comparison"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000249", "sent_id": 7}, {"doc_id": "doc_000007", "sent_id": 3}], "id": "dev_000339", "question": "First identify the project from Camila Brooks's 2026-04-06 assignment as the data steward; which model did that project choose for claim classification on 2026-05-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["River-3B"], "evidence": [{"doc_id": "doc_000031", "sent_id": 2}, {"doc_id": "doc_000001", "sent_id": 11}], "id": "dev_000340", "question": "The 2026-04-06 assignment names Anika Sato as lead; for that project, which evidence retrieval model appears on 2026-06-07?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2026-07-08"], "evidence": [{"doc_id": "doc_000161", "sent_id": 2}], "id": "dev_000341", "question": "In the 2026-06-25 schedule revision, which earlier date did Project Sonata replace for Milestone F1?", "reasoning_type": "single_hop"}
{"answers": ["Lumen-3B"], "evidence": [{"doc_id": "doc_000232", "sent_id": 7}, {"doc_id": "doc_000127", "sent_id": 3}, {"doc_id": "doc_000127", "sent_id": 4}], "id": "dev_000342", "question": "Which model wins the macro F1 comparison between Project Aster's Lumen-3B run and Project Sonata's Vela-3B run?", "reasoning_type": "numeric_comparison"}
{"answers": ["evidence retrieval"], "evidence": [{"doc_id": "doc_000288", "sent_id": 2}], "id": "dev_000343", "question": "The 2026-06-10 selection note ties Atlas-7B to what purpose for Project Meridian?", "reasoning_type": "single_hop"}
{"answers": ["Atlas-3B"], "evidence": [{"doc_id": "doc_000381", "sent_id": 9}, {"doc_id": "doc_000005", "sent_id": 6}], "id": "dev_000344", "question": "The 2026-05-04 assignment names Elian Ames as evaluation owner; for that project, which evidence retrieval model appears on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["1"], "evidence": [{"doc_id": "doc_000401", "sent_id": 4}, {"doc_id": "doc_000401", "sent_id": 5}, {"doc_id": "doc_000005", "sent_id": 4}], "id": "dev_000345", "question": "The 2026-06-08 assignment names Mina Adler; for that same project, what GPU block did Node Spruce-03 supply on 2026-05-30?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["the data steward"], "evidence": [{"doc_id": "doc_000263", "sent_id": 9}, {"doc_id": "doc_000263", "sent_id": 10}], "id": "dev_000346", "question": "In Project Anchor's 2026-05-05 staffing entry, what duties were assigned to Iris Stone?", "reasoning_type": "single_hop"}
{"answers": ["Project Meridian"], "evidence": [{"doc_id": "doc_000014", "sent_id": 6}, {"doc_id": "doc_000014", "sent_id": 7}, {"doc_id": "doc_000294", "sent_id": 5}, {"doc_id": "doc_000294", "sent_id": 6}], "id": "dev_000347", "question": "Looking at both accuracy result notes, which project should be selected as higher: Project Saffron or Project Meridian?", "reasoning_type": "numeric_comparison"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000147", "sent_id": 8}, {"doc_id": "doc_000004", "sent_id": 11}, {"doc_id": "doc_000004", "sent_id": 12}], "id": "dev_000348", "question": "Using Mina Adler's retrieval owner assignment as the bridge, how many GPUs did Node Spruce-03 allocate on 2026-04-23?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000174", "sent_id": 5}, {"doc_id": "doc_000007", "sent_id": 3}], "id": "dev_000349", "question": "First identify the project from Elian Shah's 2026-05-05 assignment as the data steward; which model did that project choose for claim classification on 2026-05-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Marble-3B"], "evidence": [{"doc_id": "doc_000187", "sent_id": 5}, {"doc_id": "doc_000187", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 7}], "id": "dev_000350", "question": "Use the staffing clue for Dr. Theo Lind on 2026-06-30 to find the project. What model did it pick for error analysis on 2026-04-12?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Orchid-7B"], "evidence": [{"doc_id": "doc_000161", "sent_id": 11}, {"doc_id": "doc_000161", "sent_id": 12}, {"doc_id": "doc_000005", "sent_id": 10}, {"doc_id": "doc_000005", "sent_id": 11}], "id": "dev_000351", "question": "The 2026-04-14 assignment names Selene Kim as evaluation owner; for that project, which reranking model appears on 2026-06-26?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Fir-10"], "evidence": [{"doc_id": "doc_000313", "sent_id": 9}], "id": "dev_000352", "question": "The 2026-05-28 allocation for Project Saffron lists 2 GPUs; which node supplied them?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000330", "sent_id": 9}, {"doc_id": "doc_000330", "sent_id": 10}, {"doc_id": "doc_000001", "sent_id": 3}, {"doc_id": "doc_000001", "sent_id": 4}], "id": "dev_000353", "question": "Using Dr. Julian Gray's lead assignment as the bridge, how many GPUs did Node Birch-04 allocate on 2026-04-03?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000190", "sent_id": 4}, {"doc_id": "doc_000002", "sent_id": 4}], "id": "dev_000354", "question": "Identify the project from Camila Quinn's 2026-04-21 staffing entry, then read the Node Birch-04 allocation on 2026-06-27; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Lumen-3B"], "evidence": [{"doc_id": "doc_000416", "sent_id": 9}, {"doc_id": "doc_000416", "sent_id": 10}], "id": "dev_000355", "question": "Which model should be matched to Project Aster's Node Spruce-03 failure from 2026-05-23?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000350", "sent_id": 13}, {"doc_id": "doc_000005", "sent_id": 8}, {"doc_id": "doc_000005", "sent_id": 9}], "id": "dev_000356", "question": "The 2026-04-06 assignment names Vera Kim; for that same project, what GPU block did Node Birch-04 supply on 2026-05-23?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000405", "sent_id": 6}, {"doc_id": "doc_000007", "sent_id": 2}], "id": "dev_000357", "question": "Identify the project from Priya Vale's 2026-06-29 staffing entry, then read the Node Fir-10 allocation on 2026-04-18; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Dr. Jonas Rios"], "evidence": [{"doc_id": "doc_000251", "sent_id": 4}, {"doc_id": "doc_000251", "sent_id": 5}], "id": "dev_000358", "question": "The 2026-05-24 entry lists a lead for Project Sonata; who is it?", "reasoning_type": "single_hop"}
{"answers": ["Petra Adler"], "evidence": [{"doc_id": "doc_000202", "sent_id": 7}, {"doc_id": "doc_000202", "sent_id": 8}], "id": "dev_000359", "question": "Project Saffron's 2026-04-28 personnel update points to which person for the data steward?", "reasoning_type": "single_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000097", "sent_id": 7}, {"doc_id": "doc_000097", "sent_id": 8}, {"doc_id": "doc_000007", "sent_id": 2}], "id": "dev_000360", "question": "Identify the project from Petra Gray's 2026-06-09 staffing entry, then read the Node Fir-10 allocation on 2026-04-18; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Helix-7B"], "evidence": [{"doc_id": "doc_000224", "sent_id": 6}, {"doc_id": "doc_000151", "sent_id": 2}], "id": "dev_000361", "question": "Which model wins the evidence F1 comparison between Project Sonata's Quartz-3B run and Project Aster's Helix-7B run?", "reasoning_type": "numeric_comparison"}
{"answers": ["reranking"], "evidence": [{"doc_id": "doc_000280", "sent_id": 2}], "id": "dev_000362", "question": "The 2026-04-15 selection note ties Vela-8B to what purpose for Project Sonata?", "reasoning_type": "single_hop"}
{"answers": ["Aster-8B"], "evidence": [{"doc_id": "doc_000059", "sent_id": 2}, {"doc_id": "doc_000059", "sent_id": 3}, {"doc_id": "doc_000220", "sent_id": 2}], "id": "dev_000363", "question": "Reading both result notes, which model has the larger evidence F1: Nova-8B from Project Nereid or Aster-8B from Project Sonata?", "reasoning_type": "numeric_comparison"}
{"answers": ["Atlas-8B"], "evidence": [{"doc_id": "doc_000185", "sent_id": 6}, {"doc_id": "doc_000185", "sent_id": 7}, {"doc_id": "doc_000007", "sent_id": 4}], "id": "dev_000364", "question": "Use the staffing clue for Nora Sol on 2026-06-22 to find the project. What model did it pick for evidence retrieval on 2026-04-16?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["metric smoothing"], "evidence": [{"doc_id": "doc_000402", "sent_id": 5}], "id": "dev_000365", "question": "Project Sonata's 2026-05-21 note retired an older method; what replaced it?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000343", "sent_id": 2}, {"doc_id": "doc_000013", "sent_id": 9}], "id": "dev_000366", "question": "Using Leo Hale's data steward assignment as the bridge, how many GPUs did Node Spruce-03 allocate on 2026-05-09?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000293", "sent_id": 2}], "id": "dev_000367", "question": "Project Meridian's compute allocation on 2026-04-01 links Node Hazel-14 to how many GPUs?", "reasoning_type": "single_hop"}
{"answers": ["Rowan-09"], "evidence": [{"doc_id": "doc_000288", "sent_id": 5}], "id": "dev_000368", "question": "The 2026-04-15 allocation for Project Aster lists 3 GPUs; which node supplied them?", "reasoning_type": "single_hop"}
{"answers": ["Project Anchor"], "evidence": [{"doc_id": "doc_000098", "sent_id": 7}, {"doc_id": "doc_000098", "sent_id": 8}, {"doc_id": "doc_000286", "sent_id": 6}], "id": "dev_000369", "question": "The two runs use River-7B and Kestrel-7B; which project has the larger latency efficiency score value?", "reasoning_type": "numeric_comparison"}
{"answers": ["Marble-3B"], "evidence": [{"doc_id": "doc_000234", "sent_id": 2}, {"doc_id": "doc_000003", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 7}], "id": "dev_000370", "question": "First identify the project from Dr. Theo Lind's 2026-04-14 assignment as the evaluation owner; which model did that project choose for error analysis on 2026-04-12?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["River-8B"], "evidence": [{"doc_id": "doc_000145", "sent_id": 3}, {"doc_id": "doc_000085", "sent_id": 2}], "id": "dev_000371", "question": "Two macro F1 entries are relevant: River-8B on RiverBench for Project Aster, and Nimbus-8B on TraceEval-2 for Project Nereid. Which model is higher?", "reasoning_type": "numeric_comparison"}
{"answers": ["Cedar-8B"], "evidence": [{"doc_id": "doc_000383", "sent_id": 5}, {"doc_id": "doc_000016", "sent_id": 3}, {"doc_id": "doc_000016", "sent_id": 4}], "id": "dev_000372", "question": "The 2026-05-04 assignment names Dr. Julian Gray as lead; for that project, which error analysis model appears on 2026-05-06?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["the lead"], "evidence": [{"doc_id": "doc_000100", "sent_id": 2}, {"doc_id": "doc_000100", "sent_id": 3}], "id": "dev_000373", "question": "In Project Aster's 2026-04-27 staffing entry, what duties were assigned to Mina Shah?", "reasoning_type": "single_hop"}
{"answers": ["Kestrel-3B"], "evidence": [{"doc_id": "doc_000235", "sent_id": 6}, {"doc_id": "doc_000235", "sent_id": 7}], "id": "dev_000374", "question": "The 2026-04-23 failure note ties an unstable-validation-loss error on Node Birch-04 to which Project Nereid model?", "reasoning_type": "single_hop"}
{"answers": ["Marble-7B"], "evidence": [{"doc_id": "doc_000239", "sent_id": 9}, {"doc_id": "doc_000002", "sent_id": 5}], "id": "dev_000375", "question": "The 2026-06-02 assignment names Dr. Jonas Rios as lead; for that project, which error analysis model appears on 2026-04-22?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["2026-05-21"], "evidence": [{"doc_id": "doc_000103", "sent_id": 7}, {"doc_id": "doc_000103", "sent_id": 8}], "id": "dev_000376", "question": "After Project Meridian revised Milestone D1 on 2026-05-05, what date became the deadline?", "reasoning_type": "single_hop"}
{"answers": ["0.851"], "evidence": [{"doc_id": "doc_000398", "sent_id": 9}], "id": "dev_000377", "question": "Project Anchor's 2026-04-21 result put Finch-8B on VestaLogs; what latency efficiency score was reported?", "reasoning_type": "single_hop"}
{"answers": ["2026-06-14"], "evidence": [{"doc_id": "doc_000231", "sent_id": 8}, {"doc_id": "doc_000231", "sent_id": 9}], "id": "dev_000378", "question": "Which deadline replaced the old one for Project Nereid's Milestone J1 on 2026-05-11?", "reasoning_type": "single_hop"}
{"answers": ["4"], "evidence": [{"doc_id": "doc_000251", "sent_id": 12}, {"doc_id": "doc_000007", "sent_id": 2}], "id": "dev_000379", "question": "The 2026-06-30 assignment names Lena Sol; for that same project, what GPU block did Node Fir-10 supply on 2026-04-18?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Kestrel-8B"], "evidence": [{"doc_id": "doc_000172", "sent_id": 7}, {"doc_id": "doc_000342", "sent_id": 6}], "id": "dev_000380", "question": "Which model wins the latency efficiency score comparison between Project Meridian's Kestrel-8B run and Project Saffron's Vela-8B run?", "reasoning_type": "numeric_comparison"}
{"answers": ["Mira-7B"], "evidence": [{"doc_id": "doc_000268", "sent_id": 7}, {"doc_id": "doc_000268", "sent_id": 8}, {"doc_id": "doc_000004", "sent_id": 4}], "id": "dev_000381", "question": "First identify the project from Dr. Jonas Nolan's 2026-06-01 assignment as the retrieval owner; which model did that project choose for calibration on 2026-06-24?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Kestrel-3B"], "evidence": [{"doc_id": "doc_000110", "sent_id": 2}, {"doc_id": "doc_000364", "sent_id": 12}], "id": "dev_000382", "question": "Two latency efficiency score entries are relevant: Kestrel-3B on CedarQA for Project Meridian, and Vela-3B on LumenFacts-3 for Project Saffron. Which model is higher?", "reasoning_type": "numeric_comparison"}
{"answers": ["Marble-7B"], "evidence": [{"doc_id": "doc_000361", "sent_id": 4}, {"doc_id": "doc_000002", "sent_id": 5}], "id": "dev_000383", "question": "Use the staffing clue for Mara Quinn on 2026-04-13 to find the project. What model did it pick for error analysis on 2026-04-22?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Atlas-3B"], "evidence": [{"doc_id": "doc_000230", "sent_id": 2}, {"doc_id": "doc_000005", "sent_id": 6}], "id": "dev_000384", "question": "First identify the project from Mira Nolan's 2026-06-08 assignment as the evaluation owner; which model did that project choose for evidence retrieval on 2026-06-19?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["River-3B"], "evidence": [{"doc_id": "doc_000362", "sent_id": 4}, {"doc_id": "doc_000001", "sent_id": 11}], "id": "dev_000385", "question": "The 2026-05-05 assignment names Mina Shah as lead; for that project, which evidence retrieval model appears on 2026-06-07?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Nimbus-7B"], "evidence": [{"doc_id": "doc_000189", "sent_id": 13}, {"doc_id": "doc_000189", "sent_id": 14}, {"doc_id": "doc_000229", "sent_id": 7}], "id": "dev_000386", "question": "Reading both result notes, which model has the larger latency efficiency score: Marble-7B from Project Saffron or Nimbus-7B from Project Meridian?", "reasoning_type": "numeric_comparison"}
{"answers": ["2026-07-06"], "evidence": [{"doc_id": "doc_000192", "sent_id": 2}], "id": "dev_000387", "question": "In the 2026-06-17 schedule revision, which earlier date did Project Aster replace for Milestone H1?", "reasoning_type": "single_hop"}
{"answers": ["Elm-08"], "evidence": [{"doc_id": "doc_000312", "sent_id": 10}], "id": "dev_000388", "question": "The 2026-04-17 allocation for Project Meridian lists 4 GPUs; which node supplied them?", "reasoning_type": "single_hop"}
{"answers": ["threshold search"], "evidence": [{"doc_id": "doc_000163", "sent_id": 2}], "id": "dev_000389", "question": "Which method became the replacement in Project Saffron's 2026-04-16 update?", "reasoning_type": "single_hop"}
{"answers": ["Marble-3B"], "evidence": [{"doc_id": "doc_000071", "sent_id": 8}, {"doc_id": "doc_000003", "sent_id": 6}, {"doc_id": "doc_000003", "sent_id": 7}], "id": "dev_000390", "question": "First identify the project from Lena Costa's 2026-05-19 assignment as the data steward; which model did that project choose for error analysis on 2026-04-12?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["the data steward"], "evidence": [{"doc_id": "doc_000393", "sent_id": 4}], "id": "dev_000391", "question": "What responsibility label did Project Anchor give Dr. Arun Kwan in the 2026-06-08 entry?", "reasoning_type": "single_hop"}
{"answers": ["the retrieval owner"], "evidence": [{"doc_id": "doc_000040", "sent_id": 4}, {"doc_id": "doc_000040", "sent_id": 5}], "id": "dev_000392", "question": "In Project Sonata's 2026-05-19 staffing entry, what duties were assigned to Samir Kwan?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000002", "sent_id": 4}], "id": "dev_000393", "question": "The 2026-06-27 allocation note says Node Birch-04 supplied Project Meridian with what GPU count?", "reasoning_type": "single_hop"}
{"answers": ["the evaluation owner"], "evidence": [{"doc_id": "doc_000091", "sent_id": 5}, {"doc_id": "doc_000091", "sent_id": 6}], "id": "dev_000394", "question": "What responsibility label did Project Meridian give Elian Ames in the 2026-06-16 entry?", "reasoning_type": "single_hop"}
{"answers": ["0.658"], "evidence": [{"doc_id": "doc_000297", "sent_id": 5}, {"doc_id": "doc_000297", "sent_id": 6}], "id": "dev_000395", "question": "In the 2026-04-18 result note, what macro F1 did Mira-3B produce for Project Sonata on TraceEval-3?", "reasoning_type": "single_hop"}
{"answers": ["2"], "evidence": [{"doc_id": "doc_000311", "sent_id": 5}, {"doc_id": "doc_000007", "sent_id": 5}], "id": "dev_000396", "question": "Identify the project from Iris Lane's 2026-04-14 staffing entry, then read the Node Rowan-09 allocation on 2026-04-11; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["late interaction"], "evidence": [{"doc_id": "doc_000297", "sent_id": 7}], "id": "dev_000397", "question": "Which method became the replacement in Project Meridian's 2026-04-09 update?", "reasoning_type": "single_hop"}
{"answers": ["3"], "evidence": [{"doc_id": "doc_000017", "sent_id": 3}, {"doc_id": "doc_000021", "sent_id": 2}], "id": "dev_000398", "question": "Identify the project from Samir Ames's 2026-06-08 staffing entry, then read the Node Fir-10 allocation on 2026-05-13; how many GPUs was it?", "reasoning_type": "bridge_multi_hop"}
{"answers": ["Felix Lind"], "evidence": [{"doc_id": "doc_000395", "sent_id": 2}], "id": "dev_000399", "question": "In the 2026-04-05 staffing note for Project Aster, who took lead duties?", "reasoning_type": "single_hop"}
{"answers": ["0.857"], "evidence": [{"doc_id": "doc_000229", "sent_id": 3}], "id": "dev_000400", "question": "Which latency efficiency score value is attached to the 2026-04-25 Helix-7B run on CedarQA-3 for Project Anchor?", "reasoning_type": "single_hop"}