Data

Dataset Files

File name: train.jsonl
question: The question to answer
id: The question ID
reasoning_type: The reasoning category (single_hop, bridge_multi_hop, numeric_comparison)
evidence: The document and sentence references needed to answer the question, e.g. [{"doc_id": "", "sent_id": 1}]
answers: The gold answer label(s)

Corpus rows contain a document ID, metadata, and sentence objects with stable sentence IDs.

RAG-QA test rows should contain question inputs and stable IDs. The server validates submissions against the organizer test IDs.

{"doc_id":"doc_000001","sentences":[{"sent_id":1,"text":"..."}]}

{"id":"test_000001","question":"..."}

Submit exactly one JSONL prediction for every row in test.jsonl.

Each prediction must contain exactly id, answer, and evidence fields.

{"id":"test_000001","answer":"2","evidence":[{"doc_id":"doc_000050","sent_id":2}]}

{"doc_id":"doc_000001","sent_id":1}