Ir Datasets Versions Save

What's Changed

• TREC DL 2023 Topics by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/242
• MS MARCO Passage v2 deduplicated version by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/243
• MIRACL by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/248
• Use provided id_field by @bpiwowar in https://github.com/allenai/ir_datasets/pull/252
• fix: fix the bug of considering the Path as a str when loading from TREC dataset by @yzong12138 in https://github.com/allenai/ir_datasets/pull/247
• fix location of msmarco source files and bump version by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/257

Full Changelog: https://github.com/allenai/ir_datasets/compare/v0.5.5...v0.5.6

What's Changed

• Fix typo by @heinrichreimer in https://github.com/allenai/ir_datasets/pull/212
• Fix and add html extractor by @grodino in https://github.com/allenai/ir_datasets/pull/201
• py310 by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/143
• Remove duplicate bib by @heinrichreimer in https://github.com/allenai/ir_datasets/pull/214
• msmarco-passage/dev/2 by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/220
• Adding the SARA dataset by @JackMcKechnie in https://github.com/allenai/ir_datasets/pull/225
• defaulttext by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/226
• [MINOR:TYPO] Update msmarco-passage.yaml by @cakiki in https://github.com/allenai/ir_datasets/pull/231
• TREC tip-of-the-tongue by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/238
• trec-dl-2022 qrels by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/239

New Contributors

• @JackMcKechnie made their first contribution in https://github.com/allenai/ir_datasets/pull/225

Full Changelog: https://github.com/allenai/ir_datasets/compare/v0.5.4...v0.5.5

What's Changed

• Fix Touché file URLs by @heinrichreimer in https://github.com/allenai/ir_datasets/pull/202
• Remove redundant query arg by @heinrichreimer in https://github.com/allenai/ir_datasets/pull/203
• istella22/source moved by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/204
• Istella22 update links by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/205
• Touché 2022 by @heinrichreimer in https://github.com/allenai/ir_datasets/pull/211

Full Changelog: https://github.com/allenai/ir_datasets/compare/v0.5.3...v0.5.4b

What's Changed

• Add clueweb12 diversity task datasets by @grodino in https://github.com/allenai/ir_datasets/pull/198
• Istella22 by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/199
• trec-dl-2022 topics and scoreddocs by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/200

New Contributors

• @grodino made their first contribution in https://github.com/allenai/ir_datasets/pull/198

Full Changelog: https://github.com/allenai/ir_datasets/compare/v0.5.2...v0.5.3

New Datasets

• TREC Clinical Trials 2022
• TREC Fair Ranking 2022
• CODEC

Features / Bugfixes

• Fix TREC Genomics Track 2005 description
• Allow downloads to resume for all MSMARCO dataset resources larger than 500MB
• For format support for disks45

Full Changelog: https://github.com/allenai/ir_datasets/compare/v0.5.1...v0.5.2

What's Changed

• [MINOR FIX / TYPO] Update trec-robust04.yaml by @cakiki in https://github.com/allenai/ir_datasets/pull/137
• .z compression support for robust04 by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/139
• moving msmarco-passage scoreddocs around by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/142
• mmarco updates (files hosted elsewhere & new version of some sources) by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/145
• new data available for mmarco (scoreddocs, docpairs, and dev/small) by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/146
• added tripclick/train/hofstaetter-triples by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/147
• additional versions of msmarco-passage triples by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/149
• mMARCO v2 by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/150
• Anchor Text for msmarco-document and msmarco-document-v2 by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/155
• mmarco source files renamed by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/153
• TREC CAsT 2019, 2020 by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/156
• HC4 by @eugene-yang in https://github.com/allenai/ir_datasets/pull/158
• LoTTE dataset by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/159
• kilt by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/161
• some trec 2021 qrels released by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/162
• some trec 2021 qrels released by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/171
• CODEC by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/172
• improved HTML/XML parser, TREC 7 and 8 by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/173
• fixed and tested issue affecting some clueweb lookups by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/174
• cache hc4 topics/qrels by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/176
• wikiclir by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/178
• NeuCLIR Collection 1 (documents and HC4-filtered subset) by @eugene-yang in https://github.com/allenai/ir_datasets/pull/179
• neuMARCO by @seanmacavaney in https://github.com/allenai/ir_datasets/pull/181

New Contributors

• @cakiki made their first contribution in https://github.com/allenai/ir_datasets/pull/137
• @eugene-yang made their first contribution in https://github.com/allenai/ir_datasets/pull/158

Full Changelog: https://github.com/allenai/ir_datasets/compare/v0.5.0...v0.5.1

New Features:

• Metadata is included for all datasets, including record counts, without needing to download or process the data.
• New entity type (qlogs) for query log records

New datasets:

• argsme & touche (thanks @heinrichreimer!)
• aol-ia dataset
• tripclick logs
• trec-dl-2021 qrels (active participants only for now)

Miscellaneous:

• No longer updates root logger instance, allowing other applications to easily cusomise logging output from this package
• Updates to documentation

Added:

• trec-fair-2021/eval topics
• clinicaltrials/2021/trec-ct-2021
• c4 and c4/en-noclean-tr/trec-misinfo-2021
• wikir/en78k and wikir/ens78k
• msmarco-passage-v2/trec-dl-2021 and msmarco-document-v2/trec-dl-2021
• mr-tydi
• mmarco

Misc:

• some minor changes to clean command
• msmarco-passage-v2 lookups now performed by ID instead of lz4
• file linking info not shown when downloading small files
• fixed cord19/fulltext
• other minor fixes

Adds the following datasets:

• MS MARCO Passage version 2
• TREC Fair Ranking 2021

A few other minor improvements:

• Progress bars: units + totals in a few more places
• Checks for adequate disk space before big downloads (can be disabled with an environment variable)