A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
bug fixes in wids
style fixes
bug fixes in wids
numerous updates to WIDS, WIDS caching, etc.
reorganized directories
webdataset, wids, and tests are now top level directories. Installs project as editable in virtual environment.
made debugging output optional in WIDS
testcase fix (testgz.tar)
added decompression to wids