Popular repositories Loading

1. webdataset webdataset Public

   A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

   Python 3.1k 231

2. tarp tarp Public

   Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.

   Go 138 15

3. WebDataset.jl WebDataset.jl Public

   A high performance I/O library for deep learning in Julia, based on the PyTorch WebDataset library

   Julia 15

4. wids wids Public

   Python 2 1

5. wdsconversions wdsconversions Public

   conversions of standard pytorch datasets to webdataset format

   Jupyter Notebook 1