Hugging Face · Datasets
Stream a huge dataset
Iterate without downloading the whole dataset first.
ds = load_dataset("allenai/c4", "en", split="train", streaming=True)
next(iter(ds))
Official Hugging Face documentation
Hugging Face · Datasets
Iterate without downloading the whole dataset first.
ds = load_dataset("allenai/c4", "en", split="train", streaming=True)
next(iter(ds))
Official Hugging Face documentation
Was this page helpful?