CatalogWantedMirrorsLedgerOperating StatementDocsStudio statusCard system
alt.freeweights.datasets / fineweb-edu
From: HuggingFaceFW <huggingface.co/HuggingFaceFW>Newsgroups: alt.freeweights.datasetsSubject:

fineweb-edu

Date: 2026-11-14Commit: 87f0914Signed: 2DC28CC7B26A283B ✓

Dataset. Parquet files, 28.5 GB in all. Published by HuggingFaceFW under ODC-BY-1.0.

datasets28.5GBfineweb-eduparquetpermissive
FactsRowsnot statedSize28.5 GBFormatparquetLicenseODC-BY-1.0From sourcepermissive
>>> from datasets import load_dataset
>>> ds = load_dataset("HuggingFaceFW/fineweb-edu")
# with HF_ENDPOINT=https://freeweights.allternit.com · manifest sha256 17418e09123c…
From sourceHuggingFaceFW/fineweb-eduLast check: 2026-11-14 14:45 UTC
OverviewFilesUse itLicenseProvenance

Overview

Size
28.5 GB
Weights
dataset
Parameters
not stated
Formats
parquet
Task
text generation
License
ODC-BY-1.0 (permissive)
Files
15, each with a sha256
Publisher
HuggingFaceFW
Added
2026-11-14
Section
alt.freeweights.datasets
Lineage

Original release from the publisher.

Where these bytes come from
Publisher at the pinned commit→You

Sources are tried in order. A file counts only when its size and sha256 match the manifest. Sources are checked when you ask for them, not on a timer.

Sources
BadgeHostLast checkResult
From sourcehuggingface.co2026-11-14 14:45 UTCpassed

Files

15 files · 28.5 GB Sizes and sha256 from the signed manifest.
Hide all 15 files with their sha256
FileSizesha256
README.md26.4 KBa0cc8998a20499432b28b6575f3046b714938eb8e11b8d59a1d25ddf3716061e
sample/10BT/000_00000.parquet2.15 GBb1ba7b2ce4cb5ea6ef42dca40263eabb85f37700d01693a68e9b30a31d78e871
sample/10BT/001_00000.parquet2.15 GB3fcf2dc69cd52503986276d3d2d26a8c356d0f2ea28a0de4fdbda8cf87755693
sample/10BT/002_00000.parquet2.15 GB547ae182d132c9f06b6ce63149567208ea9f57630bfd9b1a2938e504f0c9ebd7
sample/10BT/003_00000.parquet2.15 GB22184e6eb25759ddd97783751ffc73e1705dfa2542e630dae1f2a8bac8ee6ddb
sample/10BT/004_00000.parquet2.15 GB33557ddd87a07a4ae6fcaf7a4789c7b484e5cc0c273ca12a65b74200e6d8748b
sample/10BT/005_00000.parquet2.15 GBe08d79927ecb377786572cd854817c748ceb8880878b1a0eb91abf8c85d505ea
sample/10BT/006_00000.parquet2.15 GB554fa2613c9261d6c9c396caab881de3160175794c6c3e1856bf28a0e9cb9b76
sample/10BT/007_00000.parquet2.15 GB4b7d1f697d4afff7f5f65cb7aa4d83acc6db716da4d46ea23399d0c50608c6e3
sample/10BT/008_00000.parquet2.15 GBa6d9dcc0c72ecd7c7f0173c2d06b3a4249a2ccaa94961469d1a522ca689bbf1a
sample/10BT/009_00000.parquet2.15 GBf836cd3c70b95776699eb6c356b2dbf702816e25dcf39992f5c80a29029d23c3
sample/10BT/010_00000.parquet2.15 GBe5a2eae25f057f0856a10bfae314c6ca8ea8bb08456d2131e9e89b2b8305e2f6
sample/10BT/011_00000.parquet2.15 GBdb71cf0425bb3d1813a09f12ff1acd6dabdfb91a2e4f141960254ee5a7f036e7
sample/10BT/012_00000.parquet2.15 GB08b47a3e1c25161f796d2f8dbf99ccf60affdebdcea4910833d0d5783315551f
sample/10BT/013_00000.parquet541 MBb393f51fefab26cd6f4c8f65707c1924f6666c4961a0ebebe04bb57f7ec832de

Use it

>>> from datasets import load_dataset
>>> ds = load_dataset("HuggingFaceFW/fineweb-edu")
# with HF_ENDPOINT=https://freeweights.allternit.com · manifest sha256 17418e09123c…
fw.pyChecks the signature and every sha256, tries each source in order, resumes.
$ python3 fw.py get https://freeweights.allternit.com/manifests/HuggingFaceFW/fineweb-edu.json --dir ./fineweb-edu $ python3 fw.py verify ./fineweb-edu ./HuggingFaceFW__fineweb-edu.json
hfThe Hugging Face CLI with one setting. Same repo id.
$ HF_ENDPOINT=https://freeweights.allternit.com hf download HuggingFaceFW/fineweb-edu --revision 87f09149ef4734204d70ed1d046ddc9ca3f2b8f9 --local-dir ./fineweb-edu
datasetsLoad it with the datasets library.
import os os.environ["HF_ENDPOINT"] = "https://freeweights.allternit.com" from datasets import load_dataset ds = load_dataset("HuggingFaceFW/fineweb-edu", revision="87f09149ef4734204d70ed1d046ddc9ca3f2b8f9")
Run in Allternit Desktopcoming in Phase 1
Fine-tune in Freeweights Studiocoming in Phase 3

License

Name
Open Data Commons Attribution License 1.0
Id
ODC-BY-1.0
Class
Permissive
Redistribution
yes
Text in
README.md
Text sha256
a0cc8998a20499432b28b6575f3046b714938eb8e11b8d59a1d25ddf3716061e
Terms gate
No extra terms beyond the license.

Read the license text

Licenses are checked against the license list. A custom license passes only after a recorded human audit.

Provenance

From: HuggingFaceFW <huggingface.co/HuggingFaceFW>Newsgroups: alt.freeweights.datasetsSubject: fineweb-eduDate: 2026-11-14Commit: 87f0914Signed: 2DC28CC7B26A283B ✓
Upstream
HuggingFaceFW/fineweb-edu
Pinned commit
87f09149ef4734204d70ed1d046ddc9ca3f2b8f9
Manifest
fineweb-edu.json · .minisig
Manifest sha256
17418e09123ccdd64004100cf5bb4e7c7253e044430cde8cd1f46478da621333
Signature
minisign, Ed25519, key 2DC28CC7B26A283B
Created
2026-11-14 14:45 UTC
Generator
freeweights-manifest/0.1.0
Takedowns
None.

How to verify

$ curl -O https://freeweights.allternit.com/manifests/HuggingFaceFW/fineweb-edu.json $ curl -O https://freeweights.allternit.com/manifests/HuggingFaceFW/fineweb-edu.json.minisig $ minisign -Vm fineweb-edu.json -P RWQ7KGqyx4zCLXtUFOqvfv8L3g+8fpKJ1FsuxPyOYMF+4KufbUxKq1Oq $ shasum -a 256 <file> # compare with the Files tab

A manifest whose signature fails must be rejected. A file whose size or sha256 does not match must be discarded. Verify a download

Get it
Download
$ HF_ENDPOINT=https://freeweights.allternit.com hf download HuggingFaceFW/fineweb-edu
Run in Allternit Desktopcoming in Phase 1
Signed manifest
minisign, key 2DC28CC7B26A283B. fineweb-edu.json. Provenance. Takedown history: none.
Source
huggingface.co/datasets/HuggingFaceFW/fineweb-edu

Related models

All of alt.freeweights.datasets →
From: Idavidrein <huggingface.co/Idavidrein>Subject: gpqa
From: openai <huggingface.co/openai>Subject: gsm8k
From: Anthropic <huggingface.co/Anthropic>Subject: hh-rlhf
From: TIGER-Lab <huggingface.co/TIGER-Lab>Subject: MMLU-Pro
From: OpenAssistant <huggingface.co/OpenAssistant>Subject: oasst2
From: openai <huggingface.co/openai>Subject: openai_humaneval