{"id":44,"date":"2026-11-19T03:39:48","date_gmt":"2026-11-19T03:39:48","guid":{"rendered":"https:\/\/globalcorpora.com\/blog\/training-data-documentation-datasheets-provenance\/"},"modified":"2026-11-19T03:39:48","modified_gmt":"2026-11-19T03:39:48","slug":"training-data-documentation-datasheets-provenance","status":"publish","type":"post","link":"https:\/\/globalcorpora.com\/blog\/training-data-documentation-datasheets-provenance\/","title":{"rendered":"Dataset Documentation: Datasheets, Cards and Provenance"},"content":{"rendered":"<p>Most training sets ship with a README written the week before release. A year later nobody can say which license each sample had, when it was fetched or whether its source has since opted out. This guide is a working approach to dataset documentation for ML training data. It covers the established frameworks (Datasheets, Data Cards, Hugging Face dataset cards, Croissant), the per-sample provenance fields that make them possible to fill in, the manifests that tie documentation to actual bytes, and how all of this feeds the EU AI Act's training-content summary.<\/p>\n<h2>TL;DR<\/h2>\n<ul>\n<li><strong>Documentation has two layers.<\/strong> A human-readable card (Datasheet, Data Card or dataset card) answers why, how and with what caveats. Machine-readable records (per-sample provenance, manifests, Croissant) back up every claim the card makes.<\/li>\n<li><strong>Record provenance at collection time.<\/strong> Source URL, retrieval time, license as observed, content hash and opt-out status can't be reconstructed reliably afterwards.<\/li>\n<li><strong>Don't trust upstream license labels.<\/strong> The Data Provenance Initiative audit found license omission rates above 70% and error rates above 50% on widely used dataset hosting sites.<\/li>\n<li><strong>Pin documentation to bytes<\/strong> with a sha256 manifest per release, so \"this card describes that data\" can be checked.<\/li>\n<li><strong>The EU AI Act training-content summary<\/strong> for general-purpose AI models must follow the Commission's mandatory template (published 24 July 2025). It's much easier to write from good per-sample records.<\/li>\n<\/ul>\n<h2>The frameworks, and what each is for<\/h2>\n<h3>Datasheets for Datasets<\/h3>\n<p><a href=\"https:\/\/arxiv.org\/abs\/1803.09010\">Datasheets for Datasets<\/a> (Gebru et al., first posted 2018, published in CACM in December 2021) borrows the idea of an electronics datasheet: every dataset should come with a document covering its motivation, composition, collection process, preprocessing\/cleaning\/labeling, uses, distribution and maintenance. The paper's value is its question list. It forces creators to write down things that are obvious to them and invisible to everyone else, such as who funded the collection, what was filtered out, and whether the data relates to people.<\/p>\n<p>A datasheet is prose: the right place for judgments and caveats, the wrong place for facts that should be computed (counts, license distributions, collection windows). Generate those from your records.<\/p>\n<h3>Data Cards<\/h3>\n<p><a href=\"https:\/\/arxiv.org\/abs\/2204.01075\">Data Cards<\/a> (Pushkarna, Zaldivar and Kjartansson, Google Research, FAccT 2022) are structured summaries aimed at different stakeholders across a dataset's lifecycle: upstream sources, collection and annotation methods, intended uses, and decisions that affect model performance. The paper reports lessons from deploying over 20 Data Cards, and Google publishes a <a href=\"https:\/\/sites.research.google\/datacardsplaybook\/\">Data Cards Playbook<\/a> with templates and activities. The lesson: documentation is a product with distinct readers (legal, researchers, downstream teams), so write for each of them.<\/p>\n<h3>Hugging Face dataset cards<\/h3>\n<p>On the Hugging Face Hub, a dataset card is the repository's <code>README.md<\/code>: YAML front matter for machine-readable metadata, followed by a Markdown body. The <a href=\"https:\/\/raw.githubusercontent.com\/huggingface\/hub-docs\/main\/datasetcard.md\">metadata reference<\/a> lists fields including <code>license<\/code> (plus <code>license_name<\/code> and <code>license_link<\/code> when the license is <code>other<\/code>), <code>language<\/code>, <code>pretty_name<\/code>, <code>tags<\/code>, <code>annotations_creators<\/code>, <code>size_categories<\/code>, <code>source_datasets<\/code>, <code>task_categories<\/code>, <code>configs<\/code> and <code>dataset_info<\/code>. There are also gating fields (<code>extra_gated_fields<\/code>, <code>extra_gated_prompt<\/code>). The body follows the <a href=\"https:\/\/github.com\/huggingface\/huggingface_hub\/blob\/main\/src\/huggingface_hub\/templates\/datasetcard_template.md\">dataset card template<\/a>.<\/p>\n<pre><code>---\npretty_name: Example Lecture Video Clips\nlicense: cc-by-4.0\nlanguage:\n- en\n- de\ntags:\n- video\n- audio\nannotations_creators:\n- machine-generated\nsize_categories:\n- 100K&lt;n&lt;1M\nsource_datasets:\n- original\ntask_categories:\n- automatic-speech-recognition\nconfigs:\n- config_name: default\n  data_files:\n  - split: train\n    path: data\/train-*.parquet\n---<\/code><\/pre>\n<p>The YAML <code>license<\/code> is one value for the whole repository. If your samples carry different licenses, say so in the card and put the per-sample license in a column. A single dataset-level tag that hides a mixed collection is exactly the kind of mislabeling discussed below.<\/p>\n<h3>Croissant and the RAI extension<\/h3>\n<p><a href=\"https:\/\/github.com\/mlcommons\/croissant\">Croissant<\/a> is an MLCommons metadata format built on schema.org's Dataset vocabulary and encoded as JSON-LD. It describes four layers: dataset metadata, resources (<code>FileObject<\/code> and <code>FileSet<\/code>, each file with a <code>sha256<\/code>), structure (<code>RecordSet<\/code> and <code>Field<\/code>), and ML semantics. The <a href=\"https:\/\/docs.mlcommons.org\/croissant\/docs\/croissant-spec-1.1.html\">Croissant 1.1 specification<\/a> is dated 2026-01-29. Its introduction says it adds machine-readable representations of data provenance and usage conditions, built on the W3C PROV-O and ODRL standards. Hugging Face, Kaggle and OpenML expose Croissant files for hosted datasets; the Hub serves them at <code>https:\/\/huggingface.co\/api\/datasets\/&lt;owner&gt;\/&lt;name&gt;\/croissant<\/code>.<\/p>\n<p>The <a href=\"https:\/\/docs.mlcommons.org\/croissant\/docs\/croissant-rai-spec.html\">Croissant RAI specification<\/a> (version 1.0, published 2024-03-06) adds responsible-AI properties under the <code>rai:<\/code> prefix. They include <code>rai:dataCollection<\/code>, <code>rai:dataCollectionType<\/code> (recommended values include \"Web Scraping\" and \"Web API\"), <code>rai:dataCollectionTimeframe<\/code>, <code>rai:dataPreprocessingProtocol<\/code>, <code>rai:dataLimitations<\/code>, <code>rai:dataBiases<\/code>, <code>rai:personalSensitiveInformation<\/code>, <code>rai:dataUseCases<\/code> and <code>rai:dataReleaseMaintenancePlan<\/code>. A trimmed example:<\/p>\n<pre><code>{\n  \"@context\": {\n    \"@language\": \"en\",\n    \"@vocab\": \"http:\/\/schema.org\/\",\n    \"sc\": \"http:\/\/schema.org\/\",\n    \"cr\": \"http:\/\/mlcommons.org\/croissant\/\",\n    \"rai\": \"http:\/\/mlcommons.org\/croissant\/RAI\/\",\n    \"dct\": \"http:\/\/purl.org\/dc\/terms\/\"\n  },\n  \"@type\": \"sc:Dataset\",\n  \"name\": \"example-lecture-clips\",\n  \"dct:conformsTo\": [\"http:\/\/mlcommons.org\/croissant\/1.1\",\n                     \"http:\/\/mlcommons.org\/croissant\/RAI\/1.0\"],\n  \"description\": \"Speech-heavy lecture clips with captions.\",\n  \"license\": \"https:\/\/creativecommons.org\/licenses\/by\/4.0\/\",\n  \"url\": \"https:\/\/example.com\/datasets\/lecture-clips\",\n  \"version\": \"1.2.0\",\n  \"rai:dataCollectionType\": [\"Web Scraping\"],\n  \"rai:dataCollection\": \"Candidate IDs from channel lists; license checked at discovery and again at download.\",\n  \"rai:dataPreprocessingProtocol\": [\"sha256 exact dedup\", \"near-duplicate removal\", \"scene splitting\"],\n  \"rai:personalSensitiveInformation\": [\"Faces and voices of speakers\"],\n  \"rai:dataLimitations\": [\"Mostly English; captions partly machine-generated.\"],\n  \"distribution\": [{\n    \"@type\": \"cr:FileObject\",\n    \"@id\": \"train-00000.parquet\",\n    \"contentUrl\": \"data\/train-00000.parquet\",\n    \"encodingFormat\": \"application\/x-parquet\",\n    \"sha256\": \"&lt;sha256 of the file&gt;\"\n  }]\n}<\/code><\/pre>\n<p>This example is illustrative and incomplete: a valid file also needs a <code>recordSet<\/code>, plus <code>creator<\/code> and <code>datePublished<\/code> (required in 1.1). Start from the repository's examples and validate with <code>mlcroissant<\/code> rather than hand-writing it.<\/p>\n<h3>Which one should you use?<\/h3>\n<table>\n<thead>\n<tr>\n<th>Format<\/th>\n<th>Audience<\/th>\n<th>Machine-readable<\/th>\n<th>Use it for<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Datasheet<\/td>\n<td>People evaluating or auditing the data<\/td>\n<td>No<\/td>\n<td>Motivation, process, caveats, maintenance<\/td>\n<\/tr>\n<tr>\n<td>Data Card<\/td>\n<td>Multiple stakeholder groups<\/td>\n<td>Mostly no<\/td>\n<td>Structured summaries per audience<\/td>\n<\/tr>\n<tr>\n<td>HF dataset card<\/td>\n<td>Hub users, loaders<\/td>\n<td>YAML header<\/td>\n<td>Publishing on the Hub; config and split definitions<\/td>\n<\/tr>\n<tr>\n<td>Croissant + RAI<\/td>\n<td>Tools, search engines, loaders<\/td>\n<td>Yes (JSON-LD)<\/td>\n<td>File checksums, record structure, RAI fields<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>They aren't competitors. A practical stack: datasheet answers in the card body, HF YAML if you publish on the Hub, Croissant generated from your manifest, and per-sample records underneath.<\/p>\n<h2>Why upstream labels can't be trusted<\/h2>\n<p>The <a href=\"https:\/\/arxiv.org\/abs\/2310.16787\">Data Provenance Initiative<\/a> (Longpre et al., 2023) audited more than 1,800 text fine-tuning datasets and traced each one's sources, creators and license conditions. It reports frequent license miscategorization on widely used dataset hosting sites, with license omission of 70%+ and error rates of 50%+. Those figures describe text datasets audited in 2023, not video or speech data today. The lesson still carries over: a license tag on an aggregated dataset tells you what the uploader chose, not what the underlying sources permit.<\/p>\n<p>So record the license from the original source, per sample, with evidence, and trace upstream sources of third-party data yourself. See also our <a href=\"https:\/\/globalcorpora.com\/blog\/buying-video-training-data-checklist\/\">checklist for buying video training data<\/a>.<\/p>\n<h2>Per-sample provenance: the fields to record<\/h2>\n<p>Everything in a card should be derivable from per-sample records. These are the fields worth capturing at collection time:<\/p>\n<table>\n<thead>\n<tr>\n<th>Field<\/th>\n<th>Why<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><code>sample_id<\/code><\/td>\n<td>Stable key across releases; derive it from the source ID, not the row order<\/td>\n<\/tr>\n<tr>\n<td><code>source_url<\/code>, <code>source_platform<\/code>, <code>source_id<\/code><\/td>\n<td>Where the bytes came from; needed for attribution and takedowns<\/td>\n<\/tr>\n<tr>\n<td><code>retrieved_at<\/code> (UTC, ISO 8601)<\/td>\n<td>Licenses, availability and opt-outs change; time scopes every other field<\/td>\n<\/tr>\n<tr>\n<td><code>license<\/code> + evidence<\/td>\n<td>The value as observed, where it was read, and when<\/td>\n<\/tr>\n<tr>\n<td><code>sha256<\/code>, <code>bytes<\/code><\/td>\n<td>Ties the record to exact content; enables dedup and integrity checks<\/td>\n<\/tr>\n<tr>\n<td><code>opt_out_status<\/code> + <code>checked_at<\/code><\/td>\n<td>Result of whatever opt-out signals you honor (robots.txt, machine-readable reservations, takedown list)<\/td>\n<\/tr>\n<tr>\n<td><code>collector<\/code><\/td>\n<td>Crawler name\/version and user agent; the EU template asks about crawlers<\/td>\n<\/tr>\n<tr>\n<td><code>parent_id<\/code>, <code>transforms<\/code><\/td>\n<td>Lineage for clips, transcodes and captions derived from a source sample<\/td>\n<\/tr>\n<tr>\n<td><code>pipeline_version<\/code><\/td>\n<td>Which filters and thresholds produced this release<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>One JSONL line per sample:<\/p>\n<pre><code>{\"sample_id\": \"yt:abc123XYZ_-:clip0007\",\n \"source_platform\": \"youtube\", \"source_id\": \"abc123XYZ_-\",\n \"source_url\": \"https:\/\/www.youtube.com\/watch?v=abc123XYZ_-\",\n \"retrieved_at\": \"2026-11-02T08:14:55Z\",\n \"license\": {\"value\": \"creativeCommon\", \"source\": \"videos.list status.license\",\n             \"checked_at\": \"2026-11-02T08:14:51Z\"},\n \"opt_out_status\": {\"value\": \"none_found\", \"checked_at\": \"2026-11-02T08:14:51Z\"},\n \"collector\": \"collector\/3.4.1\",\n \"parent_id\": \"yt:abc123XYZ_-\", \"transforms\": [\"clip 83.4-91.8s\", \"transcode av1\"],\n \"pipeline_version\": \"2026.11-r2\",\n \"bytes\": 2841122,\n \"sha256\": \"9f2c...e1\"}<\/code><\/pre>\n<p>For YouTube specifically, how to read and double-check the license field is covered in <a href=\"https:\/\/globalcorpora.com\/blog\/creative-commons-youtube-videos-for-ai-training\/\">finding and filtering Creative Commons YouTube videos<\/a>. Append new checks instead of overwriting old ones, so you can answer \"what did you know, and when?\"<\/p>\n<h2>Manifests: pinning documentation to bytes<\/h2>\n<p>A card says \"release 1.2.0 contains 412 shards\". A manifest proves it. Write one per release, listing every file with its size and sha256, and store it with the card. Consumers verify on download, and you can show later that the documented release is the one you trained on. The script below writes and verifies a JSONL manifest using only the standard library (Python 3.8+):<\/p>\n<pre><code>#!\/usr\/bin\/env python3\n\"\"\"Write or verify a sha256 manifest for a directory of dataset files.\"\"\"\nimport argparse\nimport hashlib\nimport json\nimport sys\nfrom pathlib import Path\n\n\ndef sha256_file(path, chunk=8 * 1024 * 1024):\n    h = hashlib.sha256()\n    with open(path, \"rb\") as f:\n        while block := f.read(chunk):\n            h.update(block)\n    return h.hexdigest()\n\n\ndef write_manifest(root, out):\n    root, out = Path(root), Path(out).resolve()\n    with open(out, \"w\", encoding=\"utf-8\") as f:\n        for p in sorted(root.rglob(\"*\")):\n            if p.is_file() and p.resolve() != out:\n                rec = {\"path\": p.relative_to(root).as_posix(),\n                       \"bytes\": p.stat().st_size,\n                       \"sha256\": sha256_file(p)}\n                f.write(json.dumps(rec) + \"\\n\")\n\n\ndef verify_manifest(root, manifest):\n    root, bad = Path(root), 0\n    with open(manifest, encoding=\"utf-8\") as f:\n        for line in f:\n            rec = json.loads(line)\n            p = root \/ rec[\"path\"]\n            if not p.is_file():\n                print(\"MISSING \", rec[\"path\"])\n                bad += 1\n            elif p.stat().st_size != rec[\"bytes\"] or sha256_file(p) != rec[\"sha256\"]:\n                print(\"MISMATCH\", rec[\"path\"])\n                bad += 1\n    return bad\n\n\nif __name__ == \"__main__\":\n    ap = argparse.ArgumentParser()\n    ap.add_argument(\"mode\", choices=[\"write\", \"verify\"])\n    ap.add_argument(\"root\")\n    ap.add_argument(\"manifest\")\n    a = ap.parse_args()\n    if a.mode == \"write\":\n        write_manifest(a.root, a.manifest)\n    else:\n        sys.exit(1 if verify_manifest(a.root, a.manifest) else 0)<\/code><\/pre>\n<p>Usage: <code>python manifest.py write release-1.2.0\/ manifest-1.2.0.jsonl<\/code>, then <code>python manifest.py verify release-1.2.0\/ manifest-1.2.0.jsonl<\/code>. Hash the manifest itself and put that one hash in the card and the Croissant file. The shard-level layout this assumes is covered in <a href=\"https:\/\/globalcorpora.com\/blog\/storing-video-datasets-webdataset-parquet-shards\/\">storing video datasets as WebDataset and Parquet shards<\/a>. If you exclude benchmark data, record the exclusion list's hash too (see <a href=\"https:\/\/globalcorpora.com\/blog\/benchmark-decontamination-llm-training-data\/\">benchmark decontamination<\/a>).<\/p>\n<h2>The EU AI Act training-content summary<\/h2>\n<p>Article 53(1)(d) of the <a href=\"https:\/\/eur-lex.europa.eu\/eli\/reg\/2024\/1689\/oj\/eng\">AI Act<\/a> requires providers of general-purpose AI models to publish a sufficiently detailed summary of the content used for training, following a template from the AI Office. The Commission published the <a href=\"https:\/\/digital-strategy.ec.europa.eu\/en\/library\/explanatory-notice-and-template-public-summary-training-content-general-purpose-ai-models\">Explanatory Notice and Template<\/a> on 24 July 2025. According to the Commission's <a href=\"https:\/\/digital-strategy.ec.europa.eu\/en\/faqs\/template-general-purpose-ai-model-providers-summarise-their-training-content\">Q&amp;A<\/a> (last updated 26 March 2026):<\/p>\n<ul>\n<li>Using the template is mandatory. The obligation applies from 2 August 2025, including to models released under free and open-source licenses.<\/li>\n<li>Models placed on the market before that date have until 2 August 2027. Information that is unavailable, or disproportionately burdensome to retrieve, must be stated and justified as a gap.<\/li>\n<li>The template has three sections: general information (including modalities and size per modality within broad ranges), a list of data sources (public datasets, private datasets, scraped data, user data, synthetic data), and relevant data processing aspects (such as copyright-related measures and removal of illegal content).<\/li>\n<li>For scraped data, it asks for crawler names, the collection period, a description of the content, and the top 10% of scraped domains (for SMEs, the top 5% or 1,000 domains, whichever is lower).<\/li>\n<li>Summaries are updated every six months, or sooner after a materially significant change in training data. The AI Office can enforce from 2 August 2026.<\/li>\n<\/ul>\n<p>Whether you count as a provider, how fine-tuning changes that, and how your model relates to these dates are legal questions. The Commission has separate <a href=\"https:\/\/digital-strategy.ec.europa.eu\/en\/policies\/guidelines-gpai-providers\">guidelines on GPAI providers<\/a> on that. Have counsel read the template itself; this list summarizes the Q&amp;A, not the full Explanatory Notice.<\/p>\n<p>From an engineering view, with the per-sample records above the summary becomes a query rather than an archaeology project:<\/p>\n<pre><code>import json\nimport math\nimport sys\nfrom collections import Counter\nfrom urllib.parse import urlsplit\n\nREQUIRED = [\"source_url\", \"retrieved_at\", \"license\", \"sha256\", \"opt_out_status\"]\nlicenses, bytes_by_domain, missing = Counter(), Counter(), Counter()\nfirst = last = None\n\nwith open(sys.argv[1], encoding=\"utf-8\") as f:\n    for line in f:\n        r = json.loads(line)\n        missing.update(k for k in REQUIRED if not r.get(k))\n        lic = r.get(\"license\") or {}\n        licenses[lic.get(\"value\", \"UNKNOWN\") if isinstance(lic, dict) else lic] += 1\n        host = urlsplit(r.get(\"source_url\", \"\")).hostname or \"UNKNOWN\"\n        bytes_by_domain[host] += r.get(\"bytes\", 0)\n        t = r.get(\"retrieved_at\")\n        if t:  # ISO 8601 UTC strings sort chronologically\n            first = t if first is None or t &lt; first else first\n            last = t if last is None or t &gt; last else last\n\nk = max(1, math.ceil(len(bytes_by_domain) * 0.10))\nprint(\"collection window:\", first, \"to\", last)\nprint(\"licenses:\", dict(licenses))\nprint(\"records missing fields:\", dict(missing))\nprint(f\"top {k} of {len(bytes_by_domain)} domains by bytes:\")\nfor host, b in bytes_by_domain.most_common(k):\n    print(f\"  {host}\\t{b}\")<\/code><\/pre>\n<p>Ranking domains by bytes is an assumption here. Check the Explanatory Notice for the measure it actually specifies. For a single-platform video set the domain list is trivially short. The parts that take work are the collection period, the crawler description and the processing measures, and those come straight from <code>retrieved_at<\/code>, <code>collector<\/code> and <code>pipeline_version<\/code>.<\/p>\n<h2>A release checklist<\/h2>\n<ol>\n<li>Freeze shards plus the per-sample table.<\/li>\n<li>Fail the release if any record lacks a required provenance field.<\/li>\n<li>Apply the current takedown\/opt-out list; record its hash.<\/li>\n<li>Write and hash the manifest.<\/li>\n<li>Generate the card's numbers from the table; update the prose by hand.<\/li>\n<li>Emit and validate HF YAML and\/or Croissant; add a changelog entry.<\/li>\n<\/ol>\n<h2>Compliance note<\/h2>\n<p>Documentation records what you did; it doesn't make it permissible. If your data comes from YouTube, its Terms of Service restrict automated access and downloading. Copyright and licensing apply, and filtering for Creative Commons narrows the problem rather than settling it. Faces and voices can be personal data under GDPR. Honoring takedown and opt-out requests requires the per-sample lineage described above. None of this is legal advice: get legal review for your jurisdiction and use case, including whether and how the AI Act applies to you.<\/p>\n<h2>If you'd rather not build the collection side<\/h2>\n<p>Corpora's managed service collects YouTube video, audio, subtitles and metadata and delivers them as JSONL or Parquet with sha256 checksums and manifests to your S3, GCS or Azure bucket. You still write the card, but the provenance and integrity inputs arrive with the data. A free sample batch is available through <a href=\"https:\/\/globalcorpora.com\/#contact\">our contact page<\/a>.<\/p>\n<h2>FAQ<\/h2>\n<h3>What is dataset documentation in machine learning?<\/h3>\n<p>A human-readable description of why and how a dataset was built, what it contains and what it shouldn't be used for, backed by machine-readable metadata: per-sample provenance, file manifests and formats such as Croissant or Hugging Face card YAML.<\/p>\n<h3>Does Croissant replace a dataset card?<\/h3>\n<p>No. Croissant makes metadata, file checksums and record structure machine-readable, and its RAI extension adds fields for collection, limitations and sensitive information. The narrative still belongs in a card. Hugging Face exposes both for Hub datasets.<\/p>\n<h3>What provenance should I store for each training sample?<\/h3>\n<p>At minimum: source URL and ID, retrieval time in UTC, license as observed with where and when it was read, sha256 and size, opt-out check result with timestamp, the collector, and lineage for derived clips.<\/p>\n<h3>When does the EU AI Act training data summary apply?<\/h3>\n<p>Per the Commission's Q&amp;A, from 2 August 2025 for general-purpose AI models placed on the EU market, with a deadline of 2 August 2027 for models already on the market before then, and AI Office enforcement from 2 August 2026. Confirm how it applies to you with counsel.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Practical dataset documentation for ML training data: datasheets, data cards, Croissant, per-sample provenance, manifests and the EU AI Act summary.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[126,124,123,125,127,128],"class_list":["post-44","post","type-post","status-publish","format-standard","hentry","category-datasets","tag-croissant","tag-data-provenance","tag-dataset-documentation","tag-datasheets-for-datasets","tag-eu-ai-act","tag-training-data"],"_links":{"self":[{"href":"https:\/\/globalcorpora.com\/blog\/wp-json\/wp\/v2\/posts\/44","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/globalcorpora.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/globalcorpora.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/globalcorpora.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/globalcorpora.com\/blog\/wp-json\/wp\/v2\/comments?post=44"}],"version-history":[{"count":0,"href":"https:\/\/globalcorpora.com\/blog\/wp-json\/wp\/v2\/posts\/44\/revisions"}],"wp:attachment":[{"href":"https:\/\/globalcorpora.com\/blog\/wp-json\/wp\/v2\/media?parent=44"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/globalcorpora.com\/blog\/wp-json\/wp\/v2\/categories?post=44"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/globalcorpora.com\/blog\/wp-json\/wp\/v2\/tags?post=44"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}