Source Transparency Watch¶
Are the organisations behind global digital-rights data adopting primary-source, open-data transparency — and when did they do it? This page tracks peer sources (the aggregators behind our scorecard indicators, plus related rights and data-transparency bodies) for four signals:
-
Datasets
Machine-readable downloads — CSV / Excel / JSON, "get the data" exports.
-
Document & legal files
Links to the actual primary documents — per-country law texts, document-link manifests.
-
APIs / endpoints
Public APIs or machine-readable data endpoints.
-
Structure / portals
New open-data sections, data portals, and URL/permalink restructures.
First archived appearances
By source
How to read this
Each entry is the first archived appearance of a transparency signal on that source's site — a dated record of when that signal appears in the available captures, drawn from the Internet Archive's capture history. A ★ marks signals that are on-topic for that source (e.g. a data-protection dataset on UNCTAD, rather than an unrelated dashboard).
Archive coverage
A first-seen date is the earliest capture found by this query. The source may have offered the material earlier, and gaps in the archive can leave signals unrecorded. Follow the archived page to examine the evidence. The methodology explains how the watch is generated.
Why this matters¶
Access to source documents and downloadable data makes research easier to examine and reproduce. The watch helps trace those access points over time and identify changes to the portals and URLs used by the pipeline.
Methodology¶
The watch is generated by utils/build_transparency_watch_data.py, which queries the
Internet Archive Wayback CDX API
for each monitored domain, matches captured URLs against transparency-signal patterns
(datasets, document manifests, API paths, open-data sections), filters out analytics/asset
noise, and records the earliest archived appearance of each — preferring on-topic examples.
To refresh it:
This writes docs/transparency-watch/data/transparency.json, which this page renders. Add or adjust monitored sources in the SOURCES list at the top of that script.