Web Archive's 'No-Index' Tag Proliferation
Tracking the growing use of 'no-index' tags that hide web pages from archives.
This subject is not publishing figures yet — its collector is still being built.
No figures yet
This subject has been created but its first collection run hasn't produced data yet.
About this data
This page measures the increasing prevalence of 'no-index' directives within web archives. These tags instruct archival tools, like the Wayback Machine, to omit specific pages from their collections. By monitoring this trend, we gain insight into what content publishers deem less important for preservation.
This metric highlights a potential shift in how the web is being documented and accessed. It could reflect evolving attitudes towards digital privacy, proprietary content, or a deliberate effort by some entities to limit the public record. As no aggregated metrics for this specific phenomenon exist elsewhere, this offers a unique perspective on the changing landscape of web archiving.
Why this isn't published anywhere else
While many sources explain what 'no-index' tags are and how they affect search engine indexing, none of the search results indicate an existing, aggregated metric or tracker specifically focused on the proliferation of 'no-index' tags as a directive for web archiving tools like the Wayback Machine.
Uniqueness score 0.80 — assessed against live web search results when this subject was created.