About this subject

Web Archive's 'No-Index' Tag Proliferation

This page measures the increasing prevalence of 'no-index' directives within web archives. These tags instruct archival tools, like the Wayback Machine, to omit specific pages from their collections. By monitoring this trend, we gain insight into what content publishers deem less important for preservation.

This metric highlights a potential shift in how the web is being documented and accessed. It could reflect evolving attitudes towards digital privacy, proprietary content, or a deliberate effort by some entities to limit the public record. As no aggregated metrics for this specific phenomenon exist elsewhere, this offers a unique perspective on the changing landscape of web archiving.

Back to the figures