Covers fixtures, retrieval and answer metrics, monitoring, freshness checks, debugging, and recovery for web crawling. This reference fixes the adoption boundary, failure behavior, and observable evidence while leaving environment-specific limits configurable.