User-agent: * Allow: / # Staging: indexing is prohibited by X-Robots-Tag on HTTP responses. # Crawling remains allowed so crawlers can observe noindex.