# robots.txt — AI-access terms for this site (Customer Zero demo) # # This site is written by a human and read by both humans and agents. # It states its terms up front instead of blocking on sight. # # Terms for automated / AI clients: # - Crawling for indexing that sends readers back here: welcome, no charge. # - Extract-and-leave reads (agents that consume content without returning # a visitor): allowed on the free articles; the /premium/ path is paid. # - Please identify yourself with a real User-Agent and a contact. # - Be polite: max ~1 request/second. Back off on 429/402. # - The /premium/ path is metered. In this demo it answers HTTP 402 # (Payment Required) to unpaid clients — pay-per-use, not a flat toll. # Human search crawlers — full access, please send readers back. User-agent: * Allow: / Disallow: /premium/ # Premium content is paid access, not blocked. # Unpaid requests to /premium/ receive HTTP 402 (Payment Required).