Skip to Content
GlossaryPPay Per Crawl

Pay Per Crawl

A monetization model charging for each instance of web crawling or data access.

What is Pay Per Crawl?

Pay Per Crawl is a Cloudflare initiative allowing websites to charge crawlers or bots for accessing content using the x402 protocol. Instead of blanket access or subscriptions, crawlers pay a small fee per page or resource accessed, with payments aggregated and settled daily via traditional methods or stablecoins. This model, currently in private beta, supports use cases like auditing large datasets or enabling bots to access premium content, with a proposed deferred payment scheme for flexible settlement.

Last updated on