Big news от Cloudflare: запустили систему Pay Per Crawl! Теперь владельцы сайтов могут взимать плату с AI-компаний за сканирование и использование их контента. 💥 Это ответ на массовый парсинг данных для обучения нейросетей — издатели наконец получат доход со своего контента. 💸 Как это работает? Подключаете функцию в настройках Cloudflare, выставляете цену за запрос, а ИИ-гиганты платят за доступ. Особенно актуально для СМИ и образовательных ресурсов. Уже тестируется с партнёрами — готовьте кошельки, OpenAI и Co! 🔥 #Cloudflare #AI #монетизация
178245910 story Cloudflare Flips AI Scraping Model With Pay-Per-Crawl System For Publishers (cloudflare.com) 13 Posted by
msmashon Tuesday July 01, 2025 @02:00PM from the AI-toll-booth dept. Cloudflare today announced a » Pay Per Crawl » program that allows website owners to charge AI companies for accessing their content, a potential revenue stream for publishers whose work is increasingly being scraped to train AI models. The system uses HTTP response code 402 to enable content creators to set per-request prices across their sites. Publishers can choose to allow free access, require payment at a configured rate, or block crawlers entirely. When an AI crawler requests paid content, it either presents payment intent via request headers for successful access or receives a «402 Payment Required» response with pricing information. Cloudflare acts as the merchant of record and handles the underlying technical infrastructure. The company aggregates billing events, charges crawlers, and distributes earnings to publishers. Alongside Pay Per Crawl, Cloudflare has switched to blocking AI crawlers by default for its customers, becoming the first major internet infrastructure provider to require explicit permission for AI access. The company handles traffic for 20% of the web and more than one million customers have already activated its AI-blocking tools since their September 2024 launch, it wrote in a blog post. ← You may like to read: → AI Arms Race Drives Engineer Pay To More Than $10 Million EVs Are Just Going To Win Are EV ‘Charger Hogs’ Ruining the EV Experience? What’s Holding Back America’s Move to Electric Cars? Speed Limiters Now Mandatory In All New EU Cars Far-Right ‘Terrorgram’ Chatrooms Are Fueling a Wave of Power Grid Attacks AI is Now Screening Job Candidates Before Humans Ever See Them
