Cloudflare launched Pay per Crawl: AI bots will pay for scanning sites
Cloudflare company launched a very interesting service! It allows website owners to charge AI bots money for data collection! The service is called Pay per Crawl and is currently running in closed beta version.
It’s important to understand the scale. Cloudflare serves 20% of the entire internet. And through this platform, website owners will be able to choose. Whether to allow AI bots to scan their content for free, block them completely, or charge micropayments for each scan.
The service makes it clear what exactly bots are collecting information for. For training AI models, for appearing in chatbot responses, or for other purposes.
Major publications have already joined the initiative – Conde Nast, TIME, Associated Press and others. They will block AI bots by default.
Statistics from Cloudflare show a curious picture. Google search engine scans sites 14 times for each received transition. And OpenAI’s bot – 17,000 times for 1 transition, and Anthropic – 73,000 times!
Autor: AIvengo
For 5 years I have been working with machine learning and artificial intelligence. And this field never ceases to amaze, inspire and interest me.
Latest News
Nvidia head believes there is no AI bubbleNvidia founder Jensen Huang dispelled concerns about a bubble in the AI market. And according to him, the company's latest chips are expected to bring 0.5 trillion dollars in revenue.
OpenAI promises to create full-fledged AI scientist by 2028OpenAI promised to create a full-fledged AI-based scientist by 2028. Company CEO Sam Altman also stated that deep learning systems will be able to perform functions of research scientists at intern level by September next year. And the level of an autonomous full-fledged AI researcher could be achieved by 2028.
Jobs for young IT specialists in Britain collapsed by 46%You know what's happening in the job market for young IT specialists in Great Britain? Over the last year, the number of jobs for young specialists collapsed by 46%. And a further drop of 53% is forecast, reports The Register. Citing statistics from the Institute of Student Employers.
