SEO

AI Agent Optimization Becomes Cloudflare’s New SEO Question

Cloudflare says its Act 4 products recorded first revenue in the third quarter. CEO Matthew Prince described paid webpage change signals, customer controls for AI agents, and beta payment products.
Picture of Hexa Tiger
3 min read
Share
What to know
Summary

AI Agent Optimization is becoming a new question for website owners as Cloudflare helps customers manage artificial intelligence agent traffic. CEO Matthew Prince said the company recorded its first third-quarter revenue from Act 4 products, which are meant to help create a new business model for the internet.

Prince described efforts to attract AI agent traffic as “sort of the new version of SEO,” according to the earnings call report. He gave no Act 4 revenue figure, and Cloudflare’s results release did not break out that revenue.

AI Agent Optimization Starts With Crawl Efficiency

During an earnings call, Prince said OpenAI pays Cloudflare for information about when webpages change. That lets OpenAI’s crawler avoid repeatedly fetching an unchanged page, such as a restaurant menu after its prices have been updated.

Blue fiber optic cables routed into a network switch
Blue fiber optic cables routed into a network switch. Illustrative stock photo via Pexels.

Cloudflare made the arrangement public on July 8 through a research pilot using signals from participating websites, including content freshness and page changes. In an Oct. 15 results posting, the company said it was still working with OpenAI to determine how better discovery could lead to business outcomes.

The deal connects to AI agents and SEO controls and how agents access websites.

Customers Can Welcome or Block Agents

Prince said customer preferences differ. Some want as many agents as possible, while others see them as a cost and want to keep them away. Cloudflare helps the first group draw more agents and handle traffic efficiently. Customers who block agents are not charged for that traffic, he said.

A person types on a laptop next to a smartphone
A person types on a laptop next to a smartphone. Illustrative stock photo via Pexels.

Prince illustrated the tradeoff with an agent choosing a restaurant for a user. It might collect menus from 1,000 restaurant websites, even though the user visits only one. The other 999 restaurants carry a cost without gaining a customer. A person might compare two or three pages, while agents can operate at much greater scale.

On an August earnings call, Prince said nonhuman traffic could reach as much as 1,000 times human traffic within five years if trends continued. This time, he said he expects it sooner. More traffic would require additional bandwidth and servers. “It can’t be a free ride for all the agents that are out there,” he said.

Cloudflare Expects More Agent Payments

Prince also expects some form of micropayments when agents visit websites. He said a site might charge an agent less when it explains why it is visiting. An agent planning a Hawaii vacation for a family of four could create advertising opportunities for a travel site, potentially making free access worthwhile.

Cloudflare moved its Monetization Gateway and Pay Per Use products into beta on Sept. 30. The Gateway lets sellers charge AI agents per request. Pay Per Use pays publishers that accept an AI company’s offer for reported uses. Prince did not say when micropayments might become a major revenue source, though he imagined they could become Cloudflare’s largest business area in 10 years.

Cloudflare offers AI Crawl Control on every plan, letting customers permit or deny individual AI crawlers. Its documentation lists Pay Per Crawl in a private beta. The company’s next disclosures may clarify whether other AI firms pay for crawl hints and whether websites whose pages agents use receive any share. A related change to Google indexing documentation shows why site owners follow how search systems discover and process pages.

Answers

Questions, answered.

Related pages

Continue reading

Service

E-Commerce Development

Hexa Tiger
Hosting

Reliable Website Hosting

Hexa Tiger
Guides and articles

Hexa Tiger’s Knowledge Base

Guides and articles from the Hexa Tiger team on WordPress, Elementor and the platforms we build.
10 Reason Why Using WordPress is a Great Idea
Building Your First Website With Elementor, Tips and Tutorials
Getting Started with JewelTrak Cloud
Guides

Getting Started with JewelTrak Cloud

October 15, 2023
Hexa Tiger
Knowledge Base
Knowledge base

Knowledge Base

Dec 9, 2022
Hexa Tiger