Google's New AI Content Controls: What They Mean for SEO, Website Owners and The Future of Search

Artificial intelligence is changing how people search for information, discover businesses and interact with websites. As platforms such as Google, ChatGPT and Microsoft Copilot become increasingly integrated into everyday search behaviour, an important question is emerging: who controls the content that powers these AI systems?

For years, website owners have created articles, guides, resources and product information to attract visitors through search engines. Now, that same content can be used to train artificial intelligence models or help generate answers directly within AI-powered platforms, sometimes without users needing to visit the original website.

Google has announced plans to support a new industry-wide system that gives website owners more control over whether their content can be used to train AI models. The development, announced on 30 October 2026, forms part of a wider effort involving other major AI providers to establish clearer rules around how publicly accessible website content is used.

But what does this mean for businesses in practice? Could restricting AI access protect your content, or could it come at the expense of valuable visibility? And how might these changes affect search engine optimisation over the coming years?

In this article, we'll explore Google's latest announcement, explain the technical controls involved and examine what businesses should consider as traditional search and AI-powered discovery continue to evolve.

What has Google announced about AI and website content?

On 30 October 2026, Google confirmed that it intends to support a shared AI training control within the robots.txt file, a technical file that website owners already use to communicate instructions to automated crawlers.

The proposed system is being developed through the Internet Engineering Task Force (IETF), an organisation responsible for developing widely adopted internet standards. More specifically, the work is being progressed through the Artificial Intelligence Preferences (AIPREF) working group.

Currently, different artificial intelligence providers offer different mechanisms for controlling access to website content. This can make managing AI usage complicated, particularly for businesses that want to apply consistent policies across several platforms.

The proposed standard aims to simplify that process. Rather than configuring separate training restrictions for every participating AI provider, website owners would be able to express a broader preference using a shared policy token.

Google has confirmed that it intends to support the new mechanism in 2027, alongside other participating AI providers. Importantly, this is a planned development rather than a fully implemented universal standard.

The announcement follows increasing pressure from publishers, content creators and regulators for greater transparency and control over how AI companies collect and use publicly accessible information.

Why do AI companies want access to website content?

AI systems depend on large quantities of information to develop their capabilities and, in some applications, generate responses to individual questions.

Publicly available website content can contribute to these systems in different ways. However, understanding the distinction between AI training and AI-generated search results is essential.

AI model training

AI training involves using information to develop or improve an artificial intelligence model. During training, models learn statistical patterns from large datasets, helping them generate responses, understand language and perform other tasks.

Website content can form part of these datasets, depending on the developer's collection methods, permissions, policies and applicable laws.

For example, an educational website containing hundreds of detailed articles might provide information that an AI developer considers useful when developing a model's knowledge and capabilities.

The important point is that using content for training does not necessarily mean the original website will receive a link, referral traffic or recognition when the model subsequently generates a response.

AI search and grounding

AI-powered search works differently. When a user submits a question, some systems retrieve information from websites to help produce an answer. This process is often described as grounding.

Google AI Overviews, AI Mode and other AI assistants can use retrieved information to support responses and, in some cases, display links to the original sources.

For businesses, this creates a different opportunity. Instead of appearing only as a traditional organic listing, a website may be referenced as a source within an AI-generated response.

However, appearing as a source does not guarantee that someone will click through to the website.

This distinction matters because controlling AI training and controlling AI search visibility are separate decisions. A website owner might want to prevent content from contributing to future model training while still allowing AI search platforms to reference their articles and direct potential customers to their website.

How will Google's new AI training control work?

At the centre of Google's announcement is the robots.txt file.

A robots.txt file is normally located at the root of a website and contains instructions that automated crawlers can interpret. Search engines regularly use these instructions to determine which areas of a website they are permitted to crawl.

For example, a website might allow search engines to crawl its public service pages while restricting access to certain internal directories.

Google's proposed AI training control would introduce a shared preference mechanism within this existing framework.

Rather than requiring website owners to maintain separate rules for every participating AI provider, the shared policy token would communicate a broader preference regarding AI training.

Google has also explained how it intends to interpret the new control alongside its existing Google-Extended mechanism.

Where a website opts out of AI training using the shared token and has not explicitly configured Google-Extended, Google intends to treat that preference as though Google-Extended had been disallowed.

Where Google-Extended has been explicitly configured, that provider-specific instruction can continue to operate alongside the wider industry preference.

This approach would allow website owners to establish a general policy while retaining more specific control over particular AI providers.

However, the proposed mechanism remains under development. Website owners should avoid implementing speculative syntax or assuming that every AI platform will interpret the new instructions identically.

What is Google-Extended and how does it affect SEO?

Google-Extended is an existing control introduced by Google in 2023. It allows website owners to manage certain uses of their content by Google's AI systems without necessarily preventing the website from appearing in traditional Google Search results.

This is particularly important for businesses that rely on organic traffic.

A company might not want its website content used for particular AI development purposes, but it may still depend heavily on Google Search to generate enquiries, sales and brand awareness.

Google-Extended provides a degree of separation between those different objectives.

However, there are limitations to understand. Google's documentation connects Google-Extended not only with AI-related training controls but also with eligibility for certain Gemini experiences. Google has stated that websites explicitly allowing Google-Extended are eligible to appear as grounded sources in Gemini Apps.

Consequently, restricting Google-Extended should not be treated as a decision that has absolutely no implications beyond model training.

It is also important to distinguish Google-Extended from Googlebot, which is responsible for crawling websites for Google Search. Blocking Googlebot can have significant implications for search visibility, whereas Google-Extended serves a different purpose.

For most businesses, this is an area where changes should be reviewed carefully rather than implemented without understanding the consequences.

Can website owners stop their content appearing in Google AI Overviews?

Google has also introduced separate controls allowing website owners to manage their participation in generative AI search features.

In June 2026, Google announced that it was testing a new Google Search Console control that would allow website owners to opt out of appearing in features such as AI Overviews and AI Mode. Google subsequently confirmed that the functionality had become available globally by the end of August 2026.

Through this control, website owners can decide whether they want their content and links to help support responses generated by Google's AI search experiences.

A website that opts out will no longer receive impressions or referral traffic from those generative AI search features.

Google has stated that using this control will not be treated as a ranking signal for results outside those AI features.

This creates an important strategic decision for website owners.

On one hand, businesses have greater control over how their content is presented and used. On the other, opting out could mean losing opportunities to reach potential customers who increasingly rely on AI-generated search results.

Rather than viewing these controls purely as technical settings, businesses should consider how they fit within their wider digital marketing strategy.

Why are these changes important for SEO?

Search engine optimisation has traditionally focused on helping websites become more visible in search results, attract relevant traffic and convert visitors into customers.

Although those objectives remain important, the way users discover information is changing.

Google's AI features can generate answers to increasingly complex questions, combining information from multiple sources into a single response. This changes the relationship between content, search visibility and website traffic.

Previously, a well-optimised article could attract visitors searching for a particular question. Today, an AI-generated response might answer that question before the user reaches the website.

For businesses investing heavily in content marketing, this creates both opportunities and challenges.

The challenge of reduced click-through opportunities

One concern surrounding AI-powered search is the possibility that users will obtain the information they need without clicking through to the original source.

For example, imagine a mortgage broker publishing a detailed guide explaining how mortgage affordability assessments work. Traditionally, someone searching for that information might find the article in Google and visit the broker's website.

In an AI-powered search experience, Google may present a summary directly within the search results.

The user receives an answer, but they may never visit the original article.

This doesn't necessarily mean the website loses all value from appearing as a source. Brand recognition, credibility and subsequent searches may still contribute to commercial outcomes.

However, it does mean that impressions, clicks and rankings should no longer be interpreted in isolation.

The opportunity for greater brand visibility

AI-powered search can also create new opportunities for businesses whose content is considered relevant and useful.

A detailed article containing original research, practical expertise or explanations that really help may be referenced when an AI platform answers related questions.

For businesses operating in competitive industries, appearing alongside authoritative sources could introduce their brand to audiences they might otherwise struggle to reach.

The difficulty is determining how much that exposure is worth.

An AI reference may help establish familiarity with a brand, but businesses still need to understand whether that visibility contributes to enquiries, conversions or revenue.

This is why tracking AI search performance is becoming an increasingly relevant part of modern SEO.

Should businesses block AI crawlers from their websites?

There isn't a universal answer to this question.

The correct approach depends on the type of website, the commercial value of its content and the role organic search plays in attracting customers.

For some publishers, content itself is the primary product. Their commercial model might depend on subscriptions, advertising revenue or licensing agreements. Allowing AI companies to use substantial amounts of that content without an appropriate return could create legitimate concerns.

For other businesses, published content primarily supports marketing and customer acquisition.

A local accountancy practice, construction company or digital agency might create educational articles to demonstrate expertise and attract potential customers. In these circumstances, being discoverable through AI-powered platforms may offer commercial advantages.

The critical distinction is between protecting content as an asset and using content as a marketing channel.

A publisher selling access to specialist research has different priorities from a service-based business publishing advice to generate enquiries.

Before introducing restrictions, businesses should consider how their content supports their wider objectives and whether excluding particular AI uses would create more value than allowing them.

What do the changes mean for small businesses?

Although discussions around AI content rights frequently focus on major publishers and technology companies, smaller businesses also have an interest in how their website content is used.

Many small and medium-sized businesses invest considerable time and money into developing their online presence. They commission service pages, publish specialist articles, create resources and optimise their websites to compete for relevant searches.

That content represents an investment.

As AI platforms become another way for potential customers to discover businesses, companies need to understand how their content can be accessed and what opportunities or limitations come with that access.

For a local service provider, allowing AI search systems to reference relevant pages may help potential customers discover the business while researching a particular service.

For an ecommerce retailer, product information, buying guides and comparisons may contribute to product discovery.

For a professional services business, authoritative content may help communicate expertise in an increasingly competitive online environment.

However, these opportunities should not be confused with guaranteed results. A website being accessible to AI systems does not mean that its content will automatically be selected, cited or recommended.

Successful visibility still depends on the quality, relevance, accessibility and credibility of the information available.

How should businesses adapt their SEO strategies?

Google's announcement should encourage businesses to review how their websites are prepared for an increasingly AI-driven search environment.

The introduction of more granular controls doesn't make traditional SEO irrelevant. Instead, it reinforces the importance of developing a strategy that considers both conventional search and AI-powered discovery.

1. Review your existing crawling and indexing settings

Before changing any AI-related controls, businesses should understand how their websites are currently configured.

This includes reviewing robots.txt instructions, meta robots directives, indexing accessibility and any restrictions affecting specific crawlers.

Incorrectly implemented crawling controls can have consequences for website visibility. Changes should therefore be tested and documented, particularly when managing websites that generate significant organic traffic.

2. Understand which AI experiences you want to participate in

Not every form of AI content usage serves the same purpose.

A business may be comfortable with its articles appearing as referenced sources in AI-powered search while taking a different position on using those articles to train future models.

Separating those objectives will make it easier to decide which controls are appropriate.

As more providers adopt shared standards, businesses should be able to express these preferences more consistently. Until then, existing provider-specific controls and their documentation remain important.

3. Invest in original and valuable content

AI-generated answers create additional competition for websites publishing generic information.

If a page simply repeats widely available explanations without offering anything distinctive, there may be little reason for users to visit it after receiving an AI summary.

Businesses should therefore focus on creating content that provides real value beyond basic definitions.

Original research, detailed case studies, expert commentary, real examples and first-hand experience can help differentiate a website from competitors publishing similar material.

For service-based businesses, this could include explaining real project challenges, showing completed work or answering specialist questions that prospective customers regularly ask.

Content should still be written primarily for people rather than attempting to manipulate AI systems.

4. Monitor AI search visibility alongside traditional SEO

Google has expanded Search Console reporting to provide greater insight into how websites appear within its generative AI search features.

These insights can help businesses understand which pages are being surfaced, where they are receiving visibility and how their presence changes over time.

Traditional SEO metrics remain valuable, but businesses should increasingly evaluate how search impressions, referral traffic, user behaviour and conversions interact.

An increase in AI visibility is useful information, but the ultimate commercial objective is still to attract relevant audiences and generate meaningful outcomes.

5. Build brand recognition beyond search rankings

As search experiences evolve, businesses should avoid depending entirely on individual keyword positions.

A recognisable brand, consistent messaging and a strong online reputation can become valuable assets when customers encounter a business across several platforms.

This includes maintaining accurate business information, publishing credible expertise, developing high-quality service pages and ensuring that the website clearly communicates what the business offers.

AI search introduces another discovery channel, but it doesn't replace the importance of having a website that establishes trust and converts visitors into customers.

What role does UK regulation play?

Google's announcement also arrives against the backdrop of increasing regulatory scrutiny.

In June 2026, the UK's Competition and Markets Authority introduced requirements designed to give publishers greater control over how their content is used within Google's generative AI search features.

These requirements address issues including publisher choice, attribution, transparency and reporting.

The objective is to create a fairer relationship between the organisations producing content and the platforms using that information to provide AI-powered services.

Google's proposed support for a shared AI training control is a separate initiative, but both developments reflect the growing importance of content ownership and publisher preferences.

They also highlight a broader shift in how websites and AI providers interact.

Historically, the central question was whether search engines were allowed to crawl and index a website. Today, website owners are increasingly being asked to consider multiple potential uses of their content, each with different commercial implications.

What happens next for Google and AI content controls?

Google has stated that it aims to support the shared AI training control in 2027.

The proposal is still being refined through the IETF process, and its long-term effectiveness will depend partly on how widely it is adopted and how consistently participating providers interpret the resulting preferences.

There are also questions that technical controls alone cannot fully resolve.

For example, how should publishers be compensated when their content contributes substantial value to AI services? How can businesses accurately measure the benefit of appearing within AI-generated responses? And how should website owners balance protecting their work against remaining visible in new discovery environments?

These questions are likely to remain central to discussions about the future of online publishing and search.

For businesses, the immediate priority should be understanding existing controls, reviewing current SEO performance and monitoring how AI-powered discovery affects their audiences.

The future of SEO is about visibility, value and control

Google's latest announcement represents another step towards giving website owners a greater say in how artificial intelligence systems use their content.

Although the proposed shared training control will not be supported by Google until 2027, the direction is significant.

Businesses are moving into an environment where appearing in traditional search results, contributing to AI model training and being referenced within AI-generated answers are increasingly distinct considerations.

The challenge is no longer simply getting a website indexed and ranking for relevant keywords. It is understanding where a business should be visible, how its content creates value and which platforms contribute to meaningful commercial results.

At Cold, we see this as an evolution of SEO rather than its replacement. The fundamental principles of building technically sound websites, publishing useful content and developing a credible online presence remain important.

What changes is how those foundations need to support an expanding range of search and discovery experiences.

Businesses that understand these differences and adapt their strategies accordingly will be better equipped to make informed decisions about their content, protect their interests and identify new opportunities for growth.