Google-CloudVertexBot

AI assistant fetcher

A Google crawler that fetches pages at the request of site owners building Vertex AI Agent applications. It runs on behalf of the customer who set up the agent, not as a general index. Google lists only the substring Google-CloudVertexBot and states its common crawlers always obey robots.txt rules when crawling automatically.

OperatorGoogle
TypeAI assistant fetcher
Respects robots.txtYes (documented)
DocumentationOfficial operator documentation

Google-CloudVertexBot user-agent string

This is how Google-CloudVertexBot identifies itself in your server logs:

Google-CloudVertexBot

How to block Google-CloudVertexBot in robots.txt

Add this to the robots.txt file at the root of your site:

Block Google-CloudVertexBot

User-agent: Google-CloudVertexBot
Disallow: /

Explicitly allow Google-CloudVertexBot

User-agent: Google-CloudVertexBot
Allow: /

What blocking changes: Blocking it prevents Vertex AI agent builders from indexing your site for their applications. Google Search is unaffected.

Want to decide for all AI bots at once? Use the AI robots.txt generator.

Other ai assistant fetchers

Is Google sending you visitors?

Glyphex classifies AI referral traffic from ChatGPT, Perplexity, Claude, Gemini and more. See which assistants cite your pages and what those visitors do.

See your AI traffic