AI Systems Are Visiting Business Websites. Are They Actually Reading Yours?
Stop guessing. Measure it.
The Problem
Being crawlable does not tell you whether AI systems actually came, what they retrieved, or whether the retrieval worked.
The Sydney Business Web AI Observatory is an Australian-developed managed SaaS platform for AI Visibility monitoring that gives suitable business websites access to a live dashboard of filtered, observable evidence of recognised AI and search crawler retrieval activity — including what they requested and whether the retrieval succeeded.
Suitable business websites only • Technical assessment required before acceptance
Developed by Sydney Business Web, led by Keith Rowley, B.Sc. (Hons) Electronic Engineering, MBA, former Pr.Eng. (SA) and MSAIEE — AI Visibility Consultant.
Sydney Business Web AI Observatory — rolling 24-hour retrieval evidence showing successful machine access to real website resources.
The Observatory records and classifies identifiable machine activity before applying our stricter filters for public retrieval evidence.
What You’ll Know
Three Questions. Real Answers.
Who Came?
Which qualifying AI and search systems actually reached your website.
What Did They Retrieve?
Whether they reached real business information and machine-discovery resources.
Did It Work?
Whether those qualifying retrieval attempts succeeded or failed.
Professional AI Retrieval Monitoring
Put Your Website Under Observation
Commission a specialist monitoring system that records filtered, observable evidence of recognised AI and search crawler retrieval activity reaching your website.
Monthly Monitoring
Flexible monthly billing following commissioning.
Annual Monitoring
Twelve months paid annually in advance.
Suitable business websites only. If technical issues need to be corrected before reliable measurement can begin, we will identify them before accepting the installation.
Starting prices shown • All prices exclude GST • Final acceptance and scope subject to website assessment
Request a Website Suitability Assessment
Tell us where to find your website. We’ll assess whether it’s suitable for the Sydney Business Web AI Observatory.
Stage 1 of AI Visibility
Start Measuring Now. Build From There.
Available at launch:
Discoverability → Access → Retrieval
Later in 2026, Sydney Business Web plans to add optional measurement for downstream AI Visibility activity including representation, citation, recommendation and outcomes.
Retrieval evidence does not by itself prove understanding, citation or recommendation. Those stages require their own evidence.
Technical Engineering Note How the AI Observatory tracks machine retrieval Infrastructure detail for developers, IT teams and systems specialists
Edge-based machine retrieval telemetry
The Sydney Business Web AI Observatory does not depend on browser analytics, tracking pixels or client-side JavaScript to detect autonomous crawler activity. Instead, a production Cloudflare Worker observes selected request and response characteristics at the website edge as machine systems reach the production website.
Qualified telemetry is recorded into Cloudflare Analytics Engine, separating the measurement system from the website's WordPress, PHP and application database environment. A separate read-only reporting Worker queries those measurements, applies the public evidence rules and supplies the Observatory dashboard through a dedicated evidence endpoint.
Multi-stage evidence filtering
A crawler name in a User-Agent is not accepted as proof of identity. The Observatory applies additional technical corroboration and classification rules before machine activity can enter its public evidence.
This deliberately produces a smaller evidence set than simply counting raw crawler traffic. The purpose is not to maximise a bot count; it is to produce machine-retrieval measurements that can be defended technically.
What the instrument measures
The AI Observatory measures principally the access and retrieval stages of this chain. It can provide observable evidence that a sufficiently corroborated machine system reached the website, what class of resource it requested, and whether qualifying retrieval succeeded.
It does not claim to inspect the internal reasoning of Google, OpenAI, Anthropic, Microsoft or another AI provider. Successful retrieval does not by itself prove subsequent understanding, citation, representation, recommendation or endorsement.
The architecture therefore keeps raw telemetry, evidence qualification and public reporting as distinct stages. Raw machine activity becomes public evidence only after it satisfies the defined measurement rules.
Technical Documentation & Archived Release
AI Observatory's architecture, retrieval methodology and measurement boundary are publicly documented on GitHub. Version 1.0.0 is permanently archived by Zenodo and identified by a persistent DOI.
GitHub technical documentation:
github.com/Sydney-Business-Web/ai-observatory
Archived technical release — v1.0.0:
DOI: 10.5281/zenodo.22040578
The Engineering Behind the Observatory
Inspect the Method. Check the Evidence.
AI Observatory did not begin as a marketing dashboard. It grew from a technical measurement project designed to establish what can—and cannot—be proved about machine retrieval of a business website. The method and production evidence are available to inspect.
Measuring Machine Retrieval
The engineering problem: separating crawler permission, machine visits and genuine retrieval into things that can actually be measured.
Read Part One Part TwoReal Retrieval Evidence
What happened when we applied the measurement system to real production traffic—including crawler attribution, successful retrievals and an access fault the data exposed.
Read Part Two Live EvidenceSee the Observatory Running
View Sydney Business Web’s filtered public evidence, including observed machine systems, retrieval activity and successful access to meaningful website resources.
Open the Live ObservatoryRetrieval evidence demonstrates observable machine access. It does not by itself prove understanding, citation, recommendation or endorsement.