Your web hosting provider may be silently refusing traffic from AI and search engine bots.
I’ve found this out randomly when trying to add one of our products into a directory.
In our case the provider is Siteground, but other providers (including Cloudflare, famously) tend to be trigger-happy in the matter of blocking the AI bots from reaching your content.
As a business/product, in 99% cases you want all bots to index your website without restrictions, so that you are fully exposed to search engines and AI recommendations.
I’ve built a simple tool to use internally to verify whether your website is reachable by all popular search engine, AI and comparison bots.
Happy to test your website or make the tool public if there is enough interest, feel free to drop your URLs.