AI Economics Tools
AI
Token cost, LLM energy, agent-hour and Proof-Adjusted Autonomy calculators by Michał Piszczek
No keyCORSHTTPS
AI Crawler Checker
Checks a website's robots.txt, meta and header directives to see which AI crawlers (ChatGPT, Claude, Perplexity, etc.) are allowed or blocked. Returns a JSON verdict, per-bot rules, access scores, content signals and recommended robots.txt snippets.
Verified today: 100% uptime
API key
Unconfirmed
HTTPS
Supported
Browser calls
Unconfirmed
Status
Live · 90/100
What our checks found
- Health score
- 90/100
- Reliability
- 100%
- Average latency
- 605ms
Last checked 2026-10-14. Measured independently, not self-reported by the provider.
How to call it
A starting template for AI Crawler Checker. Replace ENDPOINT with the path from the official documentation, which we link above rather than guess at.
# Authentication requirement is unconfirmed. Check the documentation before relying on this.
curl -s "https://tools.yukai.uk/ENDPOINT" \
-H "Authorization: Bearer YOUR_TOKEN" \
-H "Accept: application/json"Where this listing comes from
Aggregated from one public source (freepublicapis), then normalised and checked by us.
Report an issue with this listing ↗Other AI APIs
See all 107 →AI Model Watch
AI
Daily-updated prices, context windows & deprecation/EOL dates for 190+ AI/LLM models, sourced from official provider docs
No keyCORSHTTPS
DocStruct
AI
AI extraction of invoices, receipts, bank statements & contracts into structured JSON/CSV
No keyCORSHTTPS
Kavel
AI
Generate and edit images with AI, no key or account required
No keyCORSHTTPS
Modelfax
AI
LLM pricing, context windows and deprecation dates, schema-validated and updated daily
No keyCORSHTTPS
Not Human Search
AI
AI tool discovery with agentic scoring for 8,600+ tools and MCP servers
No keyCORSHTTPS
AI Crawler Checker — common questions
Answered from what our own scheduled checks found, not from the provider's marketing.
Is AI Crawler Checker free to use?
AI Crawler Checker is listed in our free catalogue, but it requires some form of authentication, so you will need to register before your first call. Providers frequently reserve higher limits and commercial use for paid plans.
Does AI Crawler Checker need an API key?
AI Crawler Checker requires some form of authentication. Check the provider's documentation for which scheme it expects.
Can I call AI Crawler Checker from browser JavaScript?
We could not confirm CORS support for AI Crawler Checker. Test it from a browser before relying on it client-side; if the request succeeds in curl but fails in the console, CORS is the reason.
Is AI Crawler Checker still working?
Yes, as of 2026-10-14. Our automated check reached AI Crawler Checker and recorded a 100% reliability score with a median response time of 605 ms. We re-check on a schedule, and this page updates with the result.
Is AI Crawler Checker available over HTTPS?
Yes. AI Crawler Checker serves over HTTPS, so you can call it from a secure page without triggering a mixed-content block.