Robots.txt Tester API

Parse a robots.txt, lint it and test whether a path is allowed for Googlebot, Bingbot, GPTBot or any user-agent.

Environment

Environment	Base URL
Production	`https://api.sadafiles.com/v1`

There is one environment and no sandbox, so every request here is real and counts toward your limits.

Request

POSThttps://api.sadafiles.com/v1/seo-tools/robots-txt-tester

Content type: application/json
Auth: No key needed
Rate weight: 2 units
Web tool: Use Robots.txt Tester without code

Parameters

Send the fields your check needs as JSON.

Name	Type	Default	Allowed
`mode`Fetch a public URL, or paste the code and keep it on your device.	string	url	url, paste
`url`	string	—	—
`robots`	string	—	—
`path`	string	/	—
`userAgent`	string	Googlebot	—

Response

A JSON report. Run it below to see a real one.

Try it yourself!

This sends a real request. The URL must be public.

Body

urlstringrequired

This route needs no key. Requests count against your IP's fair-use limit.

1curl -X POST "https://api.sadafiles.com/v1/seo-tools/robots-txt-tester" \2  -H "Content-Type: application/json" \3  -d '{"url":"https://example.com"}'

Developer docs