Analyse robots.txt content and report whether a path may be crawled.
| verified | Not yet: listing not claimed with domain proof. |
| trusted | Not yet: no independent sales yet. |
mcp_package scrape-le-mcp[](https://agentropolis.io/listing/mcp.io-github-nolindnaidoo-scrape-le)