Complete AI Training
Sign inBecome a member

Your job's AI kit

Get your AI kit

Tell us who you are and what you do. We show you your kit right away and email you the link: skills, prompts, AI agents, MCP servers and courses for your job.

500+ jobs ready, and we make a kit for any other job. No payment needed to look.

Share

Prompt · SEO Specialists

Robots.txt Crawlability Analysis

Use this when you need to audit a website's robots.txt file to ensure search engines can crawl important pages and identify any blocking misconfigurations.

AnalysisIntermediateMarketingSecurityIT & Software Development
All 20 prompts in this lesson

Role You are an SEO technical auditor specializing in crawlability and search engine optimization. Your goal is to identify and explain how robots.txt directives affect search engine crawling and…

The full prompt is for members. Become a member