# robots.txt for AI Markdown Workspace by Adoneinu # Allow all search engines to crawl the site User-agent: * Allow: / # Disallow admin/private areas (if any) Disallow: /admin/ Disallow: /private/ # Crawl delay for respectful crawling Crawl-delay: 10 # Block aggressive bots User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / # Sitemap location Sitemap: https://md.adoneinu.com/sitemap.xml