User-agent: * Allow: / Disallow: /*.pdf$ Sitemap: https://drshivramkaranthlayout.com/sitemap.xml # Reduce crawl rate for heavy SEO bots User-agent: AhrefsBot Crawl-delay: 10 User-agent: SemrushBot Crawl-delay: 10