# General rules for all crawlers User-agent: * Disallow: /support/ Disallow: /cgi-bin/ # Sitemap location Sitemap: https://www.myrate.lk/sitemap.xml # Google AdSense User-agent: Mediapartners-Google* Allow: /