User-agent: Mediapartners-Google* Disallow: User-agent: Twitterbot Disallow: User-Agent: AhrefsBot # https://ahrefs.com/robot/ Disallow: / User-Agent: MegaIndex # https://www.megaindex.ru/?tab=linkAnalyze Disallow: / User-Agent: SemrushBot Crawl-delay: 10 User-agent: * Disallow: /error.php Disallow: /cron.php Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /images/ Disallow: /includes/ Disallow: /stats/ Disallow: /sitestats/ Disallow: /language/ Disallow: /pr/ Disallow: /forum/adm/ Disallow: /forum/includes/ Disallow: /forum/images/ Disallow: /forum/language/ Disallow: /forum/templates/ Disallow: /forum/common.php Disallow: /forum/config.php Disallow: /forum/cron.php Disallow: /forum/download.php Disallow: /forum/mcp.php Disallow: /forum/memberlist.php Disallow: /forum/posting.php Disallow: /forum/report.php Disallow: /forum/search.php Disallow: /forum/ucp.php Disallow: /forum/viewonline.php Disallow: /gallery/lib/ Disallow: /gallery/var/logs/ Disallow: /gallery/var/modules/ Disallow: /gallery/var/albums/ Disallow: /gallery/var/tmp/ Disallow: /gallery/var/uploads/ Disallow: /gallery/var/fullsizes/ Sitemap: https://www.f1technical.net/sitemap/sitemap.xml.gz Sitemap: https://www.f1technical.net/newest.xml