robots.txt
User-agent: * Crawl-delay: 10 Disallow: /blog/wp-json/ Disallow: /blog/jp/wp-json/ Disallow: /blog/de/wp-json/ Disallow: /blog/fr/wp-json/ Disallow: /webinars/wp-json/ Disallow: /videos/ Disallow: /legal/ Disallow: /help/search Disallow: /help/?s= Disallow: /help/?q= Disallow: /help/&s= Disallow: /help/&q= Disallow: /help/?filter= Disallow: /help/?sort= Disallow: /help/?orderby= Disallow: /help/?order= Disallow: /help/?view= Disallow: /help/?utm_ Disallow: /help/?gclid= Disallow: /help/?fbclid= Disallow: /help/?mc_cid= Disallow: /help/?mc_eid= Disallow: /help/?ref= Disallow: /help/?referrer= Disallow: /help/?replytocom= Disallow: /help//trackback/ Disallow: /help/trackback/ Disallow: /help//feed/ Disallow: /help/feed/ Disallow: /help/.atom$ Disallow: /help/.rss$ Disallow: /help/?print= Disallow: /help/*?preview= Disallow: /help/wp-admin/ Allow: /help/wp-admin/admin-ajax.php Disallow: /help/wp-json/ Disallow: /help/xmlrpc.php Disallow: /help/?p=
User-agent: bingbot Crawl-delay: 10 Disallow: /blog/wp-json/ Disallow: /blog/jp/wp-json/ Disallow: /blog/de/wp-json/ Disallow: /blog/fr/wp-json/ Disallow: /webinars/wp-json/ Disallow: /videos/ Disallow: /legal/ Disallow: /help/search Disallow: /help/?s= Disallow: /help/?q= Disallow: /help/&s= Disallow: /help/&q= Disallow: /help/?filter= Disallow: /help/?sort= Disallow: /help/?orderby= Disallow: /help/?order= Disallow: /help/?view= Disallow: /help/?utm_ Disallow: /help/?gclid= Disallow: /help/?fbclid= Disallow: /help/?mc_cid= Disallow: /help/?mc_eid= Disallow: /help/?ref= Disallow: /help/?referrer= Disallow: /help/?replytocom= Disallow: /help//trackback/ Disallow: /help/trackback/ Disallow: /help//feed/ Disallow: /help/feed/ Disallow: /help/.atom$ Disallow: /help/.rss$ Disallow: /help/?print= Disallow: /help/*?preview= Disallow: /help/wp-admin/ Allow: /help/wp-admin/admin-ajax.php Disallow: /help/wp-json/ Disallow: /help/xmlrpc.php Disallow: /help/?p=
User-agent: Baiduspider Disallow: /help/ Allow: /help/zh/ Crawl-delay: 10
User-agent: Sogou web spider User-agent: Sogou inst spider User-agent: Sogou spider2 Disallow: /help/ Allow: /help/zh/ Crawl-delay: 10
User-agent: HaoSouSpider User-agent: 360Spider Disallow: /help/ Allow: /help/zh/ Crawl-delay: 10
User-agent: Yandex Disallow: /help/
User-agent: SeznamBot Disallow: /help/
User-agent: Yeti Disallow: /help/
User-agent: GPTBot
Disallow: /help/
User-agent: ClaudeBot
Disallow: /help/
User-agent: CCBot
Disallow: /help/
User-agent: Google-Extended
Disallow: /help/
User-agent: Bytespider
Disallow: /help/
Sitemap: https://www.outbrain.com/sitemap.xml Sitemap: https://www.outbrain.com/help/sitemaps.xml