# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # https://developers.google.com/webmasters/control-crawl-index/ # # To ban all spiders from the entire site uncomment the next two lines: User-agent: * Disallow: /signup/welcome Disallow: /signup/thanks Disallow: /contact/thanks Disallow: /login Disallow: /*q= Disallow: /*.atom Disallow: /blog/tag/ Sitemap: https://www.integrate.io/sitemap.xml Sitemap: https://www.integrate.io/blog-sitemap.xml Sitemap: https://www.integrate.io/glossary-sitemap.xml Sitemap: https://www.integrate.io/xplenty-docs-sitemap.xml Sitemap: https://www.integrate.io/flydata-docs-sitemap.xml Sitemap: https://www.integrate.io/dreamfactory-docs-sitemap.xml Sitemap: https://www.integrate.io/webinars-sitemap.xml Sitemap: https://www.integrate.io/webinars-japanese-sitemap.xml Sitemap: https://www.integrate.io/customers-sitemap.xml Sitemap: https://www.integrate.io/books-and-guides-sitemap.xml Sitemap: https://www.integrate.io/careers-sitemap.xml