ZutrixBot is a web crawler designed to power the database for Zutrix, providing essential data for search engine optimization (SEO) insights. Below, you’ll find all the information about ZutrixBot, its purpose, and how it interacts with websites.
General Information
• Name: ZutrixBot / ZutrixScraper
• Version: 1.0
• Purpose: ZutrixBot collects and processes data to enhance the Zutrix SEO tool, enabling comprehensive analytics for website owners and marketers.
• Category: Search Engine Optimization
• Compliance: ZutrixBot strictly adheres to web standards and ethical crawling practices, including respecting robots.txt directives.
Technical Details
User-Agent
ZutrixBot uses the following user-agent strings to identify itself during web crawls:
ZutrixBot/1.0 (+https://zutrix.com/robot)
ZutrixScraper/1.0 (+https://zutrix.com/robot)
Reverse DNS
ZutrixBot’s requests can be verified via reverse DNS lookups to confirm they originate from our infrastructure. The following domain suffixes are used for verification:
• zutrix.com
• zutrix.net
Crawl Behavior
• Obeys Robots.txt: Yes
• Crawl Delay: Yes (respects crawl-delay directives in robots.txt files to minimize server load)
• Opt-Out: Website owners can opt-out of ZutrixBot’s crawling activities by adding the following rule in their robots.txt file:
User-agent: ZutrixBot
Disallow: /
User-agent: ZutrixScraper
Disallow: /
IP Address Range
ZutrixBot operates from a range of dedicated IP addresses. For security and transparency, the current list of ZutrixBot’s IP ranges can be found here.
Ethical Crawling Standards
ZutrixBot is designed with the utmost respect for website owners and their data:
• Robots.txt Compliance: ZutrixBot ensures compliance with the robots.txt protocol, enabling website administrators to control crawling behavior.
• Throttling: Requests are throttled to avoid overloading servers.
• Opt-Out Mechanism: Websites can block ZutrixBot through robots.txt or contact our team for manual exclusions.
FAQs
1. Why is ZutrixBot visiting my website?
ZutrixBot collects publicly available data for the Zutrix SEO tool to provide insights into backlinks, keywords, and other SEO metrics.
2. How can I block ZutrixBot?
To block ZutrixBot, add the following line to your robots.txt file:
User-agent: ZutrixBot
Disallow: /
User-agent: ZutrixScraper
Disallow: /
3. How do I verify ZutrixBot’s authenticity?
ZutrixBot requests can be verified via reverse DNS lookups for domains ending in:
• zutrix.com
• zutrix.net
Contact Us
If you have any questions or concerns about ZutrixBot, feel free to reach out to our support team:
• Email: [email protected]
• Website: https://zutrix.com/robot