What is the YuJa EqualGround Crawler?
The YuJa EqualGround Accessibility Governance Platform crawler is an agentic accessibility and compliance bot that unifies accessibility, analytics, SEO, and content performance monitoring. YuJa EqualGround can scan multiple websites, embedded documents, domains, subdomains, and as few or as many pages and documents as an organization wants.
It can be identified through the user agent string, YuJaEqualGroundBot/2.0.
Overview
YuJa EqualGround uses distinct scanning engines to crawl websites and evaluate accessibility, analytics, SEO, and content performance. It is capable of scanning both publicly accessible websites and internally hosted environments by utilizing secure credential management to access content behind login screens. This article explains how to identify the crawler, how it accesses websites, and how it can be limited or blocked if needed.
Use Cases
The YuJa EqualGround crawler can be used to scan:
- Public websites
- Internal websites
- Web applications (through the YuJa WebFlow Accessibility Module)
- Embedded documents within web pages, including:
- DOC/DOCX/ODT/RTF
- PPT/PPTX/ODP
- XLS/XLSX/ODS
- GIF
When performing a crawl, YuJa EqualGround analyzes:
- Website accessibility
- SEO
- Performance
- Document accessibility
- Visitor engagement
- Usability
Identifying the EqualGround Crawler
The full user agent name of the EqualGround crawler can vary on some sites, but the most common identifier is:
- YuJaEqualGroundBot/2.0 (+https://support.yuja.com/hc/en-us/articles/41690190931735; mailto:support@yuja.com)
How the YuJa EqualGround Crawler Accesses Your Site
When accessing a site, YuJa EqualGround starts at a configured entry point URL and navigates the site based on the specified scan depth (the number of clicks allowed from the entry point). However, YuJa EqualGround will not access external links that fall outside of the website's primary domain, and it will not crawl any pages that return a 400 HTTP status code.
To access protected or internal content, EqualGround utilizes a secure credential management feature. Organizations can securely input the necessary login credentials, such as a username and password, directly into the platform. This allows the scanner to bypass login screens and evaluate protected web pages, if desired.
How to Block the YuJa EqualGround Crawler from Visiting Your Site
The YuJa EqualGround crawler is restricted to domains explicitly configured within YuJa EqualGround accounts. If your domain is being crawled, it is highly likely that your organization maintains a contract with YuJa EqualGround and utilizes these crawls to obtain essential insights for website enhancement.
To block or restrict YuJa EqualGround from accessing specific parts of a site, administrators can configure the scan's scope and depth settings. You can do this in a few ways:
- Exclude Specific Areas: You can explicitly configure the scanner to exclude certain directories or individual pages that you do not want to be evaluated.
- Limit Scope and Depth: Instead of crawling an entire site, you can restrict the scanner to only evaluate specific subdomains or paths. You can also limit the "scan depth," which restricts the number of clicks the crawler is allowed to make from the initial entry URL.
Additionally, YuJa EqualGround has built-in limitations and will automatically block itself from crawling certain pages:
- It will not access external links that fall outside of the website's primary domain.
- It will not crawl any pages that return a 400 HTTP status code.
Contact us
If you believe YuJa EqualGround should not be crawling your domain, please contact YuJa EqualGround technical support.