Anubis Principles and Core Functions
Anubis is a Go language open source tool developed by the TecharoHQ team in Canada, whose core technology is to embed SHA256 Proof-of-Work challenges in HTTP requests. The design is a direct response to the abuse of AI crawlers on the modern Internet, which often ignore traditional safeguards such as robots.txt files.
The system works by requiring that all access requests must first complete a computationally intensive SHA256 hash computation task. For the average browser user, this computation can be done in milliseconds; however, for large-scale deployments of AI crawlers, this computation can significantly increase their operational costs.
Anubis has the following features that differentiate it from traditional anti-climbing solutions such as Cloudflare:
- Fully open-source solution that allows users to customize freely
- Seamless integration with existing systems using Docker containerized deployment
- Includes health check feature to ensure service stability
- Active blocking of search engines for privacy-sensitive scenarios
This answer comes from the articleAnubis: Interfering with AI Crawler Crawling by Proof of WorkloadThe
English 
简体中文 
日本語 
Deutsch 
Português do Brasil