Application Scenarios and Industry Impact
Anubis is designed to directly address the current industry pain point of large-scale data crawling in the AI industry. In the context of large models such as GPT that require massive amounts of training data, its application value is reflected in:
- Protecting original content from gratuitous crawling for AI training
- Reduce server load and save bandwidth costs
- Providing small websites with the technical tools to take on tech giants
Typical examples include personal blogs protecting original articles, corporate intranets segregating sensitive data, and research organizations protecting proprietary data sets. In some jurisdictions, this technology may also help websites comply with data protection regulations such as GDPR.
Industry analysts believe that tools like Anubis represent a new direction in Web protection technology - a shift from passive defenses to actively setting the technical bar. As the AI ethics controversy intensifies, these types of programs are likely to become more widely used.
This answer comes from the articleAnubis: Interfering with AI Crawler Crawling by Proof of WorkloadThe
English 
简体中文 
日本語 
Deutsch 
Português do Brasil