There are three actions that need to be completed when a Hugging Face 『gated dataset』 error is encountered:
- Log in to your Hugging Face account atSettings-Tokens pageCreating access tokens
- Set the token variable in the terminal environment where OpenBench is running:
export HF_TOKEN='hf_xxxxxxx' - Re-execute the original review command. This design is due to the fact that some benchmarking tests (e.g., certain math competition datasets) involve copyright protection, and Hugging Face requires the user to explicitly agree to the terms of use. It is worth noting that this configuration is persisted with the environment variables and does not need to be repeated for subsequent evaluations in the same session.
This answer comes from the articleOpenBench: an open source benchmarking tool for evaluating language modelsThe
May not be reproduced without permission:AI productivity tools " How to deal with Hugging Face dataset access issues when running OpenBench?
English 
简体中文 
日本語 
Deutsch 
Português do Brasil