The following steps and system configurations are required to install and deploy Hunyuan-A13B:
System Requirements:
- Python 3.10 or higher
- Recommended high-performance GPUs such as NVIDIA A100 (16GB or more video memory)
- Environments supporting PyTorch 2.5.1 and the Hugging Face Transformers library
Installation Steps:
- Cloning GitHub repositories:
git clone https://github.com/Tencent-Hunyuan/Hunyuan-A13B.git
cd Hunyuan-A13B - Install dependent libraries:
pip install torch==2.5.1 transformers
pip install -r requirements.txt - Download model weights (optional different versions):
huggingface-cli download tencent/Hunyuan-A13B-Instruct - Setting environment variables:
export MODEL_PATH="tencent/Hunyuan-A13B-Instruct" - Use the sample code to load the model and run the inference
This answer comes from the articleHunyuan-A13B: Efficient Open Source Large Language Modeling with Ultra-Long Context and Intelligent Reasoning SupportThe
May not be reproduced without permission:AI productivity tools " How to install and deploy Hunyuan-A13B and what system requirements do I need to fulfill?
