安装和部署Hunyuan-A13B需要以下步骤和系统配置:
System Requirements:
- Python 3.10 or higher
- 推荐使用NVIDIA A100等高性能GPU(16GB以上显存)
- 支持PyTorch 2.5.1和Hugging Face Transformers库的环境
Installation Steps:
- Cloning GitHub repositories:
git clone https://github.com/Tencent-Hunyuan/Hunyuan-A13B.git
cd Hunyuan-A13B - Install dependent libraries:
pip install torch==2.5.1 transformers
pip install -r requirements.txt - 下载模型权重(可选不同版本):
huggingface-cli download tencent/Hunyuan-A13B-Instruct
- Setting environment variables:
export MODEL_PATH="tencent/Hunyuan-A13B-Instruct"
- 使用示例代码加载模型并运行推理
This answer comes from the articleHunyuan-A13B: Efficient Open Source Large Language Modeling with Ultra-Long Context and Intelligent Reasoning SupportThe