Overseas access: www.kdjingpai.com
Bookmark Us
Current Position:fig. beginning " AI Answers

如何在自己的设备上运行MiniMind-V的完整训练流程?

2025-08-25 1.1 K

运行MiniMind-V需要按照环境配置→数据准备→模型训练→效果测试四个步骤进行系统化操作:

Environment Configuration

  • utilizationgit clone下载项目代码,建议Python≥3.9环境
  • 通过清华镜像源安装依赖:pip install -r requirements.txt -i https://pypi.tuna.tsinghua.edu.cn/simple
  • 下载CLIP视觉编码器到./model/vision_modelcatalogs

Data preparation

  • establish./dataset目录并下载约5GB的预训练数据
  • 需包含三种JSONL格式标注文件(预训练/单图微调/多图微调)和对应图片
  • 图像默认会resize到224×224分辨率

model training

典型流程包含两个阶段:

  1. pre-training: Runtrain_pretrain_vlm.py冻结CLIP只训练投影层(约1小时/epoch)
  2. trimming: Implementationtrain_sft_vlm.py解冻语言模型进行端到端训练

Effectiveness Test

支持两种验证方式:

  • 命令行交互:python eval_vlm.py加载训练权重
  • Web界面:python web_demo_vlm.py启动本地服务进行可视化测试

关键提示:若显存不足(<24GB),需在LMConfig.py中调小batch_size参数。

Recommended

Can't find AI tools? Try here!

Just type in the keyword Accessibility Bing SearchYou can quickly find all the AI tools on this site.

Top

en_USEnglish