Complete program for local deployment
Private Deployment LM Speed supports both Docker containerization and native Node.js:
Containerized Deployment Solutions
- Ensure that Docker v20+ and docker-compose are installed
- After cloning the project repository from GitHub, configure it as per the documentation
docker-compose.ymlThe database parameters in the - fulfillment
docker-compose up -dStart the service stack, exposing port 8650 by default
Native Deployment Program
- Node.js v16+ and PostgreSQL need to be pre-installed.
- pass (a bill or inspection etc)
.envConfiguration file to set the database connection string and JWT key - Ensure high availability of services using process managers such as PM2
Both require attention:Production environment deploymentIt is recommended to configure NGINX reverse proxy and Let's Encrypt certificates, as well as set reasonable PostgreSQL connection pool parameters (20-50 connections recommended) to cope with high concurrency test scenarios. The test data will be persisted to the volume mounted database, regular backups are recommended through pg_dump.
This answer comes from the articleLM Speed: Rapidly Test Large Model API PerformanceThe
May not be reproduced without permission:AI productivity tools " How do I locally deploy an LM Speed test environment?
