To install and configure RAGLight, proceed as follows:
- Installing Python and dependencies: Ensure that Python 3.8 or later is installed on your system, and then run the
pip install raglight
The HuggingFace embedding model is available in the HuggingFace website. To use the HuggingFace embedding model, you also need to install thesentence-transformers
The - Installing Ollama or LMStudio: Download and install Ollama or LMStudio, then pull the desired model (e.g.
ollama pull llama3
). - Configuration environment: Create the project folder and prepare the knowledge base data (local folder or GitHub repository URL).
- Initializing the RAG Pipeline: By
RAGPipeline
Specify the knowledge base, model name (e.g.llama3
) and search parameters (such ask=5
).
This answer comes from the articleRAGLight: Lightweight Retrieval Augmentation Generation Python LibraryThe