Overseas access: www.kdjingpai.com
Bookmark Us
Current Position:fig. beginning " AI Answers

What big language models does KBLaM currently support? Will it be extended to more models in the future?

2025-08-27 1.6 K
Link directMobile View
qrcode

List of supported models

  • Meta Series:: Llama-3-8B-Instruct, Llama-3.2-1B-Instruct
  • Microsoft Series: Phi-3-mini-4k-instruct (specially optimized version)

Extensibility note

As a result of the adoption ofadapter mechanism, which theoretically supports any Transformer-based model. Current limitations mainly come from: 1) the need to rewrite thesrc/kblam/models/Adapter code under 2) Model hidden layer dimensions need to match knowledge vectors. New model adaptations contributed by the community are being gradually merged.

Technology Roadmap

According to the GitHub discussion forum, the next step will be to support: 1) Mistral architecture 2) Chinese models such as Qwen 3) multimodal extensions. Developers can modify theKeyValueEmbedderclass to implement custom integrations.

Recommended

Can't find AI tools? Try here!

Just type in the keyword Accessibility Bing SearchYou can quickly find all the AI tools on this site.

Top

en_USEnglish