I want to change the LLM embedding model to my company LLM embedding model

[mzahid09]

Hi,

I want to change the embedding model to use my own company local LLM. Where do I start?
I don't want to use Ollama as the embedding model and would like to update code to use my own company model.

[KevinHuSh]

Is it OpenAI API compatible?
If it is, you could connect by this.

[Yvonne9803]

Hi,
There is already a knowledge base created based on the Ollama embedding model. After changing to vLLM embedding model and chat model, can this knowledge base be used normally