Skip to content

ToolNeuron tells me 'Embedding model not loaded" even though I have a rag model already installed. #116

Description

Hi, I was trying to test out the RAG feature by adding a document, and while adding a document, it told me that the embedding model wasn't loaded. I had already installed (BGE, Qwen Embedding) already, but it still tells me. I also changed from picking a RAG model from 'None (auto-pick)" to one of my models. It still didn't work. For some reason, Nomic Embed text (i downloaded it from the Store) works, but idk why. I tried importing the HF repo to the store, but it didnt have the 'Embedding" tag, so it makes me a download a model instead of an embedding. Please help. Also it tells me to install EmbeddingGemma from the store, but i don't seem to find that.

Downloaded my models from here:
BGE-m3: https://huggingface.co/gpustack/bge-m3-GGUF
Qwen Embedding 4B: https://huggingface.co/Qwen/Qwen3-Embedding-4B-GGUF

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions