--- license: mit tags: [rag, vismem, fine-tuning] --- # VisMem RAG Fine-tuned: `gemma-3-270m-vismem-rag-QA-1-vismem-rag-0322-1623-vismem-rag-0323-1532` ## Inference ```python import requests from vismem_core import VisMem from sentence_transformers import SentenceTransformer from transformers import pipeline # 1. Load VisMem data = requests.get( "https://huggingface.co/datasets/broadfield-dev/gemma-3-270m-vismem-rag-QA-1-vismem-rag-0322-1623-vismem-kb-0323-1532/resolve/main/vismem.png", headers={"Authorization":"Bearer "}).content mem = VisMem.from_png_bytes(data) emb = SentenceTransformer('all-MiniLM-L6-v2') # 2. RAG query q_vec = emb.encode([your_question])[0] results = mem.search(q_vec, k=3) context = "\n---\n".join(results) # 3. Prompt system = ( "You are a helpful AI Assistant with visual memory.\n" "### RAG MEMORY (Vector Database):\n" "[Uploaded Doc]: None\n" f"[Knowledge Base]: {context}\n" "### EPISODIC MEMORY (Past Chat):\n" "[History]: None" ) pipe = pipeline("text-generation", model="broadfield-dev/gemma-3-270m-vismem-rag-QA-1-vismem-rag-0322-1623-vismem-rag-0323-1532") print(pipe([ {"role":"system","content":system}, {"role":"user","content":your_question} ], max_new_tokens=200)) ``` ## Config `{ "dataset_name": "AnonymousSub/MedQuAD_47441_Context_Question_Answer_Triples", "rag_columns": [ "Contexts", "Questions" ], "question_col": "Questions", "answer_col": "Answers", "split": "train", "data_config": null, "total_kb_docs": 47441, "vismem_dim": 384, "vismem_width": 13056, "vismem_height": 13056, "kb_repo": "broadfield-dev/gemma-3-270m-vismem-rag-QA-1-vismem-rag-0322-1623-vismem-kb-0323-1532" }`