RAG Knowledge Assistant

Python

Retrieval-Augmented Generation system for intelligent document Q&A

Tech Stack

Python 3.12
FastAPI
PyTorch
PostgreSQL
Vector Store

Features

Document chunking & embedding
Vector similarity search
LLM-powered Q&A responses
REST API interface
Context-aware retrieval
FastAPI async endpoints

Code Sample

rag.py
from fastapi import FastAPI
from sentence_transformers import SentenceTransformer
import numpy as np

app = FastAPI()
embedder = SentenceTransformer("all-MiniLM-L6-v2")

@app.post("/query")
async def query_documents(question: str):
    query_embedding = embedder.encode(question)
    context = vector_store.similar_search(query_embedding, k=5)
    response = await llm.generate(
        prompt=f"Answer based on context: {context}",
        question=question
    )
    return {"answer": response, "sources": context}
View Source Docker Hub Live Demo