Release 2.0 Latest
Changelog: Release 2.0
Added:
Model Configuration UI: Added dynamic dropdown selectors to the sidebar to switch between Chat and Vision models at runtime.
ChromaDB Document Clearing: Added a "Clear Synced Documents" control to the sidebar to clear user-specific vector embeddings from ChromaDB.
Optimized:
Verbatim Image Scaling: Implemented automatic scaling for high-resolution images (max 1024px) to drastically reduce vision tile segmentation, yielding an 8x-16x speedup during document syncs.
Memory Lifecycle Management: Enforced immediate model unloading with keep_alive=0 on Ollama client calls, preventing multiple models from residing in memory simultaneously.
Hardened System Constraints: Upgraded RAG prompts to prevent hallucinations, strictly forcing the model to state "I do not know" when facts are missing from the context.
Systematic Sidebar OCR: Configured the vision engine prompt to systematically transcribe sidebars and secondary sections (such as Languages, Packages, and Contributors).
Broadened Search Window: Increased retrieval search neighbors (k_neighbors) to 15 to ensure matching data chunks are not crowded out by duplicates.
Fixed:
Streamlit Session State Crash: Resolved a KeyError and AttributeError by initializing the standard model in the Streamlit session state on page load.
Container OOM Failures: Resolved Docker container terminations (Exit Code 137) by lowering the peak RAM and VRAM footprint.
Dependency Cleanup: Streamlined the deployment footprint by removing the obsolete CPU-based Tesseract OCR packages and configurations from the Dockerfile and requirements.txt.