Text Gen WebUI (oobabooga)

About

Popular web interface for running LLMs locally. Supports multiple model formats, LoRA, extensions, and chat modes.

• Support for over 10 model loaders: llama.cpp, ExLlama, AutoGPTQ, AWQ, vLLM, and more
• Multiple UI modes: chat, chat-instruct, notebook, default, and a full REST API with streaming support
• LoRA (Low-Rank Adaptation) loading and management for adding customized behavior to base models
• Extension system with built-in plugins for text-to-speech, character cards, search, and AI response editing
• Comprehensive parameter controls: temperature, top-p, repetition penalty, context length, and quantization selection