O

OmniAI

Discover the best AI tools. Curated directory of 700+ tools across 22 categories.

Categories

Chat Image Gen Code & IDE Video Gen Music & Audio Writing Marketing Productivity

Links

Submit a Tool Search Tools API Docs

Newsletter

Get new AI tools delivered to your inbox weekly.

OmniAI Directory — Built by Milon

llama.cpp — AI Tool Review & Pricing | OmniAI

llama.cpp

ELITE

4.6(0 reviews)

free 💰

About

High-performance C++ implementation of LLM inference. Run Llama, Mistral, and other models on CPU with state-of-the-art quantization.

Features

Extremely fast CPU inference using AVX2, NEON, and other SIMD optimizations.
Support for 2-bit to 8-bit GGUF quantization for model size reduction.
OpenAI-compatible API endpoint for use with custom clients like SillyTavern or Oobabooga.
Multimodal support for models like LLaVA and BakLLaVA.
Cross-platform support: Windows, macOS, Linux, and even iOS/Android via library integration.

Links

Categories

💻 Coding & Development

Reviews

4.6

Write a Review

Your Name

Rating

Your Review

Get new AI tools weekly

Subscribe to our newsletter and never miss a tool.

Stats

Rating

4.6

Reviews0

Monthly Visits0

Pricingfree

Related Tools

VS Code

★★★★4.3

CodeGPT

★★★★4.2

Zed

★★★★4.1

Dependabot AI

★★★★4.1

Get new AI tools weekly

Subscribe to our newsletter and never miss a tool.

Similar Tools

VS Code

Microsoft's AI-powered code editor. Extensible editor with Copilot integration.

Coding & Development

CodeGPT

AI coding assistant integrated with VS Code for code generation and explanation.

Coding & Development

Zed

AI-powered code editor from the Atom creators. High-performance collaborative editing.

Coding & Development

Dependabot AI

Automated dependency update tool by GitHub. Keeps dependencies secure and up-to-date with AI-powered PRs.

Coding & Development

Sublime Text

AI-enhanced fast code editor. Lightweight with powerful features and packages.

Coding & Development

Renovate AI

Automated dependency update tool (Whitesource). Configure and customize dependency updates across repositories.

Coding & Development

O

OmniAI

Discover the best AI tools. Curated directory of 700+ tools across 22 categories.

Categories

Chat Image Gen Code & IDE Video Gen Music & Audio Writing Marketing Productivity

Links

Submit a Tool Search Tools API Docs

Newsletter

Get new AI tools delivered to your inbox weekly.

OmniAI Directory — Built by Milon