Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

llama-cpp-python

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

29

Base only

Active filters: llama-cpp-python

asumansaree/trendyol_llm_7b_chat_v1_0_gguf

Text Generation • 7B • Updated Jun 20, 2025 • 13

Sakalti/nekomata-7b-gguf

Text Generation • 8B • Updated Oct 17, 2024 • 2

erdemyavuz/llama-3-8b-chat-doctor

8B • Updated Mar 3 • 21 • 1

seasparks/Llama-3.1-8B-Instruct-LegalCite-gguf

Text Generation • 8B • Updated Apr 7, 2025 • 63

Prince-1/orpheus_3b_0.1_GGUF

Text-to-Speech • 3B • Updated May 1, 2025 • 115

marcorez8/llama-cpp-python-windows-blackwell-cuda

Updated Jun 2, 2025 • 4

dougeeai/llama-cpp-python-wheels

Updated Nov 9, 2025 • 11

terasut/typhoon-si-med-thinking-4b-research-preview-GGUF

Text Generation • 4B • Updated Jan 21 • 24

intrect/VELA

Text Generation • 8B • Updated Apr 1 • 299 • 2

Habibur2/Phi-3.5-mini-GGUF

Text Generation • 4B • Updated Jan 30 • 33

Habibur2/Qwen2.5-0.5B-GGUF

Text Generation • 0.5B • Updated Jan 30 • 34 • 1

Habibur2/Qwen2.5-Math-1.5B-GGUF

Text Generation • 2B • Updated Jan 31 • 37 • 2

chronorus/chatbot-poc

3B • Updated Feb 1 • 4

trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda

ClaireLee2429/gemma-2b-recipes-gguf

Text Generation • 3B • Updated Feb 17 • 9

James040/llama-cpp-python-wheels

pushkarsharma/LegalSahayk_q4_k_m

Text Generation • 8B • Updated Mar 12 • 12

jeremygracey-ai/FetchMerck_AI

Text Generation • 7B • Updated Apr 23 • 1

AaryanK/ModelGate

Text Classification • 2B • Updated Mar 22 • 23 • 4

enwrit/writ-lint-0.8B

Text Generation • 0.8B • Updated Mar 25 • 4

ericflo/qwen3-0.6b-summarizer

Summarization • 0.6B • Updated Apr 5 • 30

kertpoli/lua-coder-qwen25-3b-gguf

Text Generation • 3B • Updated Apr 15 • 26

neuralbroker/blitzkode

Text Generation • 2B • Updated 27 days ago • 169

flwrlabs/Lizzy-7B-GGUF

Text Generation • 7B • Updated 18 days ago • 418 • 7

maytman12/s2s-complete-setup

Automatic Speech Recognition • Updated Apr 28 • 19 • 1

Theogott/spr-qwen3_5-9b-dora-vramsafe-gguf

Text Generation • 9B • Updated May 1 • 40 • 1

pragnyanramtha/gguf-chat-template-truncation-poc

1.03M • Updated May 12 • 39

Roopalgn/sahayak-tb-gemma4-e2b-gguf

Text Generation • 5B • Updated 25 days ago • 727

build-small-hackathon/noir-verdict-nemotron-4b-gguf

Text Generation • 4B • Updated about 5 hours ago