Instructions to use PeppX/Ornith-1.0-9B-Uncensored-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use PeppX/Ornith-1.0-9B-Uncensored-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M
Use Docker
docker model run hf.co/PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use PeppX/Ornith-1.0-9B-Uncensored-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "PeppX/Ornith-1.0-9B-Uncensored-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PeppX/Ornith-1.0-9B-Uncensored-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M
- Ollama
How to use PeppX/Ornith-1.0-9B-Uncensored-GGUF with Ollama:
ollama run hf.co/PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M
- Unsloth Desktop
- Pi
How to use PeppX/Ornith-1.0-9B-Uncensored-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use PeppX/Ornith-1.0-9B-Uncensored-GGUF with Docker Model Runner:
docker model run hf.co/PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M
- Lemonade
How to use PeppX/Ornith-1.0-9B-Uncensored-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Ornith-1.0-9B-Uncensored-GGUF-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use PeppX/Ornith-1.0-9B-Uncensored-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use PeppX/Ornith-1.0-9B-Uncensored-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "PeppX/Ornith-1.0-9B-Uncensored-GGUF:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Ornith 1.0 9B โ Uncensored & Abliterated (GGUF)
0% refusal rate. 0.0827 KL divergence. The strongest uncensored 9B model you can run locally. Since this model is original base (no fine-tune) just with safety vectors steered - it will likely give a safe output without any refusal until you customize it's systemprompt to be harsh or uncensored.
Abliterated via surgical removal of the refusal direction โ no fine-tuning, no quality loss, no degradation on coding or reasoning. This is the same Qwen 3.5 9B intelligence with the safety switch permanently off.
| Metric | Value |
|---|---|
| Refusal Rate | 0% (0/100) |
| KL Divergence | 0.0827 (target <0.3) |
| Method | Abliterix TPE (50 trials, Trial #42) |
| Base | deepreinforce-ai/Ornith-1.0-9B |
| Architecture | Qwen 3.5, 32 layers, 9B dense |
| Context | 262,144 tokens |
Available Quants
| Quant | Size | Speed (RTX 3090) | Quality | Fits on |
|---|---|---|---|---|
| Q4_K_M | 5.6 GB | ~92 t/s | Good | 6 GB VRAM, Steam Deck, most users |
| Q5_K_M | 6.5 GB | ~85 t/s | Very Good | 8 GB VRAM, best speed/value |
| Q6_K | 7.0 GB | ~79 t/s | Excellent | 8-12 GB VRAM |
| Q8_0 | 9.5 GB | ~68 t/s | Near-lossless | 12-16 GB VRAM (may not fit with other apps) |
Quick Start
llama.cpp
llama-cli -m ornith-9b-uncensored-Q4_K_M.gguf -p "Write a story about..."
LM Studio
Drag any .gguf into LM Studio. Auto-configured.
Ollama
Create a file called Modelfile:
FROM ./ornith-9b-uncensored-Q4_K_M.gguf
TEMPLATE "{{ .Prompt }}"
Then:
ollama create ornith-9b-uncensored -f Modelfile
ollama run ornith-9b-uncensored
Why This Is The Best Uncensored 9B
- 0% refusal โ will not decline any request. Period.
- 0.0827 KL โ virtually identical to the base model on all benign tasks. You lose nothing.
- Abliterated, not fine-tuned โ surgical weight orthogonalization removes only the refusal direction. Coding, math, reasoning, and instruction following are untouched.
- Full 262K context โ not truncated, not nerfed.
- Qwen 3.5 base โ one of the strongest 9B architectures for agentic and coding tasks.
Why Pure Abliteration (Not DPO)
Some uncensored variants use DPO fine-tuning to reduce moralizing further, but this comes at a cost: the fine-tuning alters the model's behavior, style, and knowledge beyond just removing refusals. DPO'd models often require fragile sampling parameters (e.g. exact repeat_penalty=1.05 or they break) and can develop quirks the base model never had.
This model is pure abliteration โ weight orthogonalization only, zero training. That means:
- Reasoning 100% intact โ same GSM8K, same coding, same agentic performance as the base Ornith 1.0
- No special sampling required โ use whatever parameters you normally use for Qwen 3.5
- KL divergence 0.0827 โ lowest among all Ornith uncensors, nearly indistinguishable from base on benign tasks
- No behavioral surprises โ the model IS the base model, just without a refusal reflex
If you want the base model exactly as-is but uncensored โ this is it. If you need even lower moralizing and are willing to accept behavioral changes, DPO variants exist elsewhere.
Source Model
PeppX/Ornith-1.0-9B-Uncensored โ bf16 safetensors version also available.
Quantized with llama.cpp build 9850. Abliterated with Abliterix v1.9.0. 400 harmful + 400 harmless prompts. Judge: Gemma 4 26B via Featherless AI. Hardware: RTX 3090 24GB.
- Downloads last month
- 2,586
Model tree for PeppX/Ornith-1.0-9B-Uncensored-GGUF
Base model
ornith-ai/Ornith-1.0-9B