phi-4-heretic-GGUF

GGUF quantized versions of p-e-w/phi-4-heretic from "The Bestiary" collection.

Model Description

This is a GGUF conversion of the phi-4-heretic model, which is an abliterated (uncensored) version of Microsoft's Phi-4 model. The model has had its refusal mechanisms removed, making it more willing to engage with any prompt.

Original Model: p-e-w/phi-4-heretic Collection: The Bestiary by p-e-w

Quantization Formats

This repository contains 4 quantization levels:

File	Size	Description	Use Case
phi-4-heretic-f16.gguf	28GB	Full 16-bit precision	Best quality, highest memory usage
phi-4-heretic-Q8_0.gguf	15GB	8-bit quantization	High quality, good balance
phi-4-heretic-Q5_K_M.gguf	9.9GB	5-bit quantization	Balanced quality/size
phi-4-heretic-Q4_K_M.gguf	8.5GB	4-bit quantization	Smallest size, good quality

Recommended: Q4_K_M for most users (best balance of quality and size)

Usage

With Ollama

1. Download the GGUF file you want to use
2. Create a Modelfile:

FROM ./phi-4-heretic-Q4_K_M.gguf

TEMPLATE """{{ if .System }}<|im_start|>system<|im_sep|>{{ .System }}<|im_end|>{{ end }}{{ if .Prompt }}<|im_start|>user<|im_sep|>{{ .Prompt }}<|im_end|>{{ end }}<|im_start|>assistant<|im_sep|>{{ .Response }}<|im_end|>"""

PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
PARAMETER temperature 0.7
PARAMETER top_p 0.9
PARAMETER num_ctx 8192

3. Import to Ollama:

ollama create phi-4-heretic:Q4_K_M -f Modelfile

4. Run:

ollama run phi-4-heretic:Q4_K_M

With llama.cpp

./llama-cli -m phi-4-heretic-Q4_K_M.gguf -p "Your prompt here" -n 512

With Open WebUI

Once imported to Ollama, the model will automatically appear in the Open WebUI model dropdown.

Conversion Details

• Converted using: llama.cpp (latest)
• Conversion date: 2025-11-21
• Base format: FP16 GGUF
• Quantization method: llama-quantize

Important Note

This is an uncensored model with refusal mechanisms removed. Use responsibly and in accordance with applicable laws and regulations.

License

Inherits the MIT license from the base Phi-4 model.

Credits

• Original model: Microsoft (Phi-4)
• Abliteration: p-e-w (The Bestiary)
• GGUF conversion: cybrown