Instructions to use DJLougen/Qwen3.8-Flash-Next-Mooney with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use DJLougen/Qwen3.8-Flash-Next-Mooney with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0 # Run inference directly in the terminal: llama cli -hf DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0 # Run inference directly in the terminal: llama cli -hf DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0 # Run inference directly in the terminal: ./build/bin/llama cli -hf DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0
Use Docker
docker model run hf.co/DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0
- Llama new
- LM Studio
- Jan
- vLLM
How to use DJLougen/Qwen3.8-Flash-Next-Mooney with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "DJLougen/Qwen3.8-Flash-Next-Mooney" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DJLougen/Qwen3.8-Flash-Next-Mooney", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0
- Ollama
How to use DJLougen/Qwen3.8-Flash-Next-Mooney with Ollama:
ollama run hf.co/DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0
- Unsloth Desktop
- Pi
How to use DJLougen/Qwen3.8-Flash-Next-Mooney with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use DJLougen/Qwen3.8-Flash-Next-Mooney with Docker Model Runner:
docker model run hf.co/DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0
- Lemonade
How to use DJLougen/Qwen3.8-Flash-Next-Mooney with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0
Run and chat with the model
lemonade run user.Qwen3.8-Flash-Next-Mooney-Q2_0
List all available models
lemonade list
- Hermes Agent
How to use DJLougen/Qwen3.8-Flash-Next-Mooney with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use DJLougen/Qwen3.8-Flash-Next-Mooney with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "DJLougen/Qwen3.8-Flash-Next-Mooney:Q2_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Commit History
-
Card: buun-llama-cpp measured MTP settings (n-max 2, -t 16)
Verified signature84f867d -
Upload README.md with huggingface_hub
Verified signature1a2d422
-
Speed: re-measured on engine c9e0679f (exact MTP, draft 3 default, 128-token runs, all contexts); correct the Unsloth speed comparison; memory at 256k
Verified signature0b76f49
-
Card: correct MTP identity claim (approximate verify in 8811b9a7; exact since c9e0679f)
Verified signature11144ce -
Card: MTP speeds up greedy requests only; sampled requests fixed in engine 2f623be8
Verified signature5b0743c -
Rename files for the Hub GGUF picker: shards carry the expert type (PQ2_0), mmproj/MTP drop quant labels; content and sha256 unchanged
Verified signature6662a6a -
Charts: black-and-white Mooney style to match the banner (same data)
Verified signature394c679 -
Charts: fix needle counts (10/10 per length) and percent scale; cleaner memory chart
Verified signature0e993ba -
Chart: cleaner memory plot (Spark capacity band, label off the bars)
Verified signature46fe040 -
card: fast engine now supports image input (vision merge on lbf/pq2-rot)
Verified signature7c4884d -
Upload assets/long_context.png with huggingface_hub
Verified signatureb0e8536 -
Upload assets/memory.png with huggingface_hub
Verified signaturefaf9f41 -
Upload assets/spark_decode.png with huggingface_hub
Verified signatureed11f70 -
card/plots: 256k campaign numbers, needle plot, fast-engine memory
Verified signature5695074 -
card: public quickstart (mooney-spark), runtime repos linked, markers for fast-engine images + 256k
Verified signature16a451d -
Card: drop pending Spark verifier mentions
Verified signature7358d13 -
Card: replace '~' with '≈' (paired tildes rendered as strikethrough)
Verified signature57df28d -
Card: thank-you to Zach Mueller and Lambda moved to the top, link Zach
Verified signature8618868 -
Card: more prominent thanks to Zach Mueller and Lambda
Verified signatureeb8a98d -
Chart: x-limits
Verified signature9327f34 -
Card: corrected fast-engine numbers (non-repetitive prompts), withhold 32k until long-prompt fix, text-only note
Verified signature31486bb -
Card: correct the 4-bit comparison wording, MTP limitation, long-context limitation; chart legend
Verified signature3cfc8f8 -
Card refresh for run2 (NQ8_0): new quality numbers, plots regenerated, Spark rows marked pending
Verified signature8b4931f -
Add MTP head (Unsloth Q8_0, pinned sha256 5ff54097, unmodified) + manifest
Verified signature9056147 -
Card refresh for run2 (NQ8_0): new quality numbers, plots regenerated, Spark rows marked pending
Verified signature185ded4 -
Shard 1: compress_ratios corrected to canonical QSA schedule (12 layers); manifest updated
Verified signature93ff2db -
Card refresh for run2 (NQ8_0): new quality numbers, plots regenerated, Spark rows marked pending
Verified signature8160275
-
Card refresh for run2 (NQ8_0): new quality numbers, plots regenerated, Spark rows marked pending
Verified signature6292b1c -
Mooney run2: 8-bit non-experts (NQ8_0) — replaces run1 shards in-place; PLE shard byte-identical (deduped); manifest updated
Verified signature80a153b -
Card: title+headline first, then banner, accuracy chart, thanks and support
Verified signature1b0fd0a -
Card: social-share thumbnail
Verified signature96434d4 -
Card: hero image, labeled bit sizes, resident-only memory chart
Verified signature60e3c7f -
Card: headline bit sizes, plots, reorder, support line, drop ISTA context
Verified signature620ae13 -
Card: remove PTQ baseline row, column and comparisons
Verified signature9a3818b -
Card: Spark suite result 476/536, --cache-ram 0, load 119-133s
Verified signature3543e5d -
Card: base_model metadata, PLE wording, ISTA link, TODO banner note
Verified signaturea6497b9 -
README + manifest; shard 1 stamped general.name/repo_url
Verified signature76b2889 -
Rename to Mooney; shard 1 re-emitted with general.name=Qwen3.8-Flash-Next-Mooney
Verified signature64a1b52 -
Upload Qwen3.8-Flash-Next-lowbitFlash-PQ2_0-00004-of-00004.gguf with huggingface_hub
Verified signaturee5412cd -
Upload Qwen3.8-Flash-Next-lowbitFlash-PQ2_0-00003-of-00004.gguf with huggingface_hub
Verified signature26ea1cd -
Upload Qwen3.8-Flash-Next-lowbitFlash-PQ2_0-00002-of-00004.gguf with huggingface_hub
Verified signature631c67f -
Upload Qwen3.8-Flash-Next-lowbitFlash-PQ2_0-00001-of-00004.gguf with huggingface_hub
Verified signaturebd85555 -
Upload manifest.json with huggingface_hub
Verified signature162af06 -
Upload mmproj-Qwen3.8-Flash-Next-BF16.gguf with huggingface_hub
Verified signature33fa60f -
Upload LICENSE with huggingface_hub
Verified signature863c619 -
initial commit
Verified signature33ceb7b