Instructions to use Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8080/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Mihai-LeanZero/Qwen3.5-9B-Atlassian-Q4-mlx" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Qwen3.5-9B-Atlassian-Q4-mlx
Smaller member: the same trained Qwen3.5-9B at plain 4-bit (group size 64).
Release v0.5 (family release; this 9B member is unchanged since v0.3, round T1-9B; its second round, trained on the 27B's v0.4 mix, scored 18 of 25 complete apps and 19 of 25 manifests, below the 20/20 publish bar, so it was not released). The full write-up, with every test explained and every round compared, is on LeanZero's page: leanzero.net/portfolio/atlassian-models. The same evidence is reproduced below.
Built by LeanZero, the people behind CogniRunner (AI workflow rules for Jira), Sentinel Vault (Confluence attachment governance), LeanZero Management (PPM for Jira Cloud) and Atlassian migrations. Quantised with mlx-node and mlx-lm, trained with mlx-lm, served and evaluated with LeanZero's Rapid-MLX fork (engine wheel), all on one Apple Silicon Mac Studio.
What it is
The merged bf16 weights quantised with plain 4-bit (group size 64) by mlx-lm, MTP head as mtp.safetensors. Agreement with base+adapter: top-1024 KLD 0.1734, top-1 90.49% (the 8-bit: 0.0537 / 99.14%). Identifier probe on this quantisation, thinking on: 77% / 23% (8-bit model 62% / 15%).
What it was trained on
Round 1: two full epochs (4300 steps, learning rate 5e-5) on the 27B's round-4 mix m7: 18,189 samples, about 6.1M tokens. Twelve Forge apps written by LeanZero plus five forge-sim fixtures; schema-generated manifests validated by Atlassian's validator; UI Kit examples that compile (@forge/react 12); the Forge documentation as text and as verbatim-gated question-answer pairs; endpoint and scope facts from six Atlassian OpenAPI specs; LeanZero's community-research compendium and posted answers; 220 public Atlassian Developer Community threads; the 27B's own gate-passing apps from two rejection-sampling rounds (431 + 937) and 362 validator-corrected fix pairs; a general-code replay slice.
Measured
Against its own untouched base on the same harness as the 27B: Atlassian identifier probe 62% vs 15% (facts before 2026-04) and 15% vs 15% (after), thinking on; with thinking off, served: 69% / 38%. Forge shape tasks (a complete app from a one-line brief, thinking OFF, served through Rapid-MLX): 19 of 25 manifests pass Atlassian's validator and 16 of 25 complete apps also compile under tsc against the real @forge/* types. For scale, the 27B release scores 30.0 of 25 on the identical tasks: the small model trained two full epochs on the same data in one run and that budget shows. Looping battery (40 prompts x 4 sampling legs, 2048 tokens): genuine loops 0 / 0 / 4 / 0 vs its base 0 / 0 / 5 / 3, non-termination 18 / 8 / 13 / 0% vs 28 / 23 / 33 / 23%. Leak probe: LEAK PROBE PASS: 0 leaks over 112 outputs (26 regex matches: {'hallucinated': 21, 'hallucinated-token': 5}). Validation loss: 0.575 on its training mix, 0.959 on the 27B's round-1 mix. Merged 8-bit model vs base+adapter (top-1024 KLD, 200 prompts): 0.0537, top-1 99.14%. MTP on the merged model in Rapid-MLX, single stream: draft acceptance 67%, decode 63 -> 72 tok/s (1.14x) at 128, 63 -> 69 tok/s (1.09x) at 2048, 61 -> 66 tok/s (1.08x) at 8192, 54 -> 57 tok/s (1.05x) at 32768. LM Studio MLX engine: loaded the folder and answered a Forge question (gate PASS).
Evidence: every round, every test
This model against its base and the 27B release
| test | untouched 9B base | 9B tuned | 27B release (T9 (v0.5)) |
|---|---|---|---|
| identifiers pre / post, thinking on | 15% / 15% | 62% / 15% | 85% / 15% |
| identifiers, thinking off (served) | n/a | 69% / 38% | 85% / 31% |
| manifests valid (of 25) | n/a | 19 | 31.3 |
| complete app passes every gate (of 25) | n/a | 16 | 30.0 |
| loops per leg | 0 / 0 / 5 / 3 | 0 / 0 / 4 / 0 | 0 / 0 / 1 / 0 |
| non-termination per leg | 28 / 23 / 33 / 23% | 18 / 8 / 13 / 0% | 38 / 30 / 35 / 13% |
| merged 8-bit vs base+adapter: KLD / top-1 | - | 0.0537 / 99.14% | 0.0339 / 99.56% |
| MTP acceptance / speedup | - | 67% / 1.14x, 1.09x, 1.08x, 1.05x | 58% / 1.45x, 1.38x, 1.38x, 1.27x |
| LM Studio load | - | PASS | PASS |
How each test works, the training data per round and the full 27B history: leanzero.net/portfolio/atlassian-models.
How to run it
Rapid-MLX (LeanZero's fork, the engine inside Elzi, our desktop agent app)
rapid-mlx serve <folder> --text-only --tool-call-parser qwen3_coder_xml --reasoning-parser qwen3 --speculative-config '{"method":"mtp","model":"<folder>","num_speculative_tokens":3}'
LM Studio: put the folder under your models directory (for example models/leanzero/<folder>); it loads with the MLX engine like any mlx-community model. Measured on this release, see above.
mlx-lm
mlx_lm.generate --model <folder> --prompt "Which Forge module adds a panel to the Jira issue view?"
Sampling
Thinking: temperature 1.0, top_p 0.95, top_k 20. Instruct: temperature 0.7, top_p 0.8, top_k 20, presence penalty 1.5. Trained with reasoning_effort=medium, preserve_thinking=false.
Limits
A 9B that knows Forge, Jira, Confluence and JSM far better than its base, at a fraction of the 27B's memory. It is not a compiler: pair it with the manifest validator and tsc. Use thinking for questions and thinking OFF for code generation. Version facts are pinned to the June 2026 @forge/* wave. English only. Trained with reasoning_effort=medium.
Family
Qwen3.5-9B-Atlassian-Q8-mlx (the model), Qwen3.5-9B-Atlassian-lora (the adapter), Qwen3.5-9B-Atlassian-Q6-mlx and -Q4-mlx (smaller), Qwen3.5-9B-Atlassian-Q8-base-mlx (the untouched base). The 27B: Qwen3.8-27B-Atlassian-Q8-mlx and family.
Licence and provenance
Apache-2.0 (inherits the base). Training data: Forge apps written by LeanZero, public Atlassian developer documentation, Atlassian Cloud OpenAPI specifications, LeanZero's vetted community-research compendium and posted community answers, 220 public Atlassian Developer Community threads (question plus accepted answer), and a small general-code replay slice. No credentials; tenant hostnames and e-mail addresses were rewritten before training, and the finished model was probed for memorised strings against a control run on the untrained base. Method and gates: see the LeanZero write-up.
- Downloads last month
- 151
4-bit