How to use from
Pi
Start the MLX server
# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "DreamFoundries/MiniCPM5-2B-MLX-8bit"
Configure the model in Pi
# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "DreamFoundries/MiniCPM5-2B-MLX-8bit"
        }
      ]
    }
  }
}
Run Pi
# Start Pi in your project directory:
pi
Quick Links

Open in MLXHub

MiniCPM5-2B MLX 8-bit

MLX conversion of openbmb/MiniCPM5-2B, created specifically for MLXHub with the DreamFoundries mlx-lm fork. Affine 8-bit quantization uses group size 64.

The original model is by OpenBMB and is released under Apache-2.0. Comparative quality and performance benchmarks are not available for this conversion.

Use with MLX

from mlx_lm import load, generate

model, tokenizer = load("DreamFoundries/MiniCPM5-2B-MLX-8bit")
response = generate(model, tokenizer, prompt="Hello!", max_tokens=128)
print(response)

Download MLXHub

Downloads last month
21
Safetensors
Model size
3B params
Tensor type
U32
·
BF16
·
MLX
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for DreamFoundries/MiniCPM5-2B-MLX-8bit

Quantized
(139)
this model

Datasets used to train DreamFoundries/MiniCPM5-2B-MLX-8bit