mlx-community/GLM-4.7-REAP-50-mxfp4

This model mlx-community/GLM-4.7-REAP-50-mxfp4 was converted to MLX format from 0xSero/GLM-4.7-REAP-50 using mlx-lm version 0.30.0.

Use with mlx

pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/GLM-4.7-REAP-50-mxfp4")

prompt = "hello"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True, return_dict=False,
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)
Downloads last month
1,026
Safetensors
Model size
185B params
Tensor type
U8
U32
BF16
F32
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for mlx-community/GLM-4.7-REAP-50-mxfp4

Quantized
(7)
this model