Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon (no PyTorch, no cloud). Try the Lab · All OptiQ quants · Docs
- Downloads last month
- 109
Model size
0.3B params
Tensor type
BF16
·
U32 ·
Hardware compatibility
Log In to add your hardware
4-bit
Model tree for nisavid/mxbai-rerank-large-v2-OptiQ-4bit
Base model
mixedbread-ai/mxbai-rerank-large-v2