How to use from
vLLM
Install from pip and serve model
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "ibivibiv/multimaster-7b-v2"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ibivibiv/multimaster-7b-v2",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'
Use Docker
docker model run hf.co/ibivibiv/multimaster-7b-v2
Quick Links

Model Card for MultiMaster 5x7B

img

Version 2 of a general purpose model for knowledge.

Model Details

Model Description

This is the model card of a ๐Ÿค— transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Developed by: ibivibiv
  • Funded by: ibivibiv
  • Shared by: ibivibiv
  • Model type: Mixtral
  • Language(s) (NLP): English
  • License: Apache 2

Uses

General Knowledge

Direct Use

Evaluation

Coming Soon

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 73.33
AI2 Reasoning Challenge (25-Shot) 70.48
HellaSwag (10-Shot) 87.59
MMLU (5-Shot) 65.09
TruthfulQA (0-shot) 60.63
Winogrande (5-shot) 84.29
GSM8k (5-shot) 71.87
Downloads last month
73
Safetensors
Model size
35B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for ibivibiv/multimaster-7b-v2

Quantizations
2 models

Collection including ibivibiv/multimaster-7b-v2

Evaluation results