How to use kai-os/gemma4-31b-Opus-4.6-reasoning with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("google/gemma-4-31B-it") model = PeftModel.from_pretrained(base_model, "kai-os/gemma4-31b-Opus-4.6-reasoning")
Please add benchmarks and GGUF versions
now
· Sign up or log in to comment
