VISHNUDHAT/mus-medical-llm-lora

CAMUS Medical LLM (LoRA)

Fine-tuned on synthetic cardiac ultrasound descriptions from the CAMUS dataset.

Model type

• Base: Mistral 7B (4-bit)
• Fine-tuning: LoRA (PEFT)

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base = "unsloth/mistral-7b-bnb-4bit"

model = AutoModelForCausalLM.from_pretrained(base, load_in_4bit=True)
model = PeftModel.from_pretrained(model, "VISHNUDHAT/mus-medical-llm-lora")

tokenizer = AutoTokenizer.from_pretrained("VISHNUDHAT/mus-medical-llm-lora")