vicgalle
/

configurable-preference-phi4

Text Generation

Model card Files Files and versions

This repository contains the model described in the paper Configurable Preference Tuning with Rubric-Guided Synthetic Data.

Github repository: https://github.com/vicgalle/configurable-preference-tuning.

Downloads last month: -; Downloads are not tracked for this model. How to track

Model tree for vicgalle/configurable-preference-phi4

Base model

microsoft/phi-4

Quantized

unsloth/phi-4-unsloth-bnb-4bit

Finetuned

(353)

this model

Dataset used to train vicgalle/configurable-preference-phi4

Collection including vicgalle/configurable-preference-phi4

Configurable Preference Tuning ⚙️📝

CPT uses rubric-guided synthetic data and DPO to enable LLMs to dynamically adjust behavior (e.g., writing style) at inference with system prompts • 7 items • Updated Jun 17, 2025 • 1

Paper for vicgalle/configurable-preference-phi4

Configurable Preference Tuning with Rubric-Guided Synthetic Data

Paper • 2506.11702 • Published Jun 13, 2025 • 1