Advancing Open-source Language Models with Mixed-Quality Data

Online Demo | GitHub | Paper | Discord

OpenChat is dedicated to advancing and releasing open-source language models, fine-tuned with our C-RLFT technique, which is inspired by offline reinforcement learning. Our models learn from mixed-quality data without preference labels, delivering exceptional performance on par with ChatGPT, which we were the first to beat with only 7B parameter LLMs which can be run on a consumer GPU (e.g. RTX 3090).

💌Contact

Project Lead:

• Guan Wang [imonenext@gmail.com]
• Alpay Ariyak [alpay@ariyak.ai]

Sponsors:

• Sen Song (Tsinghua University)
• Yang Liu (Tsinghua University)
• 01.AI Company
• RunPod