Align LLMs with the preference dataset ONLY with 💡ORPO💡

We introduce ORPO, alignment without reference model & SFT! With awesome dataset from Argilla + Mistral(7B) + ORPO, we present 🌟Mistral-ORPO-β🌟
🧵

👉 AlpacaEval 2.0: 12.20%
👉 IFEval: 66.19%
👉 MT-Bench: 7.32

Very proud of the undergraduates from the #kaist #computerscience department who have been studying the behavior of #LLMs in the Korean Language. Congratulations! w/ Haneul Yoo James Thorne Alice Oh

If you are interested in medical NLP/AI, our lab is hosting one of the shared tasks at NAACL-ClinicalNLP 2024 on reliable text-to-SQL on electronic health records. #EHRSQL . Please check out the link for more information. sites.google.com/view/ehrsql-20….

Pleased to see Prof Jong C. Park from #KAIST Computer Science department present the opening keynote at #EMNLP2023 this year sharing insights from more than 20 years of development of human centric Natural Language Processing nlpcl.kaist.ac.kr

Our paper 'Flooding with Absorption: An Efficient Protocol for Heterogeneous Bandits over Complex Networks' won the Best Student Paper at OPODIS 2023! 🌐📚

Congratulations to Junghyun Lee, Laura Schmid, and Se-Young Yun!

🔗 Read the paper: arxiv.org/abs/2303.05445

Taehyung and Jihoon from Data Mining Lab received the IEEE ICDM Best Student Paper Runner-up Award. Congrats!
arxiv.org/abs/2309.10310
icdm.zhonghuapu.com/Awards/BestPap…
kaistdata.github.io

🚀 Big news from KAIST AI! We're now on LinkedIn! 🌟

🔗 Follow us: linkedin.com/company/kaist-…