tianbingsz / halos Goto Github PK
View Code? Open in Web Editor NEWThis project forked from contextualai/halos
A library with extensible implementations of DPO, KTO, PPO, and other human-centered loss functions (HALOs).
License: Apache License 2.0