Fix orpo/dpo trainer (#1286)
* change the colab notebook for dpo zephyr and orpo * use original tokenizer * Update README.md * Update README.md --------- Co-authored-by: Daniel Han <danielhanchen@gmail.com>
This commit is contained in:
parent
ae7aabd648
commit
5eeb53fb42