v0.4.3
What's Changed
- Fix Twine Build Issue by @rasbt in #1530
- Fix Mixtral prompt style by @janEbert in #1531
- Raise warning when loading a large model on a CPU device by @rasbt in #1532
- Tutorial
convert_from_litgpt
doc fix to removeoutput_dir
command argument by @jentfoo in #1533 - Test against eager attention on GPTNeoX by @rasbt in #1537
- Bump to 0.4.3.dev0 version by @rasbt in #1536
- Fix for LM Eval harness 0.4.3 by @rasbt in #1542
- Add
Phi-3-mini-4k-instruct
checkpoint by @rasbt in #1341 - Update phi-3 prompt template by @rasbt in #1544
- Add progress bar for weight loading by @rasbt in #1534
- Remove redundant code in checkpoint conversion script by @rasbt in #1547
- Update how evaluate tasks are listed by @rasbt in #1550
- Fix generate issue in finetuning script when finetuning with small datasets by @rasbt in #1551
- Tokenizer: check that
bos
andeos
tokens are applied w.r.t. to a provided config/args by @Andrei-Aksionov in #1527 - Add num_nodes argument by @janEbert in #1546
- Add Phi-3 Configs by @rasbt in #1553
- Update to version 0.4.3 for new release by @rasbt in #1554
New Contributors
Full Changelog: v0.4.2...v0.4.3