Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Sep 5, 2023

• Skip hierarchical partitioning ZeRO (hpZ) for single node (#717)

  HeyangQin

  authored
  20f0a85

  Copy full SHA for 20f0a85

Commits on Aug 31, 2023

• Update README.md (#714)

  awan-10

  authored
  6c83ac2

  Copy full SHA for 6c83ac2

• add updates for the new release. (#712)

  awan-10

  authored
  4355784

  Copy full SHA for 4355784

• add mixz script (#711)

  HeyangQin

  authored
  845ac3e

  Copy full SHA for 845ac3e

Commits on Aug 25, 2023

• Fix calculations (include critic model) for performance (#706)

  awan-10

  authored
  bd1c82c

  Copy full SHA for bd1c82c

Commits on Aug 22, 2023

• add timers and performance metrics (#688)

  Show description for 81a8521
  

  4 peopleauthored
  81a8521

  Copy full SHA for 81a8521

Commits on Aug 18, 2023

• Mixed Precision ZeRO++ (#689)

  Show description for 32083e5
  

  HeyangQin

  and

  lekurile

  authored
  32083e5

  Copy full SHA for 32083e5

Commits on Aug 17, 2023

• Rename Step 3 DS-Chat args for clarification (#698)

  Show description for 9186347
  lekurile

  authored
  9186347

  Copy full SHA for 9186347

• Update requirements.txt

  awan-10

  authored
  927690e

  Copy full SHA for 927690e

• Add DS-Chat CI badge and documentation (#697)

  Show description for 30e6735
  lekurile

  authored
  30e6735

  Copy full SHA for 30e6735

Commits on Aug 16, 2023

• Remove skipping of Z3 case in DS Chat step 3 training (#687)

  Show description for 3daac59
  lekurile

  authored
  3daac59

  Copy full SHA for 3daac59

• Add minimalistic naming convention for tests

  lekurile

  committed
  7a21aea

  Copy full SHA for 7a21aea

• Change run_training_test.py to test_training.py (#686)

  lekurile

  authored
  a143850

  Copy full SHA for a143850

Commits on Aug 15, 2023

• DS Chat Step 3 Unit Test (#677)

  Show description for 80eb89f
  lekurile

  authored
  80eb89f

  Copy full SHA for 80eb89f

• Enable non-CUDA device for CIFAR10 and HelloDeepSpeed training example (#651)

  Show description for c94321a
  

  delock

  and

  tjruwase

  authored
  c94321a

  Copy full SHA for c94321a

Commits on Aug 14, 2023

• Add LoRA LR for DS Chat steps 1-3 (#685)

  Show description for f98077d
  lekurile

  authored
  f98077d

  Copy full SHA for f98077d

Commits on Aug 11, 2023

• Add Hybrid Engine mode + move arguments to a file (#684)

  awan-10

  authored
  78a8e2d

  Copy full SHA for 78a8e2d

Commits on Aug 10, 2023

• Add test mode args to DS Chat step 3 (#682)

  Show description for c984c8d
  lekurile

  authored
  c984c8d

  Copy full SHA for c984c8d

• Update script location and docs for all 3 steps (#681)

  awan-10

  authored
  f8e25c5

  Copy full SHA for f8e25c5

Commits on Aug 9, 2023

• Fix for cannot import name 'LlamaTokenizerFast' (#647) (#648)

  Show description for ef87284
  

  3 peopleauthored
  ef87284

  Copy full SHA for ef87284

• 10-20x faster load checkpoint (for critic/reward model) (#675)

  Show description for 3952c9a
  

  awan-10

  and

  lekurile

  authored
  3952c9a

  Copy full SHA for 3952c9a

Commits on Aug 8, 2023

• add deepspeed chat arxiv report (#679)

  conglongli

  authored
  042443d

  Copy full SHA for 042443d

• Update inference test and add ds-hf-compare (#671)

  Show description for 04b1036
  

  molly-smith

  and

  awan-10

  authored
  04b1036

  Copy full SHA for 04b1036

Commits on Aug 7, 2023

• Update CIFAR example with changes required in torch 1.13 (#676)

  loadams

  authored
  0e0e2ef

  Copy full SHA for 0e0e2ef

• Fix typos in README.md (#635)

  Show description for c7bcbc8
  

  Embracing

  and

  loadams

  authored
  c7bcbc8

  Copy full SHA for c7bcbc8

Commits on Aug 3, 2023

• Fix output arg in step 3 llama script (#668)

  Show description for d2373cd
  lekurile

  authored
  d2373cd

  Copy full SHA for d2373cd

• Update DS Chat transformers req (#667)

  Show description for 835af7c
  lekurile

  authored
  835af7c

  Copy full SHA for 835af7c

• Update Stable Diffusion Example (#662)

  Show description for 258182f
  lekurile

  authored
  258182f

  Copy full SHA for 258182f

• Refactor load_hf_tokenizer for use with all 3 steps. (#666)

  awan-10

  authored
  d652031

  Copy full SHA for d652031

• fix only optimize lora and ack-ckpting compatible (#658)

  Show description for 97a36bc
  

  yaozhewei

  and

  lekurile

  authored
  97a36bc

  Copy full SHA for 97a36bc

Commits on Aug 2, 2023

• Add step 2 sweep script, clean up scripts (#664)

  Show description for 1a0b896
  lekurile

  authored
  1a0b896

  Copy full SHA for 1a0b896

Commits on Aug 1, 2023

• Adding fine-tuning support for Llama on the client side (#657)

  Show description for b371f8f
  

  3 peopleauthored
  b371f8f

  Copy full SHA for b371f8f

Commits on Jul 25, 2023

• fix variable name (#655)

  Show description for 81e88bd
  

  kwonmha

  and

  SamsungLife Mac Pro

  authored
  81e88bd

  Copy full SHA for 81e88bd

Commits on Jul 22, 2023

• DS Chat Instrumentation (#624)

  Show description for 96e86b2
  

  3 peopleauthored
  96e86b2

  Copy full SHA for 96e86b2

Commits on Jul 20, 2023

• DS Chat Characterization Scripts (Step 1 and 3) (#638)

  Show description for 1928885
  lekurile

  authored
  1928885

  Copy full SHA for 1928885

Pagination

Previous

Next