Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 17, 2021

• DeepSpeed MoE Usage Example (#127)

  Show description for 448e191
  

  3 peopleauthored
  448e191

  Copy full SHA for 448e191

Commits on Aug 16, 2021

• Curriculum learning examples (#126)

  conglongli

  authored
  ca278ba

  Copy full SHA for ca278ba

Commits on May 24, 2021

• DS inference examples (#53) (#111)

  Show description for 25d73cf
  

  4 peopleauthored
  25d73cf

  Copy full SHA for 25d73cf

Commits on Apr 29, 2021

• Z3 arg update (#105)

  jeffra

  authored
  1273725

  Copy full SHA for 1273725

Commits on Apr 21, 2021

• 1-bit LAMB optimizer example scripts (#97)

  Show description for f94591e
  conglongli

  authored
  f94591e

  Copy full SHA for f94591e

Commits on Apr 19, 2021

• Add Megatron clarification (#99)

  awan-10

  authored
  d7e23dd

  Copy full SHA for d7e23dd

• ZeRO-Infinity examples (#98)

  Show description for bdf8e59
  

  3 peopleauthored
  bdf8e59

  Copy full SHA for bdf8e59

Commits on Mar 16, 2021

• 1-bit Adam v2 example scripts (#89)

  Show description for 590364d
  conglongli

  authored
  590364d

  Copy full SHA for 590364d

Commits on Mar 10, 2021

• missed PR merge after Init rename (#93)

  

  Shaden Smith

  authored
  20ea07a

  Copy full SHA for 20ea07a

Commits on Mar 8, 2021

• Megatron + ZeRO-3 (#91)

  Show description for 2cd968f
  

  4 peopleauthored
  2cd968f

  Copy full SHA for 2cd968f

Commits on Feb 4, 2021

• Megatron 3D parallelism example (#82)

  

  Shaden Smith

  authored
  1bee84f

  Copy full SHA for 1bee84f

Commits on Feb 1, 2021

• Fix transformer kernel call parameters (#81)

  Show description for fde14be
  RezaYazdaniAminabadi

  authored
  fde14be

  Copy full SHA for fde14be

Commits on Jan 29, 2021

• [mpu] typos (#80)

  Show description for cadc355
  stas00

  authored
  cadc355

  Copy full SHA for cadc355

Commits on Jan 15, 2021

• Add deepspeed for the glue finetuning tasks & bert-large scripts (#77)

  Show description for 400cd1b
  RezaYazdaniAminabadi

  authored
  400cd1b

  Copy full SHA for 400cd1b

Commits on Jan 9, 2021

• additional no-decay keys for deepspeed transformer kernel (#75)

  hxbloom

  authored
  2d4282b

  Copy full SHA for 2d4282b

Commits on Jan 4, 2021

• small fix (#73)

  conglongli

  authored
  c3aa269

  Copy full SHA for c3aa269

Commits on Dec 29, 2020

• add local rank explicitly for mpirun (#72)

  Show description for 4fc7848
  

  szhengac

  and

  Shuai Zheng

  authored
  4fc7848

  Copy full SHA for 4fc7848

Commits on Dec 17, 2020

• updates across examples to use deepspeed.init_distributed() (see #608) (#71)

  jeffra

  authored
  78d69cb

  Copy full SHA for 78d69cb

• modify scripts for fixing the deepspeed-transformer interface (#69)

  RezaYazdaniAminabadi

  authored
  abb2706

  Copy full SHA for abb2706

Commits on Dec 10, 2020

• Fix small mistake in mpi script.

  Show description for 35b4582
  awan-10

  authored
  35b4582

  Copy full SHA for 35b4582

Commits on Nov 21, 2020

• config fixes for one bit adam example (#63)

  conglongli

  authored
  a3cfec7

  Copy full SHA for a3cfec7

Commits on Nov 10, 2020

• PLD Client (#61) (#62)

  Show description for fa1d1a7
  

  tjruwase

  and

  minjiaz

  authored
  fa1d1a7

  Copy full SHA for fa1d1a7

Commits on Oct 30, 2020

• move optimizer when deepspeed is enabled for megatron gpt2 pretraining (#60)

  Show description for a79272c
  RezaYazdaniAminabadi

  authored
  a79272c

  Copy full SHA for a79272c

Commits on Oct 21, 2020

• Update pretrain_gpt2.py (#59)

  Show description for a8865bb
  samyam

  authored
  a8865bb

  Copy full SHA for a8865bb

Commits on Oct 7, 2020

• gan example (#55)

  Show description for 28a32fb
  

  niumanar

  and

  jeffra

  authored
  28a32fb

  Copy full SHA for 28a32fb

Commits on Sep 24, 2020

• Remove typo (#56)

  tjruwase

  authored
  6a0048d

  Copy full SHA for 6a0048d

Commits on Sep 22, 2020

• Fix fp32 model undefined var bug (#54)

  tjruwase

  authored
  5523935

  Copy full SHA for 5523935

Commits on Sep 21, 2020

• add intermediate size in the transformer config (#47)

  RezaYazdaniAminabadi

  authored
  ba63ad0

  Copy full SHA for ba63ad0

Commits on Sep 10, 2020

• Fix indentation error (#51)

  tjruwase

  authored
  b989b41

  Copy full SHA for b989b41

• Pipeline parallelism example (#50)

  

  Shaden Smith

  authored
  a0a80fc

  Copy full SHA for a0a80fc

• 1-bit Adam examples/tutorial (#49)

  Show description for 38f0952
  

  5 peopleauthored
  38f0952

  Copy full SHA for 38f0952

• ZeRO-Offload updates (#48)

  Show description for ece5e0e
  

  4 peopleauthored
  ece5e0e

  Copy full SHA for ece5e0e

Commits on Sep 2, 2020

• Add sparse attention example (#36)

  Show description for 896831c
  

  jeffra

  and

  arashashari

  authored
  896831c

  Copy full SHA for 896831c

Commits on Aug 28, 2020

• add codeowners and remove deepspeed.pt refs (#33)

  Show description for 2346cb3
  jeffra

  authored
  2346cb3

  Copy full SHA for 2346cb3

Commits on Aug 14, 2020

• bring back turing.sources imports (#30)

  Show description for fd869ae
  

  conglongli

  and

  jeffra

  authored
  fd869ae

  Copy full SHA for fd869ae

Pagination

Previous

Next