Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 4, 2021

• Megatron 3D parallelism example (#82)

  

  Shaden Smith

  authored
  1bee84f

  Copy full SHA for 1bee84f

Commits on Feb 1, 2021

• Fix transformer kernel call parameters (#81)

  Show description for fde14be
  RezaYazdaniAminabadi

  authored
  fde14be

  Copy full SHA for fde14be

Commits on Jan 29, 2021

• [mpu] typos (#80)

  Show description for cadc355
  stas00

  authored
  cadc355

  Copy full SHA for cadc355

Commits on Jan 15, 2021

• Add deepspeed for the glue finetuning tasks & bert-large scripts (#77)

  Show description for 400cd1b
  RezaYazdaniAminabadi

  authored
  400cd1b

  Copy full SHA for 400cd1b

Commits on Jan 9, 2021

• additional no-decay keys for deepspeed transformer kernel (#75)

  hxbloom

  authored
  2d4282b

  Copy full SHA for 2d4282b

Commits on Jan 4, 2021

• small fix (#73)

  conglongli

  authored
  c3aa269

  Copy full SHA for c3aa269

Commits on Dec 29, 2020

• add local rank explicitly for mpirun (#72)

  Show description for 4fc7848
  

  szhengac

  and

  Shuai Zheng

  authored
  4fc7848

  Copy full SHA for 4fc7848

Commits on Dec 17, 2020

• updates across examples to use deepspeed.init_distributed() (see #608) (#71)

  jeffra

  authored
  78d69cb

  Copy full SHA for 78d69cb

• modify scripts for fixing the deepspeed-transformer interface (#69)

  RezaYazdaniAminabadi

  authored
  abb2706

  Copy full SHA for abb2706

Commits on Dec 10, 2020

• Fix small mistake in mpi script.

  Show description for 35b4582
  awan-10

  authored
  35b4582

  Copy full SHA for 35b4582

Commits on Nov 21, 2020

• config fixes for one bit adam example (#63)

  conglongli

  authored
  a3cfec7

  Copy full SHA for a3cfec7

Commits on Nov 10, 2020

• PLD Client (#61) (#62)

  Show description for fa1d1a7
  

  tjruwase

  and

  minjiaz

  authored
  fa1d1a7

  Copy full SHA for fa1d1a7

Commits on Oct 30, 2020

• move optimizer when deepspeed is enabled for megatron gpt2 pretraining (#60)

  Show description for a79272c
  RezaYazdaniAminabadi

  authored
  a79272c

  Copy full SHA for a79272c

Commits on Oct 21, 2020

• Update pretrain_gpt2.py (#59)

  Show description for a8865bb
  samyam

  authored
  a8865bb

  Copy full SHA for a8865bb

Commits on Oct 7, 2020

• gan example (#55)

  Show description for 28a32fb
  

  niumanar

  and

  jeffra

  authored
  28a32fb

  Copy full SHA for 28a32fb

Commits on Sep 24, 2020

• Remove typo (#56)

  tjruwase

  authored
  6a0048d

  Copy full SHA for 6a0048d

Commits on Sep 22, 2020

• Fix fp32 model undefined var bug (#54)

  tjruwase

  authored
  5523935

  Copy full SHA for 5523935

Commits on Sep 21, 2020

• add intermediate size in the transformer config (#47)

  RezaYazdaniAminabadi

  authored
  ba63ad0

  Copy full SHA for ba63ad0

Commits on Sep 10, 2020

• Fix indentation error (#51)

  tjruwase

  authored
  b989b41

  Copy full SHA for b989b41

• Pipeline parallelism example (#50)

  

  Shaden Smith

  authored
  a0a80fc

  Copy full SHA for a0a80fc

• 1-bit Adam examples/tutorial (#49)

  Show description for 38f0952
  

  5 peopleauthored
  38f0952

  Copy full SHA for 38f0952

• ZeRO-Offload updates (#48)

  Show description for ece5e0e
  

  4 peopleauthored
  ece5e0e

  Copy full SHA for ece5e0e

Commits on Sep 2, 2020

• Add sparse attention example (#36)

  Show description for 896831c
  

  jeffra

  and

  arashashari

  authored
  896831c

  Copy full SHA for 896831c

Commits on Aug 28, 2020

• add codeowners and remove deepspeed.pt refs (#33)

  Show description for 2346cb3
  jeffra

  authored
  2346cb3

  Copy full SHA for 2346cb3

Commits on Aug 14, 2020

• bring back turing.sources imports (#30)

  Show description for fd869ae
  

  conglongli

  and

  jeffra

  authored
  fd869ae

  Copy full SHA for fd869ae

Commits on Aug 13, 2020

• remove distributed requirement from model building (#31)

  Show description for 71ab29d
  

  jeffra

  and

  samyam

  authored
  71ab29d

  Copy full SHA for 71ab29d

Commits on Aug 10, 2020

• bumping pillow version after security update (#28)

  

  Shaden Smith

  authored
  9e2c34e

  Copy full SHA for 9e2c34e

Commits on Jul 24, 2020

• Support nvidia bert dataset (#27)

  Show description for 47766e0
  tjruwase

  authored
  47766e0

  Copy full SHA for 47766e0

Commits on Jun 17, 2020

• Create README.md

  jeffra

  authored
  fd6fb51

  Copy full SHA for fd6fb51

Commits on Jun 5, 2020

• adding stochastic mode (#24)

  RezaYazdaniAminabadi

  authored
  a8a85a9

  Copy full SHA for a8a85a9

Commits on Jun 4, 2020

• Fix bert bug with dist.init

  jeffra

  committed
  8610e5e

  Copy full SHA for 8610e5e

Commits on May 29, 2020

• update squad to add dropout

  jeffra

  committed
  10b60d1

  Copy full SHA for 10b60d1

Commits on May 28, 2020

• Update deepspeed_bsz32k_lamb_config_seq512.json

  Show description for 1b576d6
  samyam

  authored
  1b576d6

  Copy full SHA for 1b576d6

Commits on May 27, 2020

• cleanup of bert/squad code

  jeffra

  committed
  c66ce65

  Copy full SHA for c66ce65

• enable stochastic mode for bing_bert model (#16)

  Show description for 91cc01a
  

  jeffra

  and

  eltonzheng

  committed
  91cc01a

  Copy full SHA for 91cc01a

Pagination

Previous

Next