Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 10, 2020

• PLD Client (#61) (#62)

  Show description for fa1d1a7
  

  tjruwase

  and

  minjiaz

  authored
  fa1d1a7

  Copy full SHA for fa1d1a7

Commits on Oct 30, 2020

• move optimizer when deepspeed is enabled for megatron gpt2 pretraining (#60)

  Show description for a79272c
  RezaYazdaniAminabadi

  authored
  a79272c

  Copy full SHA for a79272c

Commits on Oct 21, 2020

• Update pretrain_gpt2.py (#59)

  Show description for a8865bb
  samyam

  authored
  a8865bb

  Copy full SHA for a8865bb

Commits on Oct 7, 2020

• gan example (#55)

  Show description for 28a32fb
  

  niumanar

  and

  jeffra

  authored
  28a32fb

  Copy full SHA for 28a32fb

Commits on Sep 24, 2020

• Remove typo (#56)

  tjruwase

  authored
  6a0048d

  Copy full SHA for 6a0048d

Commits on Sep 22, 2020

• Fix fp32 model undefined var bug (#54)

  tjruwase

  authored
  5523935

  Copy full SHA for 5523935

Commits on Sep 21, 2020

• add intermediate size in the transformer config (#47)

  RezaYazdaniAminabadi

  authored
  ba63ad0

  Copy full SHA for ba63ad0

Commits on Sep 10, 2020

• Fix indentation error (#51)

  tjruwase

  authored
  b989b41

  Copy full SHA for b989b41

• Pipeline parallelism example (#50)

  

  Shaden Smith

  authored
  a0a80fc

  Copy full SHA for a0a80fc

• 1-bit Adam examples/tutorial (#49)

  Show description for 38f0952
  

  5 peopleauthored
  38f0952

  Copy full SHA for 38f0952

• ZeRO-Offload updates (#48)

  Show description for ece5e0e
  

  4 peopleauthored
  ece5e0e

  Copy full SHA for ece5e0e

Commits on Sep 2, 2020

• Add sparse attention example (#36)

  Show description for 896831c
  

  jeffra

  and

  arashashari

  authored
  896831c

  Copy full SHA for 896831c

Commits on Aug 28, 2020

• add codeowners and remove deepspeed.pt refs (#33)

  Show description for 2346cb3
  jeffra

  authored
  2346cb3

  Copy full SHA for 2346cb3

Commits on Aug 14, 2020

• bring back turing.sources imports (#30)

  Show description for fd869ae
  

  conglongli

  and

  jeffra

  authored
  fd869ae

  Copy full SHA for fd869ae

Commits on Aug 13, 2020

• remove distributed requirement from model building (#31)

  Show description for 71ab29d
  

  jeffra

  and

  samyam

  authored
  71ab29d

  Copy full SHA for 71ab29d

Commits on Aug 10, 2020

• bumping pillow version after security update (#28)

  

  Shaden Smith

  authored
  9e2c34e

  Copy full SHA for 9e2c34e

Commits on Jul 24, 2020

• Support nvidia bert dataset (#27)

  Show description for 47766e0
  tjruwase

  authored
  47766e0

  Copy full SHA for 47766e0

Commits on Jun 17, 2020

• Create README.md

  jeffra

  authored
  fd6fb51

  Copy full SHA for fd6fb51

Commits on Jun 5, 2020

• adding stochastic mode (#24)

  RezaYazdaniAminabadi

  authored
  a8a85a9

  Copy full SHA for a8a85a9

Commits on Jun 4, 2020

• Fix bert bug with dist.init

  jeffra

  committed
  8610e5e

  Copy full SHA for 8610e5e

Commits on May 29, 2020

• update squad to add dropout

  jeffra

  committed
  10b60d1

  Copy full SHA for 10b60d1

Commits on May 28, 2020

• Update deepspeed_bsz32k_lamb_config_seq512.json

  Show description for 1b576d6
  samyam

  authored
  1b576d6

  Copy full SHA for 1b576d6

Commits on May 27, 2020

• cleanup of bert/squad code

  jeffra

  committed
  c66ce65

  Copy full SHA for c66ce65

• enable stochastic mode for bing_bert model (#16)

  Show description for 91cc01a
  

  jeffra

  and

  eltonzheng

  committed
  91cc01a

  Copy full SHA for 91cc01a

Commits on May 14, 2020

• DeepSpeed 0.2 support (#21)

  Show description for 5426d18
  

  7 peopleauthored
  5426d18

  Copy full SHA for 5426d18

Commits on Apr 30, 2020

• New apex compatible squad (#19)

  Show description for 9e2c735
  jeffra

  authored
  9e2c735

  Copy full SHA for 9e2c735

Commits on Apr 8, 2020

• aml datastore support using a data_path_prefix (#16)

  jeffra

  authored
  6a698b2

  Copy full SHA for 6a698b2

• Bert pretraining refactor (#15)

  Show description for 91a794c
  jeffra

  authored
  91a794c

  Copy full SHA for 91a794c

Commits on Apr 6, 2020

• Adds DS config for bing_bert tutorial. (#14)

  

  Shaden Smith

  authored
  da38821

  Copy full SHA for da38821

Commits on Mar 28, 2020

• Bing bert squad scripts update (#12)

  Show description for b873ccc
  arashashari

  authored
  b873ccc

  Copy full SHA for b873ccc

Commits on Mar 26, 2020

• Fix formatting issues (#10)

  tjruwase

  authored
  32ae819

  Copy full SHA for 32ae819

Commits on Mar 16, 2020

• Update ds_train_bert_bsz16k_seq512.sh (#7)

  Show description for 0401afe
  dadebarr

  authored
  0401afe

  Copy full SHA for 0401afe

Commits on Mar 7, 2020

• BERT example (#6)

  

  Shaden Smith

  authored
  0b69ada

  Copy full SHA for 0b69ada

Commits on Feb 13, 2020

• Fixing Apex calls (#4)

  

  Shaden Smith

  authored
  e0d2d7f

  Copy full SHA for e0d2d7f

Commits on Feb 7, 2020

• Initial add of example models

  

  jeffra

  authored and

  Shaden Smith

  committed
  07d1ce0

  Copy full SHA for 07d1ce0

Pagination

Previous

Next