Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Jun 15, 2022

• Move megatron forks in a folder and update README to link to the latest Megatron-DeepSpeed fork. (#178)

  awan-10

  authored
  89ce0d5

  Copy full SHA for 89ce0d5

Commits on Jun 14, 2022

• update CODEOWNERS (#177)

  conglongli

  authored
  5c6b1c8

  Copy full SHA for 5c6b1c8

Commits on Mar 16, 2022

• Fix HelloDeepSpeed for multi-GPU runs (#170)

  Show description for 6bd444a
  mrwyattii

  authored
  6bd444a

  Copy full SHA for 6bd444a

Commits on Mar 11, 2022

• 01 adam optimizer example scripts (#164)

  Show description for 4f064fb
  

  EugeneLYC

  and

  conglongli

  authored
  4f064fb

  Copy full SHA for 4f064fb

Commits on Feb 28, 2022

• add prmoe to cifar10 example (#163)

  yaozhewei

  authored
  36212dd

  Copy full SHA for 36212dd

Commits on Feb 22, 2022

• Inference: general tensor-parallel examples (#144)

  Show description for 9c48e36
  

  RezaYazdaniAminabadi

  and

  awan-10

  authored
  9c48e36

  Copy full SHA for 9c48e36

Commits on Feb 9, 2022

• apply dynamic loss scaling (#161)

  conglongli

  authored
  068e656

  Copy full SHA for 068e656

Commits on Jan 20, 2022

• fix the inference tests based on the new changes on DeepSpeed (#157)

  Show description for 41f4fdf
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  41f4fdf

  Copy full SHA for 41f4fdf

• fix cifar10 moe example with new moe api (#156)

  yaozhewei

  authored
  ec38584

  Copy full SHA for ec38584

Commits on Jan 6, 2022

• Improve reproducibility (#154)

  tjruwase

  authored
  d1452c9

  Copy full SHA for d1452c9

Commits on Nov 16, 2021

• Update documentation about Megatron examples (#141)

  Show description for 1fed12e
  

  conglongli

  and

  jeffra

  authored
  1fed12e

  Copy full SHA for 1fed12e

Commits on Nov 13, 2021

• add autotuning hf examples (#146)

  Show description for 2467552
  cli99

  authored
  2467552

  Copy full SHA for 2467552

Commits on Oct 30, 2021

• CL code/doc update (#142)

  conglongli

  authored
  e4d1096

  Copy full SHA for e4d1096

Commits on Oct 25, 2021

• curriculum learning fix (#139)

  conglongli

  authored
  11ca395

  Copy full SHA for 11ca395

Commits on Oct 22, 2021

• fix breaking api (#138)

  conglongli

  authored
  8d01699

  Copy full SHA for 8d01699

Commits on Oct 21, 2021

• rename beginner tutorial

  jeffra

  committed
  255e9ee

  Copy full SHA for 255e9ee

• minor edits to beginner example

  jeffra

  authored
  b33a211

  Copy full SHA for b33a211

• Add self contained beginner example (#137)

  Show description for 269b508
  

  jeffra

  and

  codedecde

  authored
  269b508

  Copy full SHA for 269b508

Commits on Sep 18, 2021

• Add zero stage 2 script

  tjruwase

  committed
  174ae3b

  Copy full SHA for 174ae3b

Commits on Sep 10, 2021

• remove dropout from moe. (#132)

  awan-10

  authored
  24712bd

  Copy full SHA for 24712bd

Commits on Sep 1, 2021

• Disable memory usage profiler (#131)

  tjruwase

  authored
  c1b206c

  Copy full SHA for c1b206c

Commits on Aug 22, 2021

• Fix curriculum learning example config

  Show description for 424cbae
  conglongli

  authored
  424cbae

  Copy full SHA for 424cbae

Commits on Aug 17, 2021

• DeepSpeed MoE Usage Example (#127)

  Show description for 448e191
  

  3 peopleauthored
  448e191

  Copy full SHA for 448e191

Commits on Aug 16, 2021

• Curriculum learning examples (#126)

  conglongli

  authored
  ca278ba

  Copy full SHA for ca278ba

Commits on May 24, 2021

• DS inference examples (#53) (#111)

  Show description for 25d73cf
  

  4 peopleauthored
  25d73cf

  Copy full SHA for 25d73cf

Commits on Apr 29, 2021

• Z3 arg update (#105)

  jeffra

  authored
  1273725

  Copy full SHA for 1273725

Commits on Apr 21, 2021

• 1-bit LAMB optimizer example scripts (#97)

  Show description for f94591e
  conglongli

  authored
  f94591e

  Copy full SHA for f94591e

Commits on Apr 19, 2021

• Add Megatron clarification (#99)

  awan-10

  authored
  d7e23dd

  Copy full SHA for d7e23dd

• ZeRO-Infinity examples (#98)

  Show description for bdf8e59
  

  3 peopleauthored
  bdf8e59

  Copy full SHA for bdf8e59

Commits on Mar 16, 2021

• 1-bit Adam v2 example scripts (#89)

  Show description for 590364d
  conglongli

  authored
  590364d

  Copy full SHA for 590364d

Commits on Mar 10, 2021

• missed PR merge after Init rename (#93)

  

  Shaden Smith

  authored
  20ea07a

  Copy full SHA for 20ea07a

Commits on Mar 8, 2021

• Megatron + ZeRO-3 (#91)

  Show description for 2cd968f
  

  4 peopleauthored
  2cd968f

  Copy full SHA for 2cd968f

Commits on Feb 4, 2021

• Megatron 3D parallelism example (#82)

  

  Shaden Smith

  authored
  1bee84f

  Copy full SHA for 1bee84f

Commits on Feb 1, 2021

• Fix transformer kernel call parameters (#81)

  Show description for fde14be
  RezaYazdaniAminabadi

  authored
  fde14be

  Copy full SHA for fde14be

Commits on Jan 29, 2021

• [mpu] typos (#80)

  Show description for cadc355
  stas00

  authored
  cadc355

  Copy full SHA for cadc355

Pagination

Previous

Next