Skip to content

Tags: databricks/megablocks

Tags

v0.5.1

Toggle v0.5.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Updt triton pin (#89)

* Update setup.py

make torch pin more flexible

* Update setup.py

v0.5.0

Toggle v0.5.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Merge pull request #47 from stanford-futuredata/fix-topology-kernel

Fix bug in topology kernel for ffn_hidden_size>4096.

v0.4.0

Toggle v0.4.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Merge pull request #34 from stanford-futuredata/fsdp_refactor

Refactoring class hierarchy for FSDP wrapping

v0.3.3

Toggle v0.3.3's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Merge pull request #31 from vchiley/no_bias

Enable running MegaBlocks MoE without bias

v0.3.2

Toggle v0.3.2's commit message
merge conflict

v0.1

Toggle v0.1's commit message
Update Megatron submodule to incorporate fixes to checkpoint saving w…

…hen using expert model parallelism