Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
Shenguo Wang
Flash Attention
Repository
Branches
Overview
Active
Stale
All
main
default
protected
320fb594
·
Update citation
·
May 26, 2024
Select Archive Format
Download source code
zip
tar.gz
tar.bz2
tar
inference
06fe4fd9
·
[WIP] Implement seqk_parallel forward, for d=64, 128
·
Aug 21, 2023
Compare
Select Archive Format
Download source code
zip
tar.gz
tar.bz2
tar
cutlass
93d0ce43
·
Set device for multi-GPU case
·
Oct 17, 2022
Compare
Select Archive Format
Download source code
zip
tar.gz
tar.bz2
tar
5b838a8b
merged
5b838a8b
·
Apply dropout scaling to dQ and dK instead of to V (in bwd)
·
Jul 04, 2022
Compare
Select Archive Format
Download source code
zip
tar.gz
tar.bz2
tar