Instructions to use kernels-community/flash-attn2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/flash-attn2 with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("kernels-community/flash-attn2") - Notebooks
- Google Colab
- Kaggle
patch: remove incorrect out=empty_like(q) in mha_fwd_kvcache
Browse files- build/torch27-cxx11-cu118-x86_64-linux/flash_attn2/_flash_attn_9e27194.abi3.so +1 -1
- build/torch27-cxx11-cu126-x86_64-linux/flash_attn2/_flash_attn_9e27194.abi3.so +1 -1
- build/torch27-cxx11-cu128-x86_64-linux/flash_attn2/_flash_attn_9e27194.abi3.so +1 -1
- build/torch28-cxx11-cu126-x86_64-linux/_flash_attn2_588b404.abi3.so +1 -1
- build/torch28-cxx11-cu128-x86_64-linux/_flash_attn2_588b404.abi3.so +1 -1
- build/torch28-cxx11-cu129-x86_64-linux/_flash_attn2_588b404.abi3.so +1 -1
- build/torch29-cxx11-cu126-aarch64-linux/_flash_attn2_cuda_abda3a0.abi3.so +1 -1
- build/torch29-cxx11-cu126-x86_64-linux/_flash_attn2_cuda_abda3a0.abi3.so +1 -1
- build/torch29-cxx11-cu128-aarch64-linux/_flash_attn2_cuda_abda3a0.abi3.so +1 -1
- build/torch29-cxx11-cu128-x86_64-linux/_flash_attn2_cuda_abda3a0.abi3.so +1 -1
- build/torch29-cxx11-cu129-aarch64-linux/_flash_attn2_cuda_f1a742f.abi3.so +1 -1
- build/torch29-cxx11-cu129-x86_64-linux/_flash_attn2_cuda_f1a742f.abi3.so +1 -1
- build/torch29-cxx11-cu130-aarch64-linux/_flash_attn2_cuda_abda3a0.abi3.so +1 -1
- build/torch29-cxx11-cu130-x86_64-linux/_flash_attn2_cuda_abda3a0.abi3.so +1 -1
build/torch27-cxx11-cu118-x86_64-linux/flash_attn2/_flash_attn_9e27194.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 445273544
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:76aafd307b4f2f2db05f8e450c68d004b5061ce726b6172a5d3411ddf54f338d
|
| 3 |
size 445273544
|
build/torch27-cxx11-cu126-x86_64-linux/flash_attn2/_flash_attn_9e27194.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 448639288
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0d130f4d2250a8025dacd5094474507c4f721d1f92ebfd51aaa048b23d346b3d
|
| 3 |
size 448639288
|
build/torch27-cxx11-cu128-x86_64-linux/flash_attn2/_flash_attn_9e27194.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1037635040
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0974763439908e223d9e3627dfff3f636e9d91f830952a35a914af55ee4d0af2
|
| 3 |
size 1037635040
|
build/torch28-cxx11-cu126-x86_64-linux/_flash_attn2_588b404.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 448648680
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5b9440c7b7253af45d06c853a7878bf154705e0e8ad8192b7391790a42d3f3c0
|
| 3 |
size 448648680
|
build/torch28-cxx11-cu128-x86_64-linux/_flash_attn2_588b404.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1037644552
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:966860bc62695941fa02c2966ab7dad4fafc5b13487e231b7781523eef745dab
|
| 3 |
size 1037644552
|
build/torch28-cxx11-cu129-x86_64-linux/_flash_attn2_588b404.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1042944096
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8ea86598d250413c68ab4cf8bb2eaf99ff138099dcccee119fd3410d1c619287
|
| 3 |
size 1042944096
|
build/torch29-cxx11-cu126-aarch64-linux/_flash_attn2_cuda_abda3a0.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 448464272
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e3e9388d04fee347a39220864d3274bfa46a0fa54640ad0c3201425bb3a8cb75
|
| 3 |
size 448464272
|
build/torch29-cxx11-cu126-x86_64-linux/_flash_attn2_cuda_abda3a0.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 448648752
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b7fa75c66a0e0f26e36e97ca905305ff054ae2936078d1ee1354cb4540bf1cdc
|
| 3 |
size 448648752
|
build/torch29-cxx11-cu128-aarch64-linux/_flash_attn2_cuda_abda3a0.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1037856008
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fd01e83103c6287b943a514ab196554c9d70f33a819e231d7286ba27ec4a1db0
|
| 3 |
size 1037856008
|
build/torch29-cxx11-cu128-x86_64-linux/_flash_attn2_cuda_abda3a0.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1037644632
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:54202fb14acadd754654a7822be7943e513822cbe0f07d4ddee5f9ee99d6fe50
|
| 3 |
size 1037644632
|
build/torch29-cxx11-cu129-aarch64-linux/_flash_attn2_cuda_f1a742f.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1043164184
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f6d2481a77b64ab1a0048a1f45333bf306d3bb985319758a31f57859a2211c20
|
| 3 |
size 1043164184
|
build/torch29-cxx11-cu129-x86_64-linux/_flash_attn2_cuda_f1a742f.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1042952368
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dec1424f566a194f2d51147e6b75e69a66d0107c9e2e3ac82fffe90bf4554786
|
| 3 |
size 1042952368
|
build/torch29-cxx11-cu130-aarch64-linux/_flash_attn2_cuda_abda3a0.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1008640480
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f050d21698e38a8353748b4e5bcb4ee962b059d32cedc40313eafd637f23d7b2
|
| 3 |
size 1008640480
|
build/torch29-cxx11-cu130-x86_64-linux/_flash_attn2_cuda_abda3a0.abi3.so
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1009019192
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:45ed1be1f8bf3a148e9c6ebf07796d20bda6b889c52192deb4bef381f9772543
|
| 3 |
size 1009019192
|