Instructions to use kernels-community/flash-attn2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/flash-attn2 with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("kernels-community/flash-attn2") - Notebooks
- Google Colab
- Kaggle
| {"mediaType":"application/vnd.dev.sigstore.bundle.v0.3+json","verificationMaterial":{"certificate":{"rawBytes":"MIIHSjCCBtCgAwIBAgIUGUF/X7u70cK2H/KeZosjret/gbgwCgYIKoZIzj0EAwMwNzEVMBMGA1UEChMMc2lnc3RvcmUuZGV2MR4wHAYDVQQDExVzaWdzdG9yZS1pbnRlcm1lZGlhdGUwHhcNMjYwNjIzMTgyMDI1WhcNMjYwNjIzMTgzMDI1WjAAMFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAE/MB9Qb0P7ZdxWM09J0Q5gaql7AHZOKstfaAzXJt2I7cmoNnCAVrfmt54ksNSQWaKgNFTNqbzK2RT2/YvNrH5hKOCBe8wggXrMA4GA1UdDwEB/wQEAwIHgDATBgNVHSUEDDAKBggrBgEFBQcDAzAdBgNVHQ4EFgQUQXJ8Bx+pb/vqphcU+QaXwsbhR3QwHwYDVR0jBBgwFoAU39Ppz1YkEZb5qNjpKFWixi4YZD8wawYDVR0RAQH/BGEwX4ZdaHR0cHM6Ly9naXRodWIuY29tL2h1Z2dpbmdmYWNlL2tlcm5lbHMtY29tbXVuaXR5Ly5naXRodWIvd29ya2Zsb3dzL2J1aWxkLnlhbWxAcmVmcy9oZWFkcy9tYWluMDkGCisGAQQBg78wAQEEK2h0dHBzOi8vdG9rZW4uYWN0aW9ucy5naXRodWJ1c2VyY29udGVudC5jb20wHwYKKwYBBAGDvzABAgQRd29ya2Zsb3dfZGlzcGF0Y2gwNgYKKwYBBAGDvzABAwQoZjEyYWZjOTJjNDBiYmQ3NmQ5OTBkOTExZWJhYmYyOGU0OTBhN2JkZTATBgorBgEEAYO/MAEEBAVCdWlsZDArBgorBgEEAYO/MAEFBB1odWdnaW5nZmFjZS9rZXJuZWxzLWNvbW11bml0eTAdBgorBgEEAYO/MAEGBA9yZWZzL2hlYWRzL21haW4wOwYKKwYBBAGDvzABCAQtDCtodHRwczovL3Rva2VuLmFjdGlvbnMuZ2l0aHVidXNlcmNvbnRlbnQuY29tMG0GCisGAQQBg78wAQkEXwxdaHR0cHM6Ly9naXRodWIuY29tL2h1Z2dpbmdmYWNlL2tlcm5lbHMtY29tbXVuaXR5Ly5naXRodWIvd29ya2Zsb3dzL2J1aWxkLnlhbWxAcmVmcy9oZWFkcy9tYWluMDgGCisGAQQBg78wAQoEKgwoZjEyYWZjOTJjNDBiYmQ3NmQ5OTBkOTExZWJhYmYyOGU0OTBhN2JkZTAbBgorBgEEAYO/MAELBA0MC3NlbGYtaG9zdGVkMEAGCisGAQQBg78wAQwEMgwwaHR0cHM6Ly9naXRodWIuY29tL2h1Z2dpbmdmYWNlL2tlcm5lbHMtY29tbXVuaXR5MDgGCisGAQQBg78wAQ0EKgwoZjEyYWZjOTJjNDBiYmQ3NmQ5OTBkOTExZWJhYmYyOGU0OTBhN2JkZTAfBgorBgEEAYO/MAEOBBEMD3JlZnMvaGVhZHMvbWFpbjAaBgorBgEEAYO/MAEPBAwMCjEwNzE0NzU1MjkwLgYKKwYBBAGDvzABEAQgDB5odHRwczovL2dpdGh1Yi5jb20vaHVnZ2luZ2ZhY2UwGAYKKwYBBAGDvzABEQQKDAgyNTcyMDc0MzBtBgorBgEEAYO/MAESBF8MXWh0dHBzOi8vZ2l0aHViLmNvbS9odWdnaW5nZmFjZS9rZXJuZWxzLWNvbW11bml0eS8uZ2l0aHViL3dvcmtmbG93cy9idWlsZC55YW1sQHJlZnMvaGVhZHMvbWFpbjA4BgorBgEEAYO/MAETBCoMKGYxMmFmYzkyYzQwYmJkNzZkOTkwZDkxMWViYWJmMjhlNDkwYTdiZGUwIQYKKwYBBAGDvzABFAQTDBF3b3JrZmxvd19kaXNwYXRjaDBkBgorBgEEAYO/MAEVBFYMVGh0dHBzOi8vZ2l0aHViLmNvbS9odWdnaW5nZmFjZS9rZXJuZWxzLWNvbW11bml0eS9hY3Rpb25zL3J1bnMvMjgwMzYyNjg5MzUvYXR0ZW1wdHMvMTAWBgorBgEEAYO/MAEWBAgMBnB1YmxpYzBGBgorBgEEAYO/MAEYBDgMNnJlcG86aHVnZ2luZ2ZhY2Uva2VybmVscy1jb21tdW5pdHk6cmVmOnJlZnMvaGVhZHMvbWFpbjCBiQYKKwYBBAHWeQIEAgR7BHkAdwB1AN09MGrGxxEyYxkeHJlnNwKiSl643jyt/4eKcoAvKe6OAAABnvW2S1QAAAQDAEYwRAIgNJAwIUYC+u/MDKy6I7yXXQXvo6QfXxIxkhDzhuci/HcCICAQpkw0Hhu3r7fgAS2Iz0RHEuABVMqK42FKpF8x8Z1IMAoGCCqGSM49BAMDA2gAMGUCMQDCSMdd3aLnQzH5VNGi4dIziaKgtCFQSBj9qQWeH6zgV8kG4LN8WZ38SVozORTnCDYCMDVfD/UwMX9uI+ZwL/rzNIkJoC72pyBkSOWAGI+dVFCXGatv5/4hUj56ra51u/Uo+w=="},"tlogEntries":[{"logIndex":"1929966493","logId":{"keyId":"wNI9atQGlz+VWfO6LRygH4QUfY/8W4RFwiT5i5WRgB0="},"kindVersion":{"kind":"hashedrekord","version":"0.0.1"},"integratedTime":"1782238825","inclusionPromise":{"signedEntryTimestamp":"MEYCIQDGJtY832xPCCKlnLD4VRF0Bkx8FEVWNWXJX2lQWmAdfgIhAIHvP0u1VsI6nmW5NjNCmktZexRnxm1UNxBpYnlOwl//"},"inclusionProof":{"logIndex":"1808062231","rootHash":"M6bBtwKzXMRC6pslsEYCgZwaaFK1esuiWPxAuv0bX8Q=","treeSize":"1808062258","hashes":["IndZ/q0vKORPU7bw4t94MH9ELdEixGn2xVRKyrMsXz4=","VJ9yaFD79SuCwi4dECn+MHPfY62qZWZjJM1JJ/9INMs=","bsYNroONIHTv3B2u4SjRSdn4PTKUbsaIyxnhwcuWW+8=","5Xh3VCXrEdwAWf2Vke2ugmclHkiLukte3XR2iEF1eqs=","jihrxwF4e/WPcFnsqD1wxKl2Wx92ax8o33KYducFSGY=","A0q0E1Q0SHxoHhzrAl3GNMlJc9b+z+UqSns1/jI2ogA=","VrhYX+LlNagV3pSn3KMaGr/lC81bfD7BQz859yCToYY=","jgKZMZUAOznhZow0dOq9j+6kBbYqJbpAwbHuyR0vtw0=","43kco2WsynkkNcu9FNHzcL7ZH810rbB/a5HS62l4P9Q=","Rf4AP9k6JckOtBvSb8IZhPtOdgQbDwTqzHj/Ob7GoR0=","2azvF0ZQXjI0TTkEYlWo40jJTIJKrIaRQSKDw70qaz8=","MXnb5KZ/vcuCLPtNBIq6MAywaatte0rS/H2lJyqLfIY=","QdxFjkGuHUV4B069H6Stxfn75M+rztEbA+7TnHdszN8=","nyv2TDlfkz0XfRwjY98zsbUbOkBZ+Tgz7PML0c2uN14=","OMfDh4k9YD0E+t4sjqJsh+vg8D1ueo1cC07exyxmr6s=","+vHKm4wNwGJ46ceyZ8mePD7Vn1SediStNHCStRoTSWQ=","5HwWjuGNDisetbiWM0cWIXM65TIM3EJlqk13ntCQlcU=","NDIRlqxO0IaGr94q86MIU7VCAN3yEEgOHS4loya5lu4=","daxmZaajRpZV+JxHiOYZhJBiSKN5ucqjh2WnGbHhirw=","DOCeoSMovIvLExkhIvisow9AuNXgeWs4ECkyR6EcqYU="],"checkpoint":{"envelope":"rekor.sigstore.dev - 1193050959916656506\n1808062258\nM6bBtwKzXMRC6pslsEYCgZwaaFK1esuiWPxAuv0bX8Q=\n\n— rekor.sigstore.dev wNI9ajBFAiEAyYIW1zM4LZL68fLGHuRetqzhvaCO+4EknerHn+XKI6ACIG/4uUTaRLxUiM6yA4rtIiZQEkpbKBD8xfvUSowADP4D\n"}},"canonicalizedBody":"eyJhcGlWZXJzaW9uIjoiMC4wLjEiLCJraW5kIjoiaGFzaGVkcmVrb3JkIiwic3BlYyI6eyJkYXRhIjp7Imhhc2giOnsiYWxnb3JpdGhtIjoic2hhMjU2IiwidmFsdWUiOiJlYTQwM2U5MDQyZWE2NDU0MGFkZGVmZDNhZjk3ZWU3Yjc5MjZjOWI5OTc5MWFhNmUyYmQ2N2UxMjU5YzdlMGQxIn19LCJzaWduYXR1cmUiOnsiY29udGVudCI6Ik1FVUNJUUNZTVhUS094V2JoNXBjTWFjNUkzK0ZJOWlpZHBJcDgvSWRLekMzMXJDUnJRSWdXVWZYeGFwUmVhbXV4OVdkc3dZVmFmSzB0aFlDQmZkc2JibHJ5SzQ0Q2ZjPSIsInB1YmxpY0tleSI6eyJjb250ZW50IjoiTFMwdExTMUNSVWRKVGlCRFJWSlVTVVpKUTBGVVJTMHRMUzB0Q2sxSlNVaFRha05EUW5SRFowRjNTVUpCWjBsVlIxVkdMMWczZFRjd1kwc3lTQzlMWlZwdmMycHlaWFF2WjJKbmQwTm5XVWxMYjFwSmVtb3dSVUYzVFhjS1RucEZWazFDVFVkQk1WVkZRMmhOVFdNeWJHNWpNMUoyWTIxVmRWcEhWakpOVWpSM1NFRlpSRlpSVVVSRmVGWjZZVmRrZW1SSE9YbGFVekZ3WW01U2JBcGpiVEZzV2tkc2FHUkhWWGRJYUdOT1RXcFpkMDVxU1hwTlZHZDVUVVJKTVZkb1kwNU5hbGwzVG1wSmVrMVVaM3BOUkVreFYycEJRVTFHYTNkRmQxbElDa3R2V2tsNmFqQkRRVkZaU1V0dldrbDZhakJFUVZGalJGRm5RVVV2VFVJNVVXSXdVRGRhWkhoWFRUQTVTakJSTldkaGNXdzNRVWhhVDB0emRHWmhRWG9LV0VwME1razNZMjF2VG01RFFWWnlabTEwTlRScmMwNVRVVmRoUzJkT1JsUk9jV0o2U3pKU1ZESXZXWFpPY2tnMWFFdFBRMEpsT0hkbloxaHlUVUUwUndwQk1WVmtSSGRGUWk5M1VVVkJkMGxJWjBSQlZFSm5UbFpJVTFWRlJFUkJTMEpuWjNKQ1owVkdRbEZqUkVGNlFXUkNaMDVXU0ZFMFJVWm5VVlZSV0VvNENrSjRLM0JpTDNaeGNHaGpWU3RSWVZoM2MySm9Vak5SZDBoM1dVUldVakJxUWtKbmQwWnZRVlV6T1ZCd2VqRlphMFZhWWpWeFRtcHdTMFpYYVhocE5Ga0tXa1E0ZDJGM1dVUldVakJTUVZGSUwwSkhSWGRZTkZwa1lVaFNNR05JVFRaTWVUbHVZVmhTYjJSWFNYVlpNamwwVERKb01Wb3laSEJpYldSdFdWZE9iQXBNTW5Sc1kyMDFiR0pJVFhSWk1qbDBZbGhXZFdGWVVqVk1lVFZ1WVZoU2IyUlhTWFprTWpsNVlUSmFjMkl6WkhwTU1rb3hZVmQ0YTB4dWJHaGlWM2hCQ21OdFZtMWplVGx2V2xkR2EyTjVPWFJaVjJ4MVRVUnJSME5wYzBkQlVWRkNaemM0ZDBGUlJVVkxNbWd3WkVoQ2VrOXBPSFprUnpseVdsYzBkVmxYVGpBS1lWYzVkV041Tlc1aFdGSnZaRmRLTVdNeVZubFpNamwxWkVkV2RXUkROV3BpTWpCM1NIZFpTMHQzV1VKQ1FVZEVkbnBCUWtGblVWSmtNamw1WVRKYWN3cGlNMlJtV2tkc2VtTkhSakJaTW1kM1RtZFpTMHQzV1VKQ1FVZEVkbnBCUWtGM1VXOWFha1Y1V1ZkYWFrOVVTbXBPUkVKcFdXMVJNMDV0VVRWUFZFSnJDazlVUlhoYVYwcG9XVzFaZVU5SFZUQlBWRUpvVGpKS2ExcFVRVlJDWjI5eVFtZEZSVUZaVHk5TlFVVkZRa0ZXUTJSWGJITmFSRUZ5UW1kdmNrSm5SVVVLUVZsUEwwMUJSVVpDUWpGdlpGZGtibUZYTlc1YWJVWnFXbE01Y2xwWVNuVmFWM2g2VEZkT2RtSlhNVEZpYld3d1pWUkJaRUpuYjNKQ1owVkZRVmxQTHdwTlFVVkhRa0U1ZVZwWFducE1NbWhzV1ZkU2Vrd3lNV2hoVnpSM1QzZFpTMHQzV1VKQ1FVZEVkbnBCUWtOQlVYUkVRM1J2WkVoU2QyTjZiM1pNTTFKMkNtRXlWblZNYlVacVpFZHNkbUp1VFhWYU1td3dZVWhXYVdSWVRteGpiVTUyWW01U2JHSnVVWFZaTWpsMFRVY3dSME5wYzBkQlVWRkNaemM0ZDBGUmEwVUtXSGQ0WkdGSVVqQmpTRTAyVEhrNWJtRllVbTlrVjBsMVdUSTVkRXd5YURGYU1tUndZbTFrYlZsWFRteE1NblJzWTIwMWJHSklUWFJaTWpsMFlsaFdkUXBoV0ZJMVRIazFibUZZVW05a1YwbDJaREk1ZVdFeVduTmlNMlI2VERKS01XRlhlR3RNYm14b1lsZDRRV050Vm0xamVUbHZXbGRHYTJONU9YUlpWMngxQ2sxRVowZERhWE5IUVZGUlFtYzNPSGRCVVc5RlMyZDNiMXBxUlhsWlYxcHFUMVJLYWs1RVFtbFpiVkV6VG0xUk5VOVVRbXRQVkVWNFdsZEthRmx0V1hrS1QwZFZNRTlVUW1oT01rcHJXbFJCWWtKbmIzSkNaMFZGUVZsUEwwMUJSVXhDUVRCTlF6Tk9iR0pIV1hSaFJ6bDZaRWRXYTAxRlFVZERhWE5IUVZGUlFncG5OemgzUVZGM1JVMW5kM2RoU0ZJd1kwaE5Oa3g1T1c1aFdGSnZaRmRKZFZreU9YUk1NbWd4V2pKa2NHSnRaRzFaVjA1c1RESjBiR050Tld4aVNFMTBDbGt5T1hSaVdGWjFZVmhTTlUxRVowZERhWE5IUVZGUlFtYzNPSGRCVVRCRlMyZDNiMXBxUlhsWlYxcHFUMVJLYWs1RVFtbFpiVkV6VG0xUk5VOVVRbXNLVDFSRmVGcFhTbWhaYlZsNVQwZFZNRTlVUW1oT01rcHJXbFJCWmtKbmIzSkNaMFZGUVZsUEwwMUJSVTlDUWtWTlJETktiRnB1VFhaaFIxWm9Xa2hOZGdwaVYwWndZbXBCWVVKbmIzSkNaMFZGUVZsUEwwMUJSVkJDUVhkTlEycEZkMDU2UlRCT2VsVXhUV3ByZDB4bldVdExkMWxDUWtGSFJIWjZRVUpGUVZGbkNrUkNOVzlrU0ZKM1kzcHZka3d5WkhCa1IyZ3hXV2sxYW1JeU1IWmhTRlp1V2pKc2RWb3lXbWhaTWxWM1IwRlpTMHQzV1VKQ1FVZEVkbnBCUWtWUlVVc0tSRUZuZVU1VVkzbE5SR013VFhwQ2RFSm5iM0pDWjBWRlFWbFBMMDFCUlZOQ1JqaE5XRmRvTUdSSVFucFBhVGgyV2pKc01HRklWbWxNYlU1MllsTTVid3BrVjJSdVlWYzFibHB0Um1wYVV6bHlXbGhLZFZwWGVIcE1WMDUyWWxjeE1XSnRiREJsVXpoMVdqSnNNR0ZJVm1sTU0yUjJZMjEwYldKSE9UTmplVGxwQ21SWGJITmFRelUxV1ZjeGMxRklTbXhhYmsxMllVZFdhRnBJVFhaaVYwWndZbXBCTkVKbmIzSkNaMFZGUVZsUEwwMUJSVlJDUTI5TlMwZFplRTF0Um0wS1dYcHJlVmw2VVhkWmJVcHJUbnBhYTA5VWEzZGFSR3Q0VFZkV2FWbFhTbTFOYW1oc1RrUnJkMWxVWkdsYVIxVjNTVkZaUzB0M1dVSkNRVWRFZG5wQlFncEdRVkZVUkVKR00ySXpTbkphYlhoMlpERTVhMkZZVG5kWldGSnFZVVJDYTBKbmIzSkNaMFZGUVZsUEwwMUJSVlpDUmxsTlZrZG9NR1JJUW5wUGFUaDJDbG95YkRCaFNGWnBURzFPZG1KVE9XOWtWMlJ1WVZjMWJscHRSbXBhVXpseVdsaEtkVnBYZUhwTVYwNTJZbGN4TVdKdGJEQmxVemxvV1ROU2NHSXlOWG9LVEROS01XSnVUWFpOYW1kM1RYcFplVTVxWnpWTmVsVjJXVmhTTUZwWE1YZGtTRTEyVFZSQlYwSm5iM0pDWjBWRlFWbFBMMDFCUlZkQ1FXZE5RbTVDTVFwWmJYaHdXWHBDUjBKbmIzSkNaMFZGUVZsUEwwMUJSVmxDUkdkTlRtNUtiR05IT0RaaFNGWnVXakpzZFZveVdtaFpNbFYyWVRKV2VXSnRWbk5qZVRGcUNtSXlNWFJrVnpWd1pFaHJObU50Vm0xUGJrcHNXbTVOZG1GSFZtaGFTRTEyWWxkR2NHSnFRMEpwVVZsTFMzZFpRa0pCU0ZkbFVVbEZRV2RTTjBKSWEwRUtaSGRDTVVGT01EbE5SM0pIZUhoRmVWbDRhMlZJU214dVRuZExhVk5zTmpRemFubDBMelJsUzJOdlFYWkxaVFpQUVVGQlFtNTJWekpUTVZGQlFVRlJSQXBCUlZsM1VrRkpaMDVLUVhkSlZWbERLM1V2VFVSTGVUWkpOM2xZV0ZGWWRtODJVV1pZZUVsNGEyaEVlbWgxWTJrdlNHTkRTVU5CVVhCcmR6QklhSFV6Q25JM1ptZEJVekpKZWpCU1NFVjFRVUpXVFhGTE5ESkdTM0JHT0hnNFdqRkpUVUZ2UjBORGNVZFRUVFE1UWtGTlJFRXlaMEZOUjFWRFRWRkVRMU5OWkdRS00yRk1ibEY2U0RWV1RrZHBOR1JKZW1saFMyZDBRMFpSVTBKcU9YRlJWMlZJTm5wblZqaHJSelJNVGpoWFdqTTRVMVp2ZWs5U1ZHNURSRmxEVFVSV1pncEVMMVYzVFZnNWRVa3JXbmRNTDNKNlRrbHJTbTlETnpKd2VVSnJVMDlYUVVkSksyUldSa05ZUjJGMGRqVXZOR2hWYWpVMmNtRTFNWFV2Vlc4cmR6MDlDaTB0TFMwdFJVNUVJRU5GVWxSSlJrbERRVlJGTFMwdExTMEsifX19fQ=="}],"timestampVerificationData":{"rfc3161Timestamps":[{"signedTimestamp":"MIICyjADAgEAMIICwQYJKoZIhvcNAQcCoIICsjCCAq4CAQMxDTALBglghkgBZQMEAgEwgbgGCyqGSIb3DQEJEAEEoIGoBIGlMIGiAgEBBgkrBgEEAYO/MAIwMTANBglghkgBZQMEAgEFAAQgxI8zDvem/zyKTdFSqYy6ib/yQXUt6MGNvDecWKLmlP8CFQCyLByKNcEBVO5flM9JzLSAGTeVXxgPMjAyNjA2MjMxODIwMjVaMAMCAQGgMqQwMC4xFTATBgNVBAoTDHNpZ3N0b3JlLmRldjEVMBMGA1UEAxMMc2lnc3RvcmUtdHNhoAAxggHbMIIB1wIBATBRMDkxFTATBgNVBAoTDHNpZ3N0b3JlLmRldjEgMB4GA1UEAxMXc2lnc3RvcmUtdHNhLXNlbGZzaWduZWQCFDoTVC8MkGHuvMFDL8uKjosqI4sMMAsGCWCGSAFlAwQCAaCB/DAaBgkqhkiG9w0BCQMxDQYLKoZIhvcNAQkQAQQwHAYJKoZIhvcNAQkFMQ8XDTI2MDYyMzE4MjAyNVowLwYJKoZIhvcNAQkEMSIEIFbD/+/Wnhzjw4X7f0g1/a7iqf8YAorG9LVAShbEV894MIGOBgsqhkiG9w0BCRACLzF/MH0wezB5BCCF+Se8B6tiysO0Q1bBDvyBssaIP9p6uebYcNnROs0FtzBVMD2kOzA5MRUwEwYDVQQKEwxzaWdzdG9yZS5kZXYxIDAeBgNVBAMTF3NpZ3N0b3JlLXRzYS1zZWxmc2lnbmVkAhQ6E1QvDJBh7rzBQy/Lio6LKiOLDDAKBggqhkjOPQQDAgRnMGUCMQCYEfENOE656RQjbnjoqSi9YoIXpl+HJs1aO+F4G/ej9WCPZOeCSMFgQTlTzwOxK0cCMAQ9fGAgliYgTgFYtY4fXBODpp/KHk6dgqx+sp6sfIHFTmbaEtes0fmrgKDDlad7zA=="}]}},"messageSignature":{"messageDigest":{"algorithm":"SHA2_256","digest":"6kA+kELqZFQK3e/Tr5fue3kmybmXkapuK9Z+ElnH4NE="},"signature":"MEUCIQCYMXTKOxWbh5pcMac5I3+FI9iidpIp8/IdKzC31rCRrQIgWUfXxapReamux9WdswYVafK0thYCBfdsbblryK44Cfc="}} |