File size: 1,519 Bytes
72d04bd 1d66a64 72d04bd 6377657 1d66a64 72d04bd 76eae3a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 | ---
license: mit
---
## FluA_Pro
The **FluA_Pro** is a protein model trained on a masked language modeling objective, resulting from the unsupervised fine-tuning of the **ESM-2** (https://huggingface.co/facebook/esm2_t33_650M_UR50D) protein language model. Its fine-tuning dataset is sourced from Influenza A protein sequences (**11** types of influenza A proteins from different species) in the NCBI Virus database (as of January 12, 2025). The original dataset comprises **1,737,586** protein sequences, reduced to **388,385** sequences after removing duplicates and those with 100% identity.
The FluA_Pro model is suitable for downstream applications related to Influenza Aviruses. For detailed information on the model’s training data, please refer to the accompanying paper.
Multiple **FluA_Pro** checkpoints are available on the Hub, with varying model sizes. Generally, larger models offer higher accuracy but require more memory and training time.
| Checkpoint name | Num layers | Num parameters |
|------------------------------|----|----------|
| .[FluA_t36_3B_esm2](https://huggingface.co/sihuapeng/FluA_t36_3B_esm2) | 36 | 3B |
| [FluA_t33_650M_esm2](https://huggingface.co/sihuapeng/FluA_t33_650M_esm2) | 33 | 650M |
| [FluA_t30_150M_esm2](https://huggingface.co/sihuapeng/FluA_t30_150M_esm2) | 30 | 150M |
| [FluA_t12_35M_esm2](https://huggingface.co/sihuapeng/FluA_t12_35M_esm2) | 12 | 35M |
| [FluA_t6_8M_esm2](https://huggingface.co/sihuapeng/FluA_t6_8M_esm2) | 6 | 8M | |