anithasoma commited on
Commit
db89bdf
·
verified ·
1 Parent(s): d22c28f

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +82 -0
README.md ADDED
@@ -0,0 +1,82 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - anithasoma/anitha_colloquial_en_te
5
+ language:
6
+ - en
7
+ - te
8
+ metrics:
9
+ - bleu
10
+ - sacrebleu
11
+ base_model:
12
+ - facebook/nllb-200-distilled-600M
13
+ pipeline_tag: translation
14
+ library_name: transformers
15
+ tags:
16
+ - text-generation
17
+ - translation
18
+ - fine-tuned-model
19
+ - colloquial-language
20
+ - telugu
21
+ - machine-translation
22
+ ---
23
+ # NLLB-200 Fine-Tuned for Colloquial Telugu
24
+
25
+ ## Model Description
26
+ This model is a fine-tuned version of the [NLLB-200 (Distilled 600M)](https://huggingface.co/facebook/nllb-200-distilled-600M) designed for translating English sentences into colloquial Telugu. It has been optimized to better capture informal and conversational nuances.
27
+
28
+ ## Model Details
29
+ - **Model Name:** anithasoma/nllb-finetuned-telugu
30
+ - **Base Model:** facebook/nllb-200-distilled-600M
31
+ - **Fine-Tuned By:** [anithasoma](https://huggingface.co/anithasoma)
32
+ - **Languages:** English → Telugu (colloquial)
33
+ - **Framework:** Transformers (🤗 Hugging Face)
34
+
35
+ ## Training Details
36
+ - **Dataset:** anithasoma/anitha_colloquial_en_te
37
+ - **Training Environment:** Google Colab with NVIDIA GPU.
38
+ - **Fine-Tuning Method:** LoRA + PEFT (Parameter Efficient Fine-Tuning)
39
+ - **Epochs:** Adjusted based on validation loss.
40
+ - **Metrics:** BLEU Score, SacreBLEU Score Perplexity, Human Evaluation.
41
+
42
+ ## Evaluation Metrics
43
+
44
+ The model was evaluated using the BLEU and SacreBLEU metrics:
45
+
46
+ - **BLEU Score:** 43.12
47
+ - **SacreBLEU Score:** 43.12
48
+
49
+
50
+ ## How to Use
51
+ You can use this model in Python with the `transformers` library:
52
+
53
+ ```python
54
+ from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
55
+
56
+ tokenizer = AutoTokenizer.from_pretrained("anithasoma/nllb-finetuned-telugu")
57
+ model = AutoModelForSeq2SeqLM.from_pretrained("anithasoma/nllb-finetuned-telugu")
58
+
59
+ def translate(text):
60
+ inputs = tokenizer(text, return_tensors="pt")
61
+ outputs = model.generate(**inputs)
62
+ return tokenizer.decode(outputs[0], skip_special_tokens=True)
63
+
64
+ print(translate("Hello, how are you?"))
65
+ ```
66
+
67
+ ## Model Card
68
+ ### Intended Use
69
+ This model is intended for generating colloquial Telugu translations from English text, improving conversational AI, and enhancing informal communication applications.
70
+
71
+ ### Limitations
72
+ - May not perform well on formal or domain-specific text.
73
+ - Can sometimes produce literal rather than context-aware translations.
74
+
75
+ ### License
76
+ This model is licensed under the [Apache 2.0 License](https://www.apache.org/licenses/LICENSE-2.0).
77
+
78
+ ## Contributors
79
+ Developed by **[anithasoma](https://huggingface.co/anithasoma)** as part of the SAWiT AI Hackathon.
80
+
81
+ ---
82
+ *For feedback or collaboration, reach out via Hugging Face!* 🚀