ManiKumarAdapala commited on
Commit
7a09b22
·
verified ·
1 Parent(s): 60bf56e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +112 -2
README.md CHANGED
@@ -1,5 +1,115 @@
1
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: other
3
- license_name: other
4
- license_link: LICENSE
5
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ - as
5
+ - bn
6
+ - brx
7
+ - doi
8
+ - gu
9
+ - hi
10
+ - kn
11
+ - ks
12
+ - kok
13
+ - mai
14
+ - ml
15
+ - mni
16
+ - mr
17
+ - ne
18
+ - or
19
+ - pa
20
+ - sa
21
+ - sat
22
+ - sd
23
+ - ta
24
+ - te
25
+ - ur
26
+ - bho
27
+ - bhb
28
+ library_name: transformers
29
+ pipeline_tag: automatic-speech-recognition
30
+ base_model:
31
+ - bodhan-ai/indic-transcribe-core
32
+ tags:
33
+ - automatic-speech-recognition
34
+ - speech
35
+ - audio
36
+ - asr
37
+ - multilingual
38
+ - indic
39
+ - code-switching
40
+ - code-mixing
41
+ - language-identification
42
+ - canary
43
+ - fastconformer
44
+ - quantized
45
+ - int8
46
+ - bitsandbytes
47
  license: other
 
 
48
  ---
49
+
50
+ # Indic-Transcribe-Core 8-bit
51
+
52
+ An **8-bit quantized version** of [Bodhan AI's Indic-Transcribe-Core](https://huggingface.co/bodhan-ai/indic-transcribe-core), created using **BitsAndBytes** quantization.
53
+
54
+ The model retains the capabilities of the original multilingual ASR model while significantly reducing GPU memory requirements, making it more suitable for resource-constrained inference and serving multiple users.
55
+
56
+ ## Key Features
57
+
58
+ * 🎙️ Multilingual Automatic Speech Recognition
59
+ * 🇮🇳 Supports Indian languages
60
+ * ⚡ 8-bit quantization using **BitsAndBytes**
61
+ * 💾 Reduced GPU VRAM usage
62
+ * 🔌 Designed for efficient inference and deployment
63
+
64
+ ## VRAM Usage
65
+
66
+ | Model | Approx. GPU VRAM |
67
+ | -------------------------------- | ---------------: |
68
+ | Original `indic-transcribe-core` | ~5 GB |
69
+ | **This 8-bit model** | **~2.5 GB** |
70
+ | Reduction | **~50%** |
71
+
72
+ Actual memory usage may vary depending on GPU, batch size, audio duration, and inference configuration.
73
+
74
+ ## Base Model
75
+
76
+ This model is derived from:
77
+
78
+ **[bodhan-ai/indic-transcribe-core](https://huggingface.co/bodhan-ai/indic-transcribe-core)**
79
+
80
+ Please refer to the original model card for the architecture, training details, supported languages, benchmarks, limitations, and licensing information.
81
+
82
+ ## Quantization
83
+
84
+ The model was quantized to **8-bit using BitsAndBytes**.
85
+
86
+ The primary goal of this quantized release is to reduce GPU memory consumption while maintaining the capabilities of the original model.
87
+
88
+
89
+
90
+ ## Inference
91
+
92
+ For a complete inference example, see the
93
+ [Inference Notebook](./transcribe-8bit-quant.ipynb).
94
+
95
+
96
+ ## Intended Use
97
+
98
+ Suitable for:
99
+
100
+ * Indian-language speech-to-text
101
+ * Voice applications
102
+ * Multilingual transcription
103
+ * Low-VRAM GPU deployment
104
+ * Multi-user ASR serving
105
+ * On-premise and edge-oriented inference
106
+
107
+ ## Attribution
108
+
109
+ This is a quantized derivative of **Bodhan AI's Indic-Transcribe-Core**.
110
+ Please retain the original model's attribution and comply with its license and usage requirements.
111
+
112
+ ## Disclaimer
113
+
114
+ This repository contains an **8-bit quantized version** of the original model.
115
+ Performance, accuracy, memory usage, and compatibility may vary depending on the inference environment.