phattrandeveloper commited on
Commit
3fcecd0
·
verified ·
1 Parent(s): e6f9bf3

Add Flutter Gemma conversion notes

Browse files
Files changed (1) hide show
  1. flutter_gemma/README.md +40 -0
flutter_gemma/README.md ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # functiongemma-270m-function-calling for Flutter Gemma
2
+
3
+ MediaPipe `.task` conversion of `phattrandeveloper/functiongemma-270m-function-calling` for `flutter_gemma` mobile inference.
4
+
5
+ ## Artifact
6
+
7
+ - Task bundle: `functiongemma-270m-function-calling.task`
8
+ - Flutter Gemma file type: `ModelFileType.task`
9
+ - Flutter Gemma model type: `ModelType.functionGemma`
10
+ - Quantization: `dynamic_int8`
11
+ - Prefill sequence length: `2048`
12
+ - KV cache max length: `4096`
13
+ - Prompt template embedded: `False`
14
+ - SHA-256: `068757b3c6fe9ec8182fe11c2eb612423a0d77ff42cae20142476aff10f99820`
15
+
16
+ Download URL:
17
+
18
+ ```text
19
+ https://huggingface.co/phattrandeveloper/functiongemma-270m-function-calling/resolve/main/functiongemma-270m-function-calling.task
20
+ ```
21
+
22
+ ## Flutter Gemma usage
23
+
24
+ ```dart
25
+ await FlutterGemma.installModel(modelType: ModelType.functionGemma)
26
+ .fromNetwork('https://huggingface.co/phattrandeveloper/functiongemma-270m-function-calling/resolve/main/functiongemma-270m-function-calling.task')
27
+ .install();
28
+ ```
29
+
30
+ Use the banking tool schema and `systemInstruction` from this project when creating the chat.
31
+
32
+ ## Conversion references
33
+
34
+ - Google Gemma HF SafeTensors to MediaPipe Task guide: https://ai.google.dev/gemma/docs/conversions/hf-to-mediapipe-task
35
+ - Google MediaPipe LLM Inference guide: https://ai.google.dev/edge/mediapipe/solutions/genai/llm_inference
36
+ - Flutter Gemma docs: https://pub.dev/packages/flutter_gemma
37
+
38
+ ## License
39
+
40
+ This converted artifact follows the license and use restrictions of the source Gemma/FunctionGemma model. Review the source model card and Gemma terms before redistribution or production use.