Text Generation
MLX
Safetensors
kimi_k3
Mixture of Experts
reap
pruned
kimi
apple-silicon
custom_code
Instructions to use pipenetwork/Kimi-K3-REAP73-zh-code-MLX-mxfp4-q8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use pipenetwork/Kimi-K3-REAP73-zh-code-MLX-mxfp4-q8 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("pipenetwork/Kimi-K3-REAP73-zh-code-MLX-mxfp4-q8") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use pipenetwork/Kimi-K3-REAP73-zh-code-MLX-mxfp4-q8 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "pipenetwork/Kimi-K3-REAP73-zh-code-MLX-mxfp4-q8" --prompt "Once upon a time"
File size: 1,011 Bytes
affbc49 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 | {
"media_proc_cfg": {
"in_patch_limit": 65536,
"patch_size": 14,
"image_mean": [
0.5,
0.5,
0.5
],
"image_std": [
0.5,
0.5,
0.5
],
"merge_kernel_size": 2,
"fixed_output_tokens": null,
"patch_limit_on_one_side": 512,
"in_patch_limit_each_frame": 16384,
"in_patch_limit_video": 655360,
"sample_fps": 8.0,
"max_num_frames_each_video": null,
"temporal_merge_kernel_size": 4,
"timestamp_mode": "hh:mm:ss.fff",
"transparent_bg_config": {
"pattern": "chessboard",
"chessboard_square_size": 8,
"chessboard_square_on_top_left": true,
"chessboard_white_value": 255,
"chessboard_gray_value": 180
},
"transparent_bg_fill_stage": "after_resize",
"config_type": "media_proc.processors.moonvit.MoonViTMediaProcessorConfig"
},
"auto_map": {
"AutoProcessor": "kimi_k3_processor.KimiK3Processor",
"AutoImageProcessor": "kimi_k3_vision_processing.KimiK3VisionProcessor"
}
} |