Text Generation
MLX
Safetensors
kimi_k3
Mixture of Experts
reap
pruned
kimi
apple-silicon
custom_code
Instructions to use pipenetwork/Kimi-K3-REAP73-zh-code-MLX-mxfp4-q8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use pipenetwork/Kimi-K3-REAP73-zh-code-MLX-mxfp4-q8 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("pipenetwork/Kimi-K3-REAP73-zh-code-MLX-mxfp4-q8") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use pipenetwork/Kimi-K3-REAP73-zh-code-MLX-mxfp4-q8 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "pipenetwork/Kimi-K3-REAP73-zh-code-MLX-mxfp4-q8" --prompt "Once upon a time"
| { | |
| "media_proc_cfg": { | |
| "in_patch_limit": 65536, | |
| "patch_size": 14, | |
| "image_mean": [ | |
| 0.5, | |
| 0.5, | |
| 0.5 | |
| ], | |
| "image_std": [ | |
| 0.5, | |
| 0.5, | |
| 0.5 | |
| ], | |
| "merge_kernel_size": 2, | |
| "fixed_output_tokens": null, | |
| "patch_limit_on_one_side": 512, | |
| "in_patch_limit_each_frame": 16384, | |
| "in_patch_limit_video": 655360, | |
| "sample_fps": 8.0, | |
| "max_num_frames_each_video": null, | |
| "temporal_merge_kernel_size": 4, | |
| "timestamp_mode": "hh:mm:ss.fff", | |
| "transparent_bg_config": { | |
| "pattern": "chessboard", | |
| "chessboard_square_size": 8, | |
| "chessboard_square_on_top_left": true, | |
| "chessboard_white_value": 255, | |
| "chessboard_gray_value": 180 | |
| }, | |
| "transparent_bg_fill_stage": "after_resize", | |
| "config_type": "media_proc.processors.moonvit.MoonViTMediaProcessorConfig" | |
| }, | |
| "auto_map": { | |
| "AutoProcessor": "kimi_k3_processor.KimiK3Processor", | |
| "AutoImageProcessor": "kimi_k3_vision_processing.KimiK3VisionProcessor" | |
| } | |
| } |