--- language: - en - zh license: apache-2.0 tags: - unsloth - nightmedia - fine tune - heretic - abliterated - uncensored - creative - creative writing - fiction writing - plot generation - sub-plot generation - fiction writing - story generation - scene continue - storytelling - fiction story - science fiction - romance - all genres - story - writing - vivid prosing - vivid writing - fiction - roleplaying - bfloat16 - all use cases - mxfp8 - merge - mergekit - mlx library_name: transformers pipeline_tag: image-text-to-text base_model: - nightmedia/Qwen3.5-9B-TNG-PKD-Qwopus-Coder - nightmedia/Qwen3.5-9B-TNG-PKD-Qwopus-Writer-Orwell-1984 - DavidAU/Qwen3.5-9B-Pro-Writer-1984-Orwell-Uncensored-Heretic --- # Qwen3.5-9B-TNG-PKD-Qwopus-Writer-Orwell-1984-mxfp8-mlx Brainwaves ```brainwaves arc arc/e boolq hswag obkqa piqa wino mxfp8 0.642,0.811,0.887 Quant Perplexity Peak Memory Tokens/sec mxfp8 4.298 ± 0.028 16.02 GB 630 ``` # Model components DavidAU/Qwen3.5-9B-Pro-Writer-1984-Orwell-Uncensored-Heretic ```brainwaves arc arc/e boolq hswag obkqa piqa wino qx86-hi 0.575,0.738,0.880 ``` Qwen3.5-9B-TNG-PKD-Qwopus-Coder ```brainwaves arc arc/e boolq hswag obkqa piqa wino qx86-hi 0.642,0.819,0.895,0.716,0.454,0.785,0.699 ``` # Model recipe ```recipe models: - model: nightmedia/Qwen3.5-9B-TNG-PKD-Qwopus-Coder parameters: weight: 1.6 - model: DavidAU/Qwen3.5-9B-Pro-Writer-1984-Orwell-Uncensored-Heretic parameters: weight: 0.4 merge_method: nuslerp dtype: bfloat16 name: Qwen3.5-9B-TNG-PKD-Qwopus-Writer-Orwell-1984 ``` ## Use with mlx ```bash pip install mlx-lm ``` ```python from mlx_lm import load, generate model, tokenizer = load("Qwen3.5-9B-TNG-PKD-Qwopus-Writer-Orwell-1984-mxfp8-mlx") prompt = "hello" if tokenizer.chat_template is not None: messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True, return_dict=False, ) response = generate(model, tokenizer, prompt=prompt, verbose=True) ```