---
license: apache-2.0
base_model: Qwen/Qwen3.5-27B
tags:
- qwen
- qwen3.5
- reasoning
- chat
- text-only
- 40b
- upscale
---

<style>
body {
  font-family: 'Quicksand', sans-serif;
  /* Replaced purple gradient with a warm, fiery one */
  background: linear-gradient(135deg, #4a1e00 0%, #1c0a00 100%);
  /* Changed text color to a warmer, parchment-like off-white */
  color: #F5EFE6;
  margin: 0;
  padding: 0;
  font-size: 16px;
}

h1, h2, h3, h4, summary {
    font-family: 'Cinzel', serif;
}

.container {
  margin: 20px auto;
  max-width: 900px;
  background-color: rgba(28, 22, 18, 0.95);
  padding: 30px;
  border-radius: 12px;
  box-shadow: 0 4px 20px rgba(255, 140, 0, 0.15);
  border: 1px solid rgba(255, 140, 0, 0.2);
  outline: 1px solid rgba(255, 140, 0, 0.5);
  outline-offset: -1px;
  position: relative;
}

.container::before {
  content: '';
  position: absolute;
  top: -1px;
  left: -1px;
  right: -1px;
  bottom: -1px;
  border: 1px solid rgba(255, 165, 0, 0.98);
  border-radius: 12px;
  pointer-events: none;
  animation: borderGlow 2.5s ease-in-out infinite;
}

@keyframes borderGlow {
  0% {
    box-shadow: 0 0 5px rgba(255, 165, 0, 0.98);
  }
  50% {
    box-shadow: 0 0 12px rgba(255, 165, 0, 0.98);
  }
  100% {
    box-shadow: 0 0 5px rgba(255, 165, 0, 0.98);
  }
}

.header h1 {
  font-size: 32px;
  color: #FFA500;
  margin: 0 0 20px 0;
  text-align: center;
  text-shadow: 0 0 12px rgba(255, 100, 0, 0.6);
}

a {
  color: #FFD700;
  text-decoration: none;
  transition: color 0.3s ease;
}

a:hover {
  color: #FFDAB9;
}

.button {
  display: inline-block;
  background-color: #E55B00;
  color: #FFFFFF;
  padding: 12px 24px;
  border-radius: 5px;
  cursor: pointer;
  text-decoration: none;
  font-family: 'Cinzel', serif;
  font-weight: 600;
  transition: all 0.3s ease;
  border: 1px solid transparent;
}

.button:hover {
  background-color: #FF8C00;
  box-shadow: 0 0 15px rgba(255, 140, 0, 0.5);
  transform: translateY(-2px);
}

pre {
  background-color: rgba(45, 35, 25, 0.95);
  padding: 15px;
  border-radius: 5px;
  overflow-x: auto;
  border: 1px solid rgba(255, 140, 0, 0.2);
  outline: 1px solid rgba(255, 140, 0, 0.5);
  outline-offset: -1px;
}

code {
  font-family: 'Courier New', monospace;
  /* Code text uses the new base text color */
  color: #F5EFE6;
}

/* Section Container */
.section-container {
  margin: 40px 0;
}

h2 {
    font-size: 26px;
    /* Section headers are orange */
    color: #FFA500;
    text-shadow: 0 0 10px rgba(255, 140, 0, 0.5);
    border-bottom: 1px solid rgba(255, 140, 0, 0.2);
    padding-bottom: 10px;
    margin-bottom: 20px;
}

.info-card {
  /* Card background is a warm dark brown */
  background: rgba(45, 35, 25, 0.95);
  border: 1px solid rgba(255, 140, 0, 0.2);
  border-radius: 8px;
  overflow: hidden;
  margin-bottom: 25px;
}

.info-header {
  /* Header background has an orange tint */
  background: rgba(255, 140, 0, 0.1);
  padding: 20px;
  border-bottom: 1px solid rgba(255, 140, 0, 0.2);
}

.info-header h3 {
  /* Card titles are orange */
  color: #FFA500;
  margin: 0 0 10px 0;
  font-size: 22px;
  text-shadow: 0 0 5px rgba(255, 140, 0, 0.3);
}

.card-content {
  padding: 20px;
  line-height: 1.7;
}

.card-content p, .card-content li {
    margin-bottom: 1em;
}

.card-content p:last-child, .card-content li:last-child {
    margin-bottom: 0;
}

.card-content ul {
    list-style: none;
    padding-left: 20px;
}

.card-content li::before {
    content: '✦';
    /* Bullet points are gold */
    color: #FFD700;
    font-weight: bold;
    display: inline-block;
    width: 1em;
    margin-left: -1.2em;
    font-size: 1.2em;
    line-height: 1;
}

.card-content strong {
    /* Strong text is gold */
    color: #FFD700;
    font-weight: 600;
}

/* Warning Card Specifics */
.warning-card {
  border: 2px solid #ff3333;
  box-shadow: 0 0 15px rgba(255, 50, 50, 0.2);
  animation: warningPulse 3s infinite;
}

@keyframes warningPulse {
  0% { box-shadow: 0 0 10px rgba(255, 50, 50, 0.3); }
  50% { box-shadow: 0 0 25px rgba(255, 50, 50, 0.6); }
  100% { box-shadow: 0 0 10px rgba(255, 50, 50, 0.3); }
}

.warning-header {
  background: rgba(255, 50, 50, 0.15);
  border-bottom: 1px solid #ff3333;
}

.warning-header h3 {
  color: #ff5555;
  text-align: center;
  font-size: 26px;
  text-shadow: 0 0 8px rgba(255, 50, 50, 0.6);
}

.warning-content p {
  text-align: center;
  font-size: 1.2em;
}

.warning-content strong {
  color: #ff5555;
}

/* Configuration */
.config-container {
  background: rgba(45, 35, 25, 0.95);
  border: 1px solid rgba(255, 140, 0, 0.2);
  border-radius: 8px;
  overflow: hidden;
}

.config-header {
  background: rgba(255, 140, 0, 0.1);
  padding: 15px 20px;
  border-bottom: 1px solid rgba(255, 140, 0, 0.2);
}

.config-header h3 {
    margin: 0;
    color: #FFA500;
    font-size: 22px;
}

.config-content {
  padding: 20px;
  display: grid;
  grid-template-columns: repeat(auto-fit, minmax(200px, 1fr));
  gap: 20px;
}

.config-item {
  display: flex;
  flex-direction: column;
  gap: 5px;
}

.config-label {
  /* Config labels are gold */
  color: #FFD700;
  font-size: 14px;
  font-weight: 500;
  font-family: 'Quicksand', sans-serif;
}

.config-value {
  /* Config values use the new base text color */
  color: #F5EFE6;
  font-family: 'Courier New', monospace;
  font-size: 18px;
  font-weight: bold;
}

.support-section {
    text-align: center;
    margin-top: 40px;
    background: rgba(45, 35, 25, 0.95);
    border: 1px solid rgba(255, 140, 0, 0.2);
    border-radius: 8px;
    padding: 20px;
}

.support-section p {
    margin-bottom: 15px;
    font-size: 1.1em;
    margin-top: 0;
}

summary {
    cursor: pointer;
    list-style: none; /* Remove default arrow */
    outline: none;
    display: flex;
    align-items: flex-start; /* Align items to the top to respect h2's vertical space */
}
summary::-webkit-details-marker {
    display: none;
}
summary::before {
    content: '▶';
    font-size: 1.2em;
    color: #FFA500; /* Match h2 color */
    margin-right: 15px;
    padding-top: 5px; /* Adjust vertical alignment with h2 text */
    transition: transform 0.2s ease;
    flex-shrink: 0; /* Prevent the arrow from shrinking */
}
details[open] > summary::before {
    transform: rotate(90deg);
}
summary > h2 {
    flex-grow: 1;
}
</style>
<div class="container">
<link href="https://fonts.googleapis.com/css2?family=Cinzel:wght@400;500;600&family=Quicksand:wght@400;500&display=swap" rel="stylesheet">
<div class="header">
  <h1>Qwen3.5-27B to 40B Upscale</h1>
</div>
<div class="info">
  
  <div class="info-card warning-card">
    <div class="info-header warning-header">
      <h3>⚠️ BIG WARNING ⚠️</h3>
    </div>
    <div class="card-content warning-content">
      <p><strong>NOT TO BE USED AS IS, AND REQUIRES FINE-TUNING.</strong></p>
      <p>This upscaled model produces gibberish out of the box and currently has a default <strong>PPL of 500k</strong>.</p>
    </div>
  </div>

  <div class="support-section">
    <p><strong>Send me your support to help me feed the data beast! also taking comissions for universe specific models</strong></p>
    <a href="https://ko-fi.com/som1tokmynam" target="_blank" class="button">
      Support on Ko-fi
    </a>
  </div>
  
  <div class="section-container">
    <details open>
      <summary><h2>Model Description</h2></summary>
      <div class="info-card">
        <div class="card-content">
          <p>This model is an <strong>interleaved upscale of Qwen3.5-27B to 40B</strong>. It expands the base architecture from 64 to 96 layers using an interleaved copying technique.</p>
          <p><strong>Upscaling Details:</strong></p>
          <ul>
            <li><strong>Layer Expansion:</strong> 64 to 96 layers.</li>
            <li><strong>Copying Strategy:</strong> Layers were copied in groups of 4 to successfully keep the 3>1 linear to full attention ratio.</li>
            <li><strong>Added Noise:</strong> Noise was purposefully introduced during the upscaling process to aid in future fine-tuning recovery. 
              <br>✦ Layers <code>o_proj</code>, <code>down_proj</code>, and <code>out_proj</code> were mapped with <strong>σ = 0.000625</strong>. 
              <br>✦ The remaining layers were mapped with <strong>σ = 0.0025</strong>.
            </li>
          </ul>
        </div>
      </div>
    </details>
  </div>


  <div class="section-container">
    <details>
      <summary><h2>Acknowledgements</h2></summary>
      <div class="info-card">
          <div class="card-content">
              <ul>
                  <li>Credit to Qwen for the powerful Qwen3 architecture and for releasing their work openly.</li>
              </ul>
          </div>
      </div>
    </details>
  </div>

</div>
</div>