Fenrir-X-26B-A4B

Overview

Fenrir-X-26B-A4B was created by combining gemma-4-26B-A4B-it, gemma-4-26B-A4B-it-Claude-Opus-Distill-v2, Pantheon-Reasoning-26B-A4B-1.1-V2, gemma4-26b-fiction-bf16, and Gemma-4-26B-A4B-Animus-V14.1-FFT using a custom merge method.

Merge Configuration

base_model: google/gemma-4-26B-A4B-it
models:
  - model: TeichAI/gemma-4-26B-A4B-it-Claude-Opus-Distill-v2
    parameters:
      weight:
        - filter: self_attn.q_proj.weight
          value: [0.16, 0.2, 0.24, 0.26, 0.28]
        - filter: self_attn.k_proj.weight
          value: [0.15, 0.19, 0.22, 0.24, 0.26]
        - filter: self_attn.v_proj.weight
          value: [0.15, 0.19, 0.23, 0.25, 0.27]
        - filter: self_attn.o_proj.weight
          value: [0.09, 0.12, 0.15, 0.17, 0.19]
        - filter: mlp.gate_proj.weight
          value: [0.09, 0.12, 0.15, 0.17, 0.18]
        - filter: mlp.up_proj.weight
          value: [0.09, 0.12, 0.15, 0.17, 0.18]
        - filter: mlp.down_proj.weight
          value: [0.08, 0.11, 0.14, 0.16, 0.17]
        - filter: experts.gate_up_proj
          value: [0.18, 0.22, 0.25, 0.26, 0.25]
        - filter: experts.down_proj
          value: [0.2, 0.24, 0.27, 0.28, 0.27]
        - value: 0.0
  - model: Gryphe/Pantheon-Reasoning-26B-A4B-1.1-V2
    parameters:
      weight:
        - filter: self_attn.q_proj.weight
          value: [0.14, 0.17, 0.2, 0.23, 0.25]
        - filter: self_attn.k_proj.weight
          value: [0.13, 0.16, 0.19, 0.22, 0.24]
        - filter: self_attn.v_proj.weight
          value: [0.14, 0.17, 0.2, 0.23, 0.25]
        - filter: self_attn.o_proj.weight
          value: [0.15, 0.19, 0.23, 0.27, 0.31]
        - filter: mlp.gate_proj.weight
          value: [0.15, 0.19, 0.23, 0.27, 0.31]
        - filter: mlp.up_proj.weight
          value: [0.15, 0.19, 0.23, 0.27, 0.31]
        - filter: mlp.down_proj.weight
          value: [0.14, 0.18, 0.22, 0.26, 0.3]
        - filter: experts.gate_up_proj
          value: [0.14, 0.16, 0.18, 0.19, 0.2]
        - filter: experts.down_proj
          value: [0.15, 0.17, 0.19, 0.2, 0.21]
        - value: 0.0
  - model: electroglyph/gemma4-26b-fiction-bf16
    parameters:
      weight:
        - filter: self_attn.q_proj.weight
          value: [0.08, 0.1, 0.12, 0.14, 0.16]
        - filter: self_attn.k_proj.weight
          value: [0.07, 0.09, 0.11, 0.13, 0.15]
        - filter: self_attn.v_proj.weight
          value: [0.09, 0.11, 0.13, 0.15, 0.17]
        - filter: self_attn.o_proj.weight
          value: [0.17, 0.21, 0.25, 0.29, 0.33]
        - filter: mlp.gate_proj.weight
          value: [0.18, 0.22, 0.26, 0.3, 0.34]
        - filter: mlp.up_proj.weight
          value: [0.18, 0.22, 0.26, 0.3, 0.34]
        - filter: mlp.down_proj.weight
          value: [0.17, 0.21, 0.25, 0.29, 0.33]
        - filter: experts.gate_up_proj
          value: [0.22, 0.26, 0.29, 0.3, 0.3]
        - filter: experts.down_proj
          value: [0.24, 0.28, 0.31, 0.32, 0.32]
        - value: 0.0
  - model: Darkhn/Gemma-4-26B-A4B-Animus-V14.1-FFT
    parameters:
      weight:
        - filter: experts.gate_up_proj
          value: [0.27, 0.32, 0.36, 0.37, 0.36]
        - filter: experts.down_proj
          value: [0.3, 0.35, 0.39, 0.4, 0.39]
        - value: 0.0
merge_method: bsc
chat_template: auto
parameters:
  gain: 0.95
  balance: 0.95
  synthesis: 0.92
  anchor: 0.92
dtype: float32
out_dtype: bfloat16
tokenizer:
  source: base

Intended Use

Roleplay

Character-driven interaction, personas, dialogue, emotional scenes, and long-form roleplay.

Creative Writing

Fiction, dialogue, atmosphere, descriptive writing, stylistic drafting, and imaginative prose.

Storytelling

Long-form narratives, worldbuilding, continuity, evolving characters, and multi-character plots.

Interactive Fiction

Branching narratives, scenario play, character interaction, and continuously evolving stories.