Falcon3-Jessi-v0.4-7B-Slerp

Name: Falcon3-Jessi-v0.4-7B-Slerp
Rating: 8.3 (10 reviews)
Author: suayptalha

7.0B

4 languages

llama

suayptalha

Language Model

OTHER

7B params

New

2 downloads

Early-stage

Try on Hugging Face Add to Compare

Edge AI:

Mobile

Laptop

Server

16GB+ RAM

Mobile

Laptop

Server

Quick Summary

AI model with specialized capabilities.

Device Compatibility

Mobile

4-6GB RAM

Laptop

16GB RAM

Server

GPU

Minimum Recommended

7GB+ RAM

Training Data Analysis

🔴 Low Quality (2.5/10)

Researched training datasets used by Falcon3-Jessi-v0.4-7B-Slerp with quality assessment

Specialized For

general

science

Training Datasets (1)

common crawl

🔴 2.5/10

general

science

Key Strengths

•Scale and Accessibility: At 9.5+ petabytes, Common Crawl provides unprecedented scale for training d...
•Diversity: The dataset captures billions of web pages across multiple domains and content types, ena...
•Comprehensive Coverage: Despite limitations, Common Crawl attempts to represent the broader web acro...

Considerations

•Biased Coverage: The crawling process prioritizes frequently linked domains, making content from dig...
•Large-Scale Problematic Content: Contains significant amounts of hate speech, pornography, violent c...

Explore our comprehensive training dataset analysis

View All Datasets

Code Examples

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Configurationyaml

base_model: neopolita/jessi-v0.4-falcon3-7b-instruct
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: tiiuae/Falcon3-7B-Instruct
  - layer_range: [0, 28]
    model: neopolita/jessi-v0.4-falcon3-7b-instruct

Deploy This Model

Production-ready deployment in minutes

Together.ai

Instant API access to this model

Fastest API

Production-ready inference API. Start free, scale to millions.

Try Free API

Replicate

One-click model deployment

Easiest Setup

Run models in the cloud with simple API. No DevOps required.

Deploy Now

Disclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.