ECE-EIFFEL-3Bv2
1
license:apache-2.0
by
lesubra
Code Model
OTHER
3B params
New
1 downloads
Early-stage
Edge AI:
Mobile
Laptop
Server
7GB+ RAM
Mobile
Laptop
Server
Quick Summary
ECE-EIFFEL-3Bv2 is a merge of the following models using mergekit: lesubra/merge-test microsoft/Phi-3.
Device Compatibility
Mobile
4-6GB RAM
Laptop
16GB RAM
Server
GPU
Minimum Recommended
3GB+ RAM
Code Examples
🧩 Configurationyaml
slices:
- sources:
- model: lesubra/merge-test
layer_range: [0, 32]
- model: microsoft/Phi-3.5-mini-instruct
layer_range: [0, 32]
merge_method: slerp
base_model: lesubra/merge-test
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16🧩 Configurationyaml
slices:
- sources:
- model: lesubra/merge-test
layer_range: [0, 32]
- model: microsoft/Phi-3.5-mini-instruct
layer_range: [0, 32]
merge_method: slerp
base_model: lesubra/merge-test
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16🧩 Configurationyaml
slices:
- sources:
- model: lesubra/merge-test
layer_range: [0, 32]
- model: microsoft/Phi-3.5-mini-instruct
layer_range: [0, 32]
merge_method: slerp
base_model: lesubra/merge-test
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16🧩 Configurationyaml
slices:
- sources:
- model: lesubra/merge-test
layer_range: [0, 32]
- model: microsoft/Phi-3.5-mini-instruct
layer_range: [0, 32]
merge_method: slerp
base_model: lesubra/merge-test
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16🧩 Configurationyaml
slices:
- sources:
- model: lesubra/merge-test
layer_range: [0, 32]
- model: microsoft/Phi-3.5-mini-instruct
layer_range: [0, 32]
merge_method: slerp
base_model: lesubra/merge-test
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16🧩 Configurationyaml
slices:
- sources:
- model: lesubra/merge-test
layer_range: [0, 32]
- model: microsoft/Phi-3.5-mini-instruct
layer_range: [0, 32]
merge_method: slerp
base_model: lesubra/merge-test
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16🧩 Configurationyaml
slices:
- sources:
- model: lesubra/merge-test
layer_range: [0, 32]
- model: microsoft/Phi-3.5-mini-instruct
layer_range: [0, 32]
merge_method: slerp
base_model: lesubra/merge-test
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16Deploy This Model
Production-ready deployment in minutes
Together.ai
Instant API access to this model
Production-ready inference API. Start free, scale to millions.
Try Free APIReplicate
One-click model deployment
Run models in the cloud with simple API. No DevOps required.
Deploy NowDisclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.