OpenHermes-13B

13
56
13.0B
1 language
llama
by
teknium
Language Model
OTHER
13B params
New
13 downloads
Early-stage
Try on Hugging FaceAdd to Compare
Edge AI:
Mobile
Laptop
Server
30GB+ RAM
Mobile
Laptop
Server
Quick Summary

OpenHermes 13B is the first fine tune of the Hermes dataset that has a fully open source dataset!

Device Compatibility

Mobile
4-6GB RAM
Laptop
16GB RAM
Server
GPU
Minimum Recommended
13GB+ RAM

Code Examples

Benchmark Informationtext
|    Task     |Version| Metric |Value |   |Stderr|
|-------------|------:|--------|-----:|---|-----:|
|arc_challenge|      0|acc     |0.5009|±  |0.0146|
|             |       |acc_norm|0.5247|±  |0.0146|
|arc_easy     |      0|acc     |0.8127|±  |0.0080|
|             |       |acc_norm|0.7854|±  |0.0084|
|boolq        |      1|acc     |0.8153|±  |0.0068|
|hellaswag    |      0|acc     |0.6126|±  |0.0049|
|             |       |acc_norm|0.7995|±  |0.0040|
|openbookqa   |      0|acc     |0.3660|±  |0.0216|
|             |       |acc_norm|0.4600|±  |0.0223|
|piqa         |      0|acc     |0.7922|±  |0.0095|
|             |       |acc_norm|0.8112|±  |0.0091|
|winogrande   |      0|acc     |0.7293|±  |0.0125|
Average: 0.7036
Benchmark Informationtext
|    Task     |Version| Metric |Value |   |Stderr|
|-------------|------:|--------|-----:|---|-----:|
|arc_challenge|      0|acc     |0.5009|±  |0.0146|
|             |       |acc_norm|0.5247|±  |0.0146|
|arc_easy     |      0|acc     |0.8127|±  |0.0080|
|             |       |acc_norm|0.7854|±  |0.0084|
|boolq        |      1|acc     |0.8153|±  |0.0068|
|hellaswag    |      0|acc     |0.6126|±  |0.0049|
|             |       |acc_norm|0.7995|±  |0.0040|
|openbookqa   |      0|acc     |0.3660|±  |0.0216|
|             |       |acc_norm|0.4600|±  |0.0223|
|piqa         |      0|acc     |0.7922|±  |0.0095|
|             |       |acc_norm|0.8112|±  |0.0091|
|winogrande   |      0|acc     |0.7293|±  |0.0125|
Average: 0.7036
Benchmark Informationtext
|    Task     |Version| Metric |Value |   |Stderr|
|-------------|------:|--------|-----:|---|-----:|
|arc_challenge|      0|acc     |0.5009|±  |0.0146|
|             |       |acc_norm|0.5247|±  |0.0146|
|arc_easy     |      0|acc     |0.8127|±  |0.0080|
|             |       |acc_norm|0.7854|±  |0.0084|
|boolq        |      1|acc     |0.8153|±  |0.0068|
|hellaswag    |      0|acc     |0.6126|±  |0.0049|
|             |       |acc_norm|0.7995|±  |0.0040|
|openbookqa   |      0|acc     |0.3660|±  |0.0216|
|             |       |acc_norm|0.4600|±  |0.0223|
|piqa         |      0|acc     |0.7922|±  |0.0095|
|             |       |acc_norm|0.8112|±  |0.0091|
|winogrande   |      0|acc     |0.7293|±  |0.0125|
Average: 0.7036
Benchmark Informationtext
|    Task     |Version| Metric |Value |   |Stderr|
|-------------|------:|--------|-----:|---|-----:|
|arc_challenge|      0|acc     |0.5009|±  |0.0146|
|             |       |acc_norm|0.5247|±  |0.0146|
|arc_easy     |      0|acc     |0.8127|±  |0.0080|
|             |       |acc_norm|0.7854|±  |0.0084|
|boolq        |      1|acc     |0.8153|±  |0.0068|
|hellaswag    |      0|acc     |0.6126|±  |0.0049|
|             |       |acc_norm|0.7995|±  |0.0040|
|openbookqa   |      0|acc     |0.3660|±  |0.0216|
|             |       |acc_norm|0.4600|±  |0.0223|
|piqa         |      0|acc     |0.7922|±  |0.0095|
|             |       |acc_norm|0.8112|±  |0.0091|
|winogrande   |      0|acc     |0.7293|±  |0.0125|
Average: 0.7036
Benchmark Informationtext
|    Task     |Version| Metric |Value |   |Stderr|
|-------------|------:|--------|-----:|---|-----:|
|arc_challenge|      0|acc     |0.5009|±  |0.0146|
|             |       |acc_norm|0.5247|±  |0.0146|
|arc_easy     |      0|acc     |0.8127|±  |0.0080|
|             |       |acc_norm|0.7854|±  |0.0084|
|boolq        |      1|acc     |0.8153|±  |0.0068|
|hellaswag    |      0|acc     |0.6126|±  |0.0049|
|             |       |acc_norm|0.7995|±  |0.0040|
|openbookqa   |      0|acc     |0.3660|±  |0.0216|
|             |       |acc_norm|0.4600|±  |0.0223|
|piqa         |      0|acc     |0.7922|±  |0.0095|
|             |       |acc_norm|0.8112|±  |0.0091|
|winogrande   |      0|acc     |0.7293|±  |0.0125|
Average: 0.7036
Benchmark Informationtext
|    Task     |Version| Metric |Value |   |Stderr|
|-------------|------:|--------|-----:|---|-----:|
|arc_challenge|      0|acc     |0.5009|±  |0.0146|
|             |       |acc_norm|0.5247|±  |0.0146|
|arc_easy     |      0|acc     |0.8127|±  |0.0080|
|             |       |acc_norm|0.7854|±  |0.0084|
|boolq        |      1|acc     |0.8153|±  |0.0068|
|hellaswag    |      0|acc     |0.6126|±  |0.0049|
|             |       |acc_norm|0.7995|±  |0.0040|
|openbookqa   |      0|acc     |0.3660|±  |0.0216|
|             |       |acc_norm|0.4600|±  |0.0223|
|piqa         |      0|acc     |0.7922|±  |0.0095|
|             |       |acc_norm|0.8112|±  |0.0091|
|winogrande   |      0|acc     |0.7293|±  |0.0125|
Average: 0.7036
Benchmark Informationtext
|    Task     |Version| Metric |Value |   |Stderr|
|-------------|------:|--------|-----:|---|-----:|
|arc_challenge|      0|acc     |0.5009|±  |0.0146|
|             |       |acc_norm|0.5247|±  |0.0146|
|arc_easy     |      0|acc     |0.8127|±  |0.0080|
|             |       |acc_norm|0.7854|±  |0.0084|
|boolq        |      1|acc     |0.8153|±  |0.0068|
|hellaswag    |      0|acc     |0.6126|±  |0.0049|
|             |       |acc_norm|0.7995|±  |0.0040|
|openbookqa   |      0|acc     |0.3660|±  |0.0216|
|             |       |acc_norm|0.4600|±  |0.0223|
|piqa         |      0|acc     |0.7922|±  |0.0095|
|             |       |acc_norm|0.8112|±  |0.0091|
|winogrande   |      0|acc     |0.7293|±  |0.0125|
Average: 0.7036

Deploy This Model

Production-ready deployment in minutes

Together.ai

Instant API access to this model

Fastest API

Production-ready inference API. Start free, scale to millions.

Try Free API

Replicate

One-click model deployment

Easiest Setup

Run models in the cloud with simple API. No DevOps required.

Deploy Now

Disclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.