nreimers
18 models • 1 total models in database
Sort by:
TinyBERT_L-4_H-312_v2
This is the [General_TinyBERT_v2(4layer-312dim)](https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/TinyBERT) ported to Huggingface transformers.
—
454,290
1
MiniLMv2-L6-H384-distilled-from-BERT-Large
This is a MiniLMv2 model from: [https://github.com/microsoft/unilm](https://github.com/microsoft/unilm/tree/master/minilm)
—
68,825
1
MiniLM-L3-H384-uncased
license:mit
33,157
3
mMiniLMv2-L12-H384-distilled-from-XLMR-Large
—
9,774
17
MiniLM-L6-H384-uncased
This is a 6 layer version of microsoft/MiniLM-L12-H384-uncased by keeping only every second layer.
license:mit
2,584
42
BERT-Tiny_L-2_H-128_A-2
—
1,327
3
mmarco-mMiniLMv2-L12-H384-v1
—
1,038
17
mMiniLMv2-L6-H384-distilled-from-XLMR-Large
—
519
17
MiniLMv2-L6-H768-distilled-from-RoBERTa-Large
—
41
3
MiniLMv2-L6-H384-distilled-from-RoBERTa-Large
—
18
7
mmarco-mMiniLMv2-L6-H384-v1
—
13
2
albert-small-v2
—
8
0
MiniLMv2-L12-H384-distilled-from-RoBERTa-Large
—
7
5
MiniLMv2-L6-H768-distilled-from-BERT-Large
—
5
3
MiniLMv2-L6-H384-distilled-from-BERT-Base
—
4
0
BERT-Small-L-4_H-512_A-8
—
2
0
MiniLMv2-L6-H768-distilled-from-BERT-Base
—
1
2
TinyBERT_L-6_H-768_v2
—
0
2