nsfwthrowitaway69

- A result of interleaving layers of Sao10K/Euryale-1.3-L2-70B, Xwin-LM/Xwin-LM-70B-V0.1, and migtissera/SynthIA-70B-v1.5 using mergekit. - The resulting model has 140 layers and approximately 122 billion parameters. - See mergekit-config.yml for details on the merge method used. - See the `exl2-` branches for exllama2 quantizations. The 4.85 bpw quant should fit in 80GB VRAM, and the 3.0 bpw quant should (just barely) fit in 48GB VRAM with 4k context. - Inspired by Goliath-120b Seems to be more coherent than v1.0, likely due to using SynthIA 1.2b instead of 1.5.

lzlv70B A Mythomax/MLewd13B-style merge of selected 70B models A multi-model merge of several LLaMA2 70B finetunes for roleplaying and creative work. The goal was to create a model that combines creativity with intelligence for an enhanced experience. Did it work? Probably, maybe. It seemed subjectively better than each of the individual models in my tests. ~~GGUF 4KM + 5KM can be found here: https://huggingface.co/lizpreciatior/lzlv70bfp16hf/settings~~ Update 29/10: Thank you to TheBloke for making the whole range of quants for lzlv: https://huggingface.co/TheBloke/lzlv70B-GGUF Also recommended: lzlv merged with limarpv3 - check it out here: https://huggingface.co/Doctor-Shotgun/lzlv-limarpv3-l2-70b/tree/main Thanks for merging the LoRA. I think it gives the model a bit more creative spice. Models used: - NousResearch/Nous-Hermes-Llama2-70b - A great model for roleplaying, but not the best at following complex instructions. - Xwin-LM/Xwin-LM-7B-V0.1 - Excellent at following instructions and quite creative out of the box, so it seemed like the best available model to act as the base for the merge. - Doctor-Shotgun/Mythospice-70b - The wildcard of the three. I was looking for a creative, NSFW-oriented model and came across this while digging through hf. I hadn't heard of it before and apparently no one had bothered to release a quantized version of this model. So I downloaded it and did it myself to test it. It turned out to be more or less what I was looking for as my third component, so I used it here. A big thank you to the creators of the models above. If you look up Mythospice, you will notice that it also includes Nous-Hermes so it's technically present twice in this mix. This is apparently common practice amongst the cool kids who do 13B models so I don't think this hurts the model. The merging process was heavily inspired by Undi95's approach in Undi95/MXLewdMini-L2-13B. To be specific, the ratios are: Component 1: Merge of Mythospice x Xwin with SLERP gradient [0.25, 0.3, 0.5]. Component 2: Merge Xwin x Hermes with SLERP gradient [0.4, 0.3, 0.25]. Finally, both Component 1 and Component 2 were merged with SLERP using weight 0.5. I tested this model for a few days before publishing it. It seems to more or less retain the instruction-following capabilities of Xwin-70B, while seeming to have adopted a lot of the creativity of the other two models. It handled my more complex scenarios that creative models otherwise tend to struggle with quite well. At the same time, its outputs felt more creative and possibly a bit more nsfw-inclined than Xwin-70b. So, is it better? Feels like it to me, subjectively. Is it really better? No clue, test it.