ise-uiuc

> Refer to our GitHub repo ise-uiuc/magicoder for an up-to-date introduction to the Magicoder family! 🎩Magicoder is a model family empowered by 🪄OSS-Instruct, a novel approach to enlightening LLMs with open-source code snippets for generating low-bias and high-quality instruction data for code. 🪄OSS-Instruct mitigates the inherent bias of the LLM-synthesized instruction data by empowering them with a wealth of open-source references to produce more diverse, realistic, and controllable data. Developed by: Yuxiang Wei, Zhe Wang, Jiawei Liu, Yifeng Ding, Lingming Zhang License: DeepSeek Finetuned from model: deepseek-coder-6.7b-base Magicoder-OSS-Instruct-75K: generated through OSS-Instruct using `gpt-3.5-turbo-1106` and used to train both Magicoder and Magicoder-S series. Magicoder-Evol-Instruct-110K: decontaminated and redistributed from theblackcat102/evol-codealpaca-v1, used to further finetune Magicoder series and obtain Magicoder-S models. Magicoders are designed and best suited for coding tasks. Magicoders may sometimes make errors, producing misleading contents, or struggle to manage tasks that are not related to coding. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Make sure you installed the transformers library. WizardCoder: Evol-Instruct DeepSeek-Coder: Base model for Magicoder-DS CodeLlama: Base model for Magicoder-CL StarCoder: Data decontamination Magicoder models are trained on the synthetic data generated by OpenAI models. Please pay attention to OpenAI's terms of use when using the models and the datasets. Magicoders will not compete with OpenAI's commercial products.