divyanshukunwar

SASTRI19B is a new model fine tuned for bhojpuri & hindi languages. More detail about the dataset used and evaluation will be shared soon. Model trained on similar languages can be adapted for a very low resource language. You can also download the GGUF version from : https://huggingface.co/divyanshukunwar/SASTRI19BGGUF Evaluation Result for English Language |Dataset| Metric | Score | |--------|---------|---------| |Arc-Easy| Accuracy | 94.2 | |Arc-Challenge| Accuracy | 86.1 | |MMLU| Accuracy | 61.0 | |BoolQ| Accuracy | 79.04 | Evaluation Result for Hindi Language |Dataset| Metric | Score | |--------|---------|---------| |Arc-Easy| Accuracy | 80.2 | |Arc-Challenge| Accuracy | 68.35 | |MMLU| Accuracy | 43.11 | |BoolQ| Accuracy | 71.61 | Evaluation Result for Bhojpuri Language coming soon .. Model may show undersired behavior such as hallucinations and unintended biases use it at your own risk. This model is not optimized for user preference. This model is released as a part of study for Large Language model for very low resource languages. |Comparison with other Indic models on English Evaluation Benchmark|Comparison with other models on Hindi Evaluation Benchmark| |---|--| |||