Generate text responses to prompts, enabling natural language conversations and content creation
The pipeline consists of a prefill and tbt models
License name: Apache License 2.0
| Test | Evaluation Metric | Full Precision Accuracy | Post Quantization Accuracy |
|---|---|---|---|
| MMLU | Accuracy | 55 | 51 |
