Home GenAI Models Qwen2.5-Coder-1.5B-Instruct

Qwen2.5-Coder-1.5B-Instruct

Generate text responses to prompts, enabling natural language understanding, multilingual support, and code generation

Model Properties

The pipeline consists of a prefill step and a token-by-token step, optimized for coding tasks

License name: Apache License 2.0
Number of parameters: 1.5B
Model Size: 1.64 GB
Select device..
Hailo-10H

Technical Details

Operations: 29.4 GOPs per input token
Context Length: 2048
Numerical Scheme: A8W4, symmetric, channel-wise
Inference Api: C++, Python, Hailo-Ollama
Compiled Model:

Performance Metrics

First Load Time In Sec 4.08
Time To First Token In Sec 0.32
Tps 8.13

Explore More Models

DeepSeek-R1-Distill-Qwen-1.5B
GenAI Models
DeepSeek-R1-Distill-Qwen-1.5B
Generate text responses to prompts, enabling natural language understanding, multilingual support, content creation and advanced reasoning
LLM
GenAI Models
Qwen2.5-1.5B-Instruct
Generate text responses to prompts, enabling natural language understanding, multilingual support, and content creation