Home AI Accelerators Hailo-10H AI Accelerator

Hailo-10H AI
Accelerator

Overview
Features

Hailo-10H Overview

Enabling Generative AI on the Edge

The Hailo-10H is the industry’s first edge AI accelerator to bring immersive generative AI capabilities directly to edge devices. Featuring 40 TOPS of INT4 performance and exceptional power efficiency, the Hailo-10H builds on the success of the market-leading Hailo-8 with a second-generation neural core architecture that is even more powerful and scalable.
Hailo-10H includes a direct DDR interface, allowing it to scale for large models such as LLMs, VLMs, Stable Diffusion, and more.

Always On –
AI on the Edge

Cost-efficiency Icon

Cost Efficiency

  • Reduce bandwidth consumption
  • No paid subscription to cloud-base AI tools
Hailo_icons_Low-latency_01-24

Responsiveness

Low latency and enhanced user experience

Streaming/connectivity icon

Availability

Continues access to essential applications, even in offline mode

Improved-privacy icon

Privacy

No transmission of personal and business-sensitive data to cloud

Breathe life into your edge applications with the Hailo AI processors

Features

Key Features & Benefits

High-performance processing of vision and generative AI models

First to market AI accelerator with generative AI capabilities

Industrial & Automotive grades, supporting:
→ Industrial -40°C to 85°C
→ Automotive-40°C to 105°C

40|20 TOPS (INT4|8)

Second generation of Hailo’s market leading AI accelerator

Supporting LPDDR4/4X

Best-in-class power efficiency;
Consumes 2.5W (typical)

Robust and mature software suite, supported by the world’s largest edge AI community

Neural Network Models & Application Support

I frameworks: TensorFlow, TensorFlow, Keras, PyTorch & ONNX

Host Architectures: x86, ARM

OSs: Linux, Windows, Android

Comprehensive Dataflow Compiler enables customer to port their neural network models easily & quickly

Neural Core Architecture

Proprietary, powerful and scalable structure-driven dataflow architecture that takes advantage of the core properties of neural networks. It enables edge devices to run deep learning applications at full scale more cost-effectively and power-efficiently than any other solution in the market.

Explore Hailo models in the Model Zoo and choose the best neural network models for your AI applications

Explore More

Blog
Bringing Generative AI to the Edge: LLM on Hailo-10H Example
Introduction  Edge AI deployment of Large Language Models (LLMs) represents the next frontier in bringing advanced artificial intelligence capabilities to resource-constrained environments. This whitepaper explores how Hailo-10H, an advanced AI accelerator, enables efficient LLM deployment at the edge, delivering high-performance while addressing the unique challenges of memory limitations, power efficiency, and computational constraints. Through innovative…
Blog
Evaluating Edge AI Processor in the Generative AI Era
TOPS Matter, But They’re Not Enough. As edge AI continues to revolutionize industries, choosing the right processor becomes a critical decision for developers and businesses. While the number of TOPS (tera operations per second) has historically been the go-to metric for evaluating AI hardware, relying on it exclusively can lead to oversimplified and misleading conclusions….
Product Brief
Hailo-10H AI Accelerator Product Brief

Order Starter Kit

M.2 module with Hailo-10H for development & prototyping of edge AI applications