Hailo Software Toolchain

A Complete & Scalable AI Software Development Kit

Hailo devices are accompanied by a comprehensive AI SDK toolchain which seamlessly integrates with existing deep learning development frameworks to allow smooth and easy integration in existing development ecosystems. The Hailo toolchain consists of the Hailo Dataflow Compiler, Hailo RT runtime software and Hailo High Performance Apps Toolkit.

deep learning compiler

Dataflow Compiler

Full deployment flow toolchain capabilities:

  • Model Translation from industry standard frameworks to Hailo format
  • Numeric Translation to internal representation, using state of the art quantization algorithms
  • Hardware Resource Allocation of user network required resources to physical resources in the Hailo device
  • Compilation of models into Hailo binary by the dedicated deep learning compiler
  • Loading binary and running inference on the Hailo target device
  • The deep learning SDK supports both standalone inference allowing direct access to the device, and Tensorflow-integrated inference for easy integration with existing environments

Analysis and debug tools:

  • Emulator providing bit exact emulation of chip behavior
  • Profiler providing chip performance estimations (e.g. FPS, power and latency)
deep learning compiler