At the same time, the company announced the introduction of its Hailo-10 high-performance generative AI (GenAI) accelerators that usher in an era where users can own and run GenAI applications locally without registering to Cloud-based GenAI services.

The new funding round was led by current and new investors including the Zisapel family, Gil Agmon, Delek Motors, Alfred Akirov, DCLBA, Vasuki, OurCrowd, Talcar, Comasco, Automotive Equipment (AEV), and Poalim Equity. To date the company has raised more than $340 million.

“The closing of our new funding round enables us to leverage all the exciting opportunities in our pipeline, while setting the stage for our long-term future growth. Together with the introduction of our Hailo-10 GenAI accelerator, it strategically positions us to bring classic and generative AI to edge devices in ways that will significantly expand the reach and impact of this remarkable new technology,” said Hailo CEO and Co-Founder Orr Danon. “We designed Hailo-10 to seamlessly integrate GenAI capabilities into users’ daily lives, freeing users from cloud network constraints. This empowers them to utilise chatbots, copilots, and other emerging content generation tools with unparalleled flexibility and immediacy, enhancing productivity and enriching lives."

Hailo-10: Generative AI at the Edge

The new Hailo-10 GenAI accelerator enables a whole spectrum of applications that maintain Hailo’s leadership in both performance-to-cost ratio and performance-to-power consumption ratio. Hailo-10 leverages the same comprehensive software suite used across the Hailo-8 AI accelerators and the Hailo-15 AI vision processors, enabling seamless integration of AI capabilities across multiple Edge devices and platforms.

Enabling GenAI at the Edge ensures continuous access to GenAI services, regardless of network connectivity; obviates network latency concerns, which can otherwise impact GenAI performance; promotes privacy by keeping personal information anonymised and enhances sustainability by reducing reliance on the substantial processing power of Cloud data centres.

By unlocking the power of GenAI on Edge devices, such as personal computers, smart vehicles, and commercial robots, Hailo-10 allows users to completely own their GenAI experiences, making them an integral part of their daily routine. Hailo accomplishes this immersive GenAI experience through a Hailo-10 architecture that supports maximum GenAI performance with minimum required power.

“As GenAI on the Edge becomes immersive, the focus turns to handling large LLMs in the smallest possible power envelope – essentially less than five watts,” Danon continued.

Among popular GenAI platforms, Hailo-10 can run Llama2-7B with up to 10 tokens per second (TPS) at under 5W of power. In processing Stable Diffusion 2.1, a popular model that produces images from text prompts, Hailo-10 is rated at under 5 seconds per image in the same ultra-low power envelope.

Hailo-10 is capable of up to 40 TOPS (tera operations per second), a new performance standard for edge AI accelerators. Hailo-10 is faster and more energy efficient than integrated neural processing unit (NPU) solutions and delivers at least 2X more performance at half the power of Intel’s Core Ultra NPU, according to recently published benchmarks.

Early applications of Hailo-10 GenAI accelerators will be targeting PCs and automotive infotainment systems, empowering current and future CPUs that cannot by themselves power the chatbots, copilots, personal assistants, and speech-operated operating systems that have become standard today. Hailo will begin shipping samples of the Hailo-10 GenAI accelerator in Q2 of 2024.

“Whether users employ GenAI to automate real-time translation or summarisation services, generate software code, or images and videos from text prompts, Hailo-10 lets them do it directly on their PCs or other Edge systems, without straining the CPU or draining the battery,” Danon concluded.

Since its founding in Israel in 2017, Hailo has become a global supplier of intelligent AI chips that serves more than 300 customers around the world. The company has offices in the United States, Europe, Japan, South Korea, China, and Taiwan.