New Release 4.18: Raspberry Pi AI Kit Now with Hailo Python API Support, CLIP Zero-Shot Classification, and picamera2 Examples!

We are excited to announce a new release for the Hailo Raspberry Pi AI Kit, packed with powerful new features that will enhance your AI development experience on Raspberry Pi 5. Whether you’re an embedded AI enthusiast or a seasoned developer, this release offers several exciting updates.

What’s New?

  1. Hailo Python API Support
    The Hailo Python API is now officially available for Raspberry Pi 5! This API allows you to easily run AI inference on the Hailo-8L AI processor using Python, simplifying the integration of deep learning models into your embedded applications.
    :point_right: Explore Python code examples here.

  2. CLIP Zero-Shot Classification App
    We are introducing a zero-shot classification app based on the CLIP (Contrastive Language-Image Pretraining) model. This application allows real-time image recognition, matching video frames to relevant text prompts without needing pre-training for specific objects. It’s a powerful tool for AI tasks where flexibility is key.
    :point_right: Check out the Hailo-CLIP GitHub repository for more information.
    :point_right: Watch the demo on YouTube.

  3. picamera2 Examples
    The latest release also includes new picamera2 examples that showcase integration between Raspberry Pi’s camera stack and the Hailo AI processor. These examples demonstrate how to utilize the Hailo-8L for advanced AI-powered applications like object detection and pose estimation with the picamera2 library.
    :point_right: Get started with picamera2 examples here.

Best Entry Point for All Updates

For a full list of updates and to get the latest features for your Raspberry Pi AI Kit, be sure to check out the Hailo Raspberry Pi 5 Examples Repository. This repository is your go-to source for all updates, new features, and examples for running AI on Raspberry Pi with the Hailo-8L AI processor.

Stay tuned for more updates and happy building!

6 Likes

In my opinion, the examples for Raspberry Pi5 should include standard support for IP cameras - RTSP streams, many people have asked about it on the forum and there are working script modifications there for example here: Using RTSP stream in Raspberry Pi5 - #6 by sanjoyg I think this would be very helpful for users without much experience.

3 Likes

Hey, nice to hear that support for the Hailo PiCamera2 is out, but I am getting an error on the first steps, when I am running the first example python3 pose.py
is there any hidden steps?

Traceback (most recent call last): File ‘/home/pi5/picamera2/examples/hailo/pose.py’, line 9, in from picamera2.devices import Hailo ImportError: cannot import name ‘Hailo’ from ‘picamera2.devices’ (/home/pi5/testenv/lib/python3.11/site-packages/picamera2/devices/init.py)"

problem is solved.

If you encounter an issue like this, ensure that you have upgraded to the latest version of the Hailo software package

That is very impressive!

I can’t wait to try this when I get home!

1 Like

Hello all,
Thanks you for this long awaited news, m’y question,IS it possible to use a webcam on https://github.com/hailo-ai/Hailo-Application-Code-Examples/blob/main/runtime/python/detection_with_tracker/detection_with_tracker.py instead of videos

Its a continuous troubleshooting instrument, i love it!

But what i think that is a weakness.

You have all software to let it run smoothly except for one thing to roll on a rpi5 and that is the converter.

The job should be this:

1st = Tensorflow
2nd = ONNX
3rd = HEF

The last part is tricky because you cannot place it on a rpi5 for it is not x86 based but arm64. All works except that. Any one have any pointers to put direct converter so i can decide cpu power an ai together. It is possible only the 3rd is a deadbeat.

Hi,
i’m new to Hailo, but webcam is producing “endless” video stream via RTSP Server OR You can use motion to record only when there is motion OR just simple use Frigate thankfully looks like the latest release now supports Hailo-8 Hailo AI Processor · blakeblackshear/frigate · Discussion #2050 (github.com) :wink:

I tried running the python scripts, unfortunately none of them worked for me. Of course i installed hailo-all.
I went into a venv for each demo script
python -m venv venv
source venv/bin/activate

and installed the resources and requirements.txt.

depth_estimation:
ModuleNotFoundError: No module named ‘hailo_platform’

detection_with_tracker:
python setup.py egg_info did not run successfully.

hailo_onnxruntime:
ERROR: Could not find a version that satisfies the requirement onnxruntime-openvino (from versions: none)

instance_segmentation:
ModuleNotFoundError: No module named ‘hailo_platform’

lane_detection:
ModuleNotFoundError: No module named ‘hailo_platform’

object_detection:
ModuleNotFoundError: No module named ‘hailo_platform’

pose_estimation:
ModuleNotFoundError: No module named ‘hailo_platform’

streaming:
ModuleNotFoundError: No module named ‘hailo_platform’

super_resolution:

espcnx4:
ModuleNotFoundError: No module named ‘hailo_platform’

srgan:
ModuleNotFoundError: No module named ‘hailo_platform’

Can you please tell me what i’m doing wrong?
Thanks

Hi @Darklord_Ice
Please use our RPi 5 github repo GitHub - hailo-ai/hailo-rpi5-examples to begin working with the RPi 5.
This is the repo which will work out of the box on the Pi if you’ll follow the installation guide.
The examples you use require some additional installation.
Note that the first step in the installation guide in the detection_with_tracker example tells you to install hailoRT python bindings (hailo_platform). Hailo-Application-Code-Examples/runtime/python/detection_with_tracker at main · hailo-ai/Hailo-Application-Code-Examples · GitHub

If you are using the Pi, it is installed on the the Pi’s “system” python as part of the hailo-all installation. However you will need to create the virtualenv with --system-site-packages flag to inherit it.

Hi there,

Are the Picamera2 examples supposed to work at this point in time?

I can’t get detect.py to work so far. There is a detection going on (after some fixes, for example the error about detection[4] being out of bounds), and an output, but the class_id is always empty/zero, which of course translates to a person every time. Looking at the hailo_output content, there’s really no value in there for the class of the detected object.

On the other hand, the rpicam-hello tool works perfectly. This is on a 26TOPS module.

Thanks for any tips!

Well, it works now for me. Putting this here if it helps anyone, but the only change that seems needed is this line in detect.py (picamera2 hailo examples):

for class_id, detections in enumerate(hailo_output):

Needs to be:

for class_id, detections in enumerate(hailo_output[0]):

I now have the proper class_id and labels.