Custom Pseudo-Coloring for Segmentation Output – Modifying Postprocess or HailoOverlay

General
,
1

Hi Hailo Team and Community,

I’m working on a thermal segmentation application using the TAPPAS framework and launching inference via the provided instance_segmentation.sh GStreamer pipeline.

I want to implement pseudo-coloring (e.g., JET color maps) on the segmentation masks to enhance the visualization of thermal input frames.

From what I understand, HailoConfClassMask is added to the HailoDetection meta inside the postprocess .so file, and then HailoOverlay handles the actual blending and rendering.

Now, I need clear guidance on how to:

  • Modify the postprocess .so to include pseudo-color logic using OpenCV (e.g., cv::applyColorMap) before passing it to HailoOverlay, or
  • Extend or override HailoOverlay behavior to apply pseudo-coloring directly during mask rendering.

I’m not sure which of the two is more appropriate for this case, but I’m open to either.

Thanks in advance — I’ll share back once it works.

2

Hi @Mateja_Gojak ,

Do you consider using other frameworks besides TAPPAS or you stick to TAPPAS?