The hailo_ai_sw_suite includes a network “shortcut_net.hef” in examples/hefs that is used to to test data pass through on the chip. Its input and output shape are 50x2928x1 and the outputs match the inputs.
Rather than having to read the 20K shortcut_net.hef from file, I would like to create a HEF in memory, in C++, using libhailort. Is this possible/easy? Can someone point me in the right direction?
HEF files can only be created using the Hailo Dataflow Compiler. It takes ONNX or TFLite files as an input and is used to convert a NN model step-by-step into a HEF file. HEF is a binary format that configures the Hailo-8 into an accelerator for that specific model. There are many different structures (compute, control and memory) all over the chip that need to be configured and connected.
You can load a HEF into memory and then load the Hailo-8.