Which type of the quanted model inputs and outputs?

General
,
1

when I use the cpp hailort api, is the input of the model type is int8?what about the output type?

2

Hi @595124665,
If the format is set to HAILO_FORMAT_TYPE_AUTO or if you don’t see any set for it (if using the Async API), you can see the inputs\outputs formats of your model by running in the command line “hailortcli parse-hef /path/to/your/hef”.

Regards,

3

thank you, How do I set the input and output type?

4

Hi @595124665,
Depending on the API you are using, but in general you need to set it in the vstreams (input vstreams or output vstreams). You can look at the HailoRT user guide for the API.

Regards,