compiling inswapper_128 for hailo8

Hi,
I’m trying to compile inswapper_128 for hailo8 and so far no success. Everything seems to be working but it takes forever at step:
Finding the best partition to contexts…
even when utilizing A10 gpu. Using CPU only I once gave it 17 hours and it never finished. With A10 gpu I waited 5 hours and was stuck at finding the best partition. All other stages including quantization was successful though. I even set fps=1 and nothing changed. Any idea why it is taking so long?

Hi,
I will need you to attach the hailo_sdk.core.log to understand the problem.
Did it say it found any valid partition? if so can use performance_param(optimization_level=0) in the allocation script - and it will finish after the first valid partition.
If it didnt find any partition and stuck at finding one I’ll need the core log to better understand.

1 Like

These are situations I’ve experienced so far:
1- the compiler never shows any progress bar at “Finding the best partition to contexts”. It just sits there indefinitely (1+ hours) with no output. GPU memory is loaded (21GB on A10) but no progress bar appears at all.

2- Previous successful run on same A10 instance DID show a progress bar and eventually launched the compiler binary (hailo_tools/build/compiler) which ran for 4+ hours before being killed. That run used optimization level 2 with QAT enabled.

3- On cpu the bouncing progress bar ran for 17 hours with no output.

Questions: 1. Is InSwapper128 (dual-input: 128x128x3 face + 1x1x512 identity) supported on Hailo-8?

2. Is there a known working model script for this architecture?

3. The previous run that launched the compiler binary — was that actually making progress toward a valid HEF? System: DFC 3.33.1, hw-arch hailo8, A10 GPU, Ubuntu 22.04

I cannot find a place to upload log files so I paste part of them here:

[2026-04-20 16:28:33.846] [default] [info] Ran from command: “/home/ubuntu/compile_only.py”

[2026-04-20 16:28:33.849] [default] [info] Loading network parameters

[2026-04-20 16:28:36.518] [default] [info] Starting Hailo allocation and compilation flow

[2026-04-20 16:28:36.543] [default] [info] Model name: inswapper

[2026-04-20 16:28:36.611] [default] [info] Building optimization options for network layers…

[2026-04-20 16:40:51.045] [default] [info] Successfully built optimization options - 12m 14s 433ms

[2026-04-20 16:40:51.047] [default] [info] Trying to compile the network in a single context

[2026-04-20 16:40:51.047] [default] [info] Trying to solve in single context

[2026-04-20 16:40:51.085] [default] [info] Single context flow failed: Recoverable single context error

[2026-04-20 16:44:52.956] [default] [info] Building optimization options for network layers…

[2026-04-20 16:51:59.272] [default] [info] Successfully built optimization options - 7m 6s 315ms

[2026-04-20 16:51:59.272] [default] [info] Using Multi-context flow

[2026-04-20 16:51:59.272] [default] [info] Resources optimization params: max_control_utilization=60%, max_compute_utilization=60%, max_compute_16bit_utilization=60%, max_memory_utilization (weights)=60%, max_input_aligner_utilization=60%, max_apu_utilization=60%

[2026-04-20 16:51:59.272] [default] [info] Finding the best partition to contexts…

[2026-04-20 16:51:59.302] [default] [info] Iteration failed on: Automri finished with too many resources on context_0
.
.
.
[2026-04-20 17:09:31.996] [default] [info] Iteration failed on: Automri finished with too many resources on context_8

[2026-04-20 17:12:54.369] [default] [info] Iteration failed on: Validator failed on node: ew_sub1 with Agent infeasible

[2026-04-20 17:15:53.065] [default] [info] Iteration failed on: Validator failed on node: ew_sub1 with Agent infeasible

[2026-04-20 17:18:48.604] [default] [info] Iteration failed on: Validator failed on node: ew_sub1 with Agent infeasible

[2026-04-20 17:21:47.362] [default] [info] Iteration failed on: Validator failed on node: ew_sub1 with Agent infeasible

[2026-04-20 17:21:48.661] [default] [info] Iteration failed on: Automri finished with too many resources on context_1

[2026-04-20 17:21:49.879] [default] [info] Iteration failed on: Automri finished with too many resources on context_2

[2026-04-20 17:21:51.086] [default] [info] Iteration failed on: Automri finished with too many resources on context_3

[2026-04-20 17:21:52.285] [default] [info] Iteration failed on: Automri finished with too many resources on context_4

[2026-04-20 17:21:53.489] [default] [info] Iteration failed on: Automri finished with too many resources on context_4

[2026-04-20 17:21:54.688] [default] [info] Iteration failed on: Automri finished with too many resources on context_4

[2026-04-20 17:21:55.896] [default] [info] Iteration failed on: Automri finished with too many resources on context_4

[2026-04-20 17:21:57.099] [default] [info] Iteration failed on: Automri finished with too many resources on context_4

[2026-04-20 17:21:58.308] [default] [info] Iteration failed on: Automri finished with too many resources on context_4

[2026-04-20 17:21:59.511] [default] [info] Iteration failed on: Automri finished with too many resources on context_4

[2026-04-20 17:22:00.704] [default] [info] Iteration failed on: Automri finished with too many resources on context_4

[2026-04-20 17:22:01.905] [default] [info] Iteration failed on: Automri finished with too many resources on context_4

[2026-04-20 17:22:03.046] [default] [info] Iteration failed on: Automri finished with too many resources on context_4

[2026-04-20 17:22:04.188] [default] [info] Iteration failed on: Automri finished with too many resources on context_4

[2026-04-20 17:22:05.379] [default] [info] Iteration failed on: Automri finished with too many resources on context_5

[2026-04-20 17:22:06.568] [default] [info] Iteration failed on: Automri finished with too many resources on context_6

[2026-04-20 17:22:07.777] [default] [info] Iteration failed on: Automri finished with too many resources on context_7

[2026-04-20 17:24:46.864] [default] [info] Iteration failed on: Validator failed on node: ew_sub1 with Agent infeasible

[2026-04-20 17:27:25.020] [default] [info] Iteration failed on: Too many inputs/outputs for inswapper_context_1, try to reduce number of inputs or outputs

Number of DDRs: 0

Number of inputs: 3

Number of outputs: 28
.
.
.
[2026-04-20 19:35:33.025] [default] [info] Iteration failed on: Validator failed on node: ew_mult1_d0 with Agent infeasible

Validator failed on node: ew_mult1_d1 with Agent infeasible

Validator failed on node: ew_mult1_d2 with Agent infeasible

Validator failed on node: ew_mult1_d3 with Agent infeasible

Validator failed on node: ew_mult1_d4 with Agent infeasible