I’m looking for where I can buy a 10h card, preferably 8GB memory. I’m looking to have one for a Home-Assistant Voice/tool calling agent. Already have a home NAS/server that I run Home-Assistant on, so need a m.2, not a the RPi hat.
Preferably buy from somewhere in USA/North America, but as long as they’ll ship to USA, I’m OK buying from elsewhere in the world from a reliable source.
I reached out to all of my regulars, Adafruit, SparkFun, etc. and no luck. Including requests from the 2 US distributors. No response.
I found a couple of vendors with stock and high price on Amazon 
This may end up being the option I take, as I really want both m2 storage over PCIE and the Hailo – which makes the HAT 2 really suboptimal given the current 1 exposed PCIE
… and sorry - these were 8’s not 10’s – my bad. But still may use for image only inference as I can’t find another source.
I’ve been hunting for the 10H M.2 for months now with no luck. I know they exist as some notable YouTubers have done reviews on them, but they seem to be largely unavailable for those of us who lack social media clout. I regularly check in with Seeed Studio, WaveShare, Digikey, Mouser, AdaFruit, etc. but have had no luck.
The amusing part is that every time I try searching for one online I just keep coming across the same Hailo press release from July of last year announcing their general availability.
Good luck in your hunt. Be sure to let us know if you actually find anyone selling them.
I’m in the same situation, impossible to find it in Europe (m.2 version). Europe providers don’t sell it.
Mostly it’s the curiosity. Something this relatively cheap handling LLM inference within even 20% of a last gen GPU (much less my old GTX 1080 8GB) would be a big boost, especially with the lower power consumption.
Where it’d get even MORE interesting, is PCIe bifurcation and a 2-on-1 m.2 → PCIe slot card if the could get splitting an LLM model across the 2 cards, but not sure that’s currently possible. 8GB is solid, but 12-16GB is where you can get truly more capable models right now. And with a decent context size.
It’s probably RAM prices. Since they’ve skyrocketed, Hailo can’t produce these with that amount of memory for the same price. Which I get, if it has to be somewhat more expensive, that sucks, but that’s the market right now.
I heard back from sales and they suggested reaching out to the US distributor ( for me ) – I did not hear back.
If you are interested in a Hailo product, please contact J-Squared, our official distributor in your region.
I am finding that it will work with out being in “pin passthrough” configuration, so at this point I am just dealing with a cable running out to the hat from the PCIe – my real reason for wanting the m.2 was so that I could use the form factor to enable a disk drive and a hailo in the same footprint. I went back to the 8, but unfortunately that can only do image stuff.