Okay, that is a little bizarre as it should bond reasonably well with very little prep.
I guess you need to check the alloy prep, the solvent & wipes you may be using, and what method are you using to compress the alloy to the surface, if you have air entrapment, the humidity and temperature plays a part… It could well be a number of things, combined!
If you use certain adhesives and over compress - then the bond strength is drastically reduced. 0.2-0.5mm is ideal for a “standard” structural adhesive.
The adhesives I have recommended work in a wide range of bond lines - Araldite’s optimum bond line is 0.05mm to 0.1mm
It will work with larger gaps as well, so do not be put off.