Haven't done it on a 4060 yet... I'm waiting for the price to drop before I upgrade. Although I've done it on my ZOTAC GTX 1650 and plan to do the same with the 4060 when I get one.
For my single fan GTX 1650 I swapped the fan for these. I just added a dot if hot glue to the back of each fan and pressed it onto the heatsink. Worked like a charm.
It did but the downside is because I'm still using the GPU to control the fans they still run all the time and the minimum fan speed is determined by the GPU. I believe for the ZOTAC 4060 Solo the minimum fan speed is 30%. So it may be better if you use standard fans and plug them into the motherboard and control them that way.