Haven't done it on a 4060 yet... I'm waiting for the price to drop before I upgrade. Although I've done it on my ZOTAC GTX 1650 and plan to do the same with the 4060 when I get one.
For my single fan GTX 1650 I swapped the fan for these. I just added a dot if hot glue to the back of each fan and pressed it onto the heatsink. Worked like a charm.