How often the box is cleaned and how often the litter is fully exchanged also can have a big impact. Some cats have zero tolerance for touching 'used' litter.
It may be worth investigating different kinds of litter as well, especially if it appears he doesn't want to touch the litter with his front paws to 'wipe'.