Not at all.
A bit of a crude demonstration, but take a sold out match at a 50,000 seater stadium.
~25,000 season tickets at ~£20 a game ~25,000 match day tickets at ~£30 a game.
That's £1.1m just from match going fans on a single match day. Add on top the massive sums that the top paying leagues get for their domestic and international TV rights (particularly the PL) and also the very lucrative advertising deals (shirt sponsors, club sponsors, stadium sponsors etc) and the incomes are huge for clubs in the big leagues where high salaries are paid.
A lot of this money goes on the actual talent, the workers that people come to see rather than even more going in to the owners pockets. I do think clubs should do more for their lower paid matchday/support staff (some salaries are dreadful even for roles as crucial as scouting) and investment in their local area (some clubs are better than others here). But the very top 0.001% of talent in the world's most popular sport that is also a lucrative industry deserves to reap the rewards imo.