I agree.

But also downvoting is very useful as community moderation tool. I participate in some communities with regular, scummy spam posts that are technically off topic and not quite bannable. They’d get naive, hype driven upvotes if left alone. And I like that there’s a community mechanism to bury them.