No Stupid Questions

Honestly, I find the entire system annoying and counter to fostering real discussions.

If you go to a party, it's not like people in the room have tags over their heads which say "trustworthy," "troll," "crazy," or whatever else. You have to make up your own mind based on your interactions and (hopefully) use of critical thinking to decide if someone you are talking with is worth your time.

If I don't want to take the time to read anything which might offend me, put me off, make me uncomfortable, challenge me, or just in some way be contrary to my world view then frankly, online forums would not be the spaces in which I would be reading things.

I believe that everyone has a point of view that can have value in some way, if only to illustrate that "negative" or "contrary to me" view and people exist around me. They have voices to contribute. Deciding if their contributions are valuable enough to award them a positive or negative "Reputation" is not an abstract thing. A true reputation takes time to build in the real world. It is earned for better or for worse, by actions people take over time not by some arbitrary number farmed by a bot posting cat memes 24/7 or whatever, or posting viewpoints sure to garner upvotes because like minded people are the only ones replying.

I still firmly believe one of the worst things to happen to the internet, besides pop-up ads, is up and down votes. Nothing exposes a misanthrope quicker than forcing them to comment instead of passively downvoting everything they see. Which makes it easier to remove them from the party.

In my opinion the best alternative is a -1 : +1 scale. Members who contribute little are near 0, members who contribute a lot in a positive way get towards +1, if users contribute a lot in a negative way, their score goes to -1.

There are lots of different particular ways to implement this that isn't up vs. downvote count. Communities created, moderation activity, post count, engagement per post, positive reporting rate, false reporting rate, number of reports against the user, number of communites banned from, etc.

I would have optional, per magazine karma. Mods can decide if they want to enable it and what rules it should follow. Personally, i would max it at some low number, like 100; above that you are an upstanding member of society and that's it.

Advogato reputations: https://en.wikipedia.org/wiki/Advogato#Trust_metric

Added: also, Slashdot.org karma worked sort of like reddit karma except 1) you couldn't see anyone's karma except your own, and 2) it only had 5 or so levels, topping out at "excellent". It took a few dozen good posts to reach excellent, and there was no point to whoring after you reached that level. Posts were ranked by upvotes/downvotes and went from -2 to +5. Anonymous posts started out at 0, posts from registered users with non-negative karma started at 1, and posts from registered users with good or higher karma started at 2. There were some more complications including voting "insightful", "funny", etc. and there was "meta moderation" where you could judge the accuracy of other people's votes. Usefully, you could select "filter out all posts rated below N" where you could choose N. Looking at just the 5-rated posts gave you a quick overview of the worthwhile thoughts on that topic. There were often 1000+ comments in a thread, so no way to read them all, but reading the few dozen top ones was generally enlightening.

Oh yes I remember, you could only vote on posts if you were a moderator (in their sense of the term) at that moment. Moderators were picked at random on a daily basis from the population of users with positive karma, or something similar. You got five "mod points" which you could spend on voting on posts, i.e. you could only rate 5 posts during your day as a mod, rather than all the posts you saw. You tended to get mod points once a month or so. It has been a long time since I spent any time there, so my memory is a bit hazy. It went down the tubes for a while, though recently it has looked better.

I asked chatgpt, just to see what would filter out...

I would like some advice on designing a content-sorting and content-filtering mechanisms for discussion forums, in order to avoid or mitigates some of the problems that current systems are prone to.

One of the social problems with discussion forums results from the concept of upvoting or downvoting content.

It can be argued that voting content up or down serves to sort content by quality, allowing high-quality content to be seen and engaged with, while discouraging low-quality submissions.

However, in practice, Goodhart's law ends up applying: when a measure becomes a goal, it stops being a useful measure.

By using popularity as a proxy metric to determine quality, and by rewarding popularity with positive attention, this ends up selecting for content with superficial emotional appeal - ragebait, memes, facile/obvious comments pandering to common sentiment, puns, etc. - and not 'useful' content that is thoughtful, incisive, analytical, or important-yet-unpalatable. Ironically, content of this nature is also low-quality in a different way.

Worse, this ends up training users to produce content of this nature at the expense of thoughtful, interesting, incisive discussion, reducing both the production of quality content, and the quality of the collaborative sorting that users perfom by way of voting.

A cumulative 'karma' score for users, being a sum total of their upvotes and downvotes across all of their submissions, while ostensibly encouraging engagement and admirable behaviour... can again end up being gamified, and lead to users making large numbers of popular but low-effort submissions in order to maximise their score.

This can also produce 'filter bubbles' or 'hive minds': subcultures or communities that reject and discourage disagreement or criticism, and end up with a positive feedback loop leading to increasing orthodoxy with little grounding in reality. In some cases, the communities involved can become radicalised or toxic as a result, as more-moderate voices are suppressed from the discussion, and increasingly-extreme views become required in order to gain attention. Of course, it's reasonable and useful to let groups based around common ideals preserve an individual identity separate from the mainstream of discussion, but perhaps a way to regulate excessive self-selection would be useful.

Doing away with any kind of quality-sorting mechanic altogether is not a very useful alternative; a forum where spam, antisocial, or irrelevant submissions are given equal weight and visibility as interesting or thought-provoking posts tends to discourage users from participating or even reading.

As a further complication, users do not generally follow instructions or policy set out for voting on posts, and will tend to use them to indicate approval/agreement regardless.

Human moderation is an important part of any discussion forum and essential to the guidance ans shaping of any community, but the workload does not scale well; it should be considered a limited and intensive resource.

It would seem there are a few challenges to overcome:

1: Better-define the concept of 'quality' for discussion-forum posts beyond immediate, superficial emotional appeal - what is it that makes discussions feel satisfying, and drives deeper engagement? 2: Find a way to programatically ascribe a metric based on this concept, via the engagement of other users, in any form including upvotes, downvotes, tagging, commenting - and statistical or derived data such as the number, depth and overall score of replies to the post, and perhaps even analysis of the text of replies. 3: Ensure that any such system is difficult for individual users to exploit or game; for instance a naive reply-count metric could be trivially exploited by a user posting a large number of replies to a single comment.
4: Limit the effect of self-selection feedback loops, to prevent radicalisation while still allowing common ideals and identity to flourish in their own spaces.

One idea I've had would be to sort all content by 'controversialness' - that is to say, posts with a high number of total votes, but a low-magnitude score once downvotes are subtracted from upvotes. I believe this would tend to deprioritize low-effort posts such as ragebait or pandering to common sentiment, along with junk, spam and boring or irrelevant content, and thus bring 'interesting' content to the top. I believe it would be difficult to game for attention, or for other users to have undue effect on its visibility. However, I'm not sure whether controversialness would be a good metric to drive engagement, or what large-scale effects sorting on this metric might have on a community.

Can you offer any advice or commentary on the situation, or identify any important flaws in my analysis? Can you suggest any alternatives that might work better?

===================================================================================== ChatGPT You've outlined several important challenges and considerations when it comes to designing content-sorting and filtering mechanisms for discussion forums. The issues you've raised are indeed prevalent in many online communities, and finding effective solutions can be complex. I'll provide some advice and commentary on your analysis, as well as suggest alternative approaches that might address the problems you've highlighted.

Better defining quality: You're right in emphasizing the need to define quality beyond superficial emotional appeal. One way to approach this is by incorporating multiple dimensions of quality, such as insightful analysis, thought-provoking content, well-reasoned arguments, and valuable information. Encouraging constructive and meaningful discussions should be a primary goal.

Ascribing metrics based on user engagement: Rather than relying solely on upvotes and downvotes, consider implementing a more comprehensive metric that takes into account various aspects of user engagement. This could include factors such as the number of replies, the depth of discussion, the length of time spent reading the post, and even sentiment analysis of the comments. By incorporating a broader set of metrics, you can obtain a more nuanced understanding of user engagement and use it to evaluate content quality.

Avoiding gaming and exploitation: To mitigate the risk of individuals exploiting the system, it's crucial to design mechanisms that discourage or penalize excessive or low-quality contributions. For example, you could implement rate-limiting measures that prevent users from making an excessive number of submissions within a certain time frame. Additionally, considering the quality of the engagement (e.g., the relevance, thoughtfulness, and contribution to the discussion) rather than just the quantity (e.g., sheer number of replies) can help minimize gaming attempts.

Addressing self-selection feedback loops: To prevent echo chambers and radicalization, it's important to strike a balance between allowing communities with common ideals to flourish and promoting diverse perspectives. You could introduce mechanisms that encourage exposure to alternative viewpoints, such as algorithms that prioritize showing posts to users with different preferences or even implementing mandatory or randomized exposure to different topics or communities. Additionally, fostering a culture of respectful and open-minded discussion can help create an environment where diverse opinions are valued.

Regarding your idea of sorting content by controversialness, it could be an interesting approach to promoting engaging discussions. However, it's important to carefully consider the potential effects of such sorting on the community. Controversial topics and discussions can be divisive, and if not managed well, they may lead to increased conflict and hostility. Implementing safeguards, such as active moderation and community guidelines, would be essential in maintaining a healthy and constructive environment.

In conclusion, tackling the challenges of content sorting and filtering in discussion forums requires a multifaceted approach. By defining quality beyond superficial appeal, incorporating comprehensive engagement metrics, preventing gaming and exploitation, and addressing self-selection feedback loops, you can design a system that promotes meaningful discussions while minimizing the negative effects associated with current mechanisms. It's crucial to iterate and refine these systems based on user feedback and community dynamics to ensure the best possible experience for forum participants.

Live and let live - Best system ever 👌

I loved forums, and we didn't have anything, except for 'total posts' and 'total replies' for users. I like that.

I do like upvoting, but I think karma should be hidden. Maybe if you go to user profile and click a button to see the value. It should not show if you hover over the user in a discussion, like Reddit. This is too much incentive for Karma farming.

I don't like downvotes, and that's the reason I'm on lemmy.one - no downvotes here at all

The worst part about using reddit when I first signed up was having to deal with celebrity redditors with bajillions of karma sucking all the air out of any thread they visited. Thankfully, it seems like over time people calmed down a bit with that, or maybe I just started browing non-defaults with more tight-knit communities, but you still have dumb novelty accounts that kind of ruin the experience (if you've ever been got by /u/shittymorph, you know what I'm talking about).

I couldn't care less about karma, what I really want is a way to see what I upvote, otherwise I feel that what I upvote is meaningless (for myself, I like to boost content that I like though).

Karma should have a half-life, so it's not a forever thing. Have each karma point lose half of its value every three days. Makes it more transitory.

Downvotes only so karma whores never comment, and completely random monthly account bannings so no one gets too comfortable.

We need the karma-equivalent of PageRank. Every vote should not be treated the same, just as Google doesn't weight every link equally. The "one user one vote" system is the equivalent of pre-Google search engines that would rank pages by how many times they contained the search term. But it can't be as simple as "votes from higher-karma users are worth more" because the easiest way to build insane karma is to build a bot or spam low-effort replies to every rising post. Still, the system needs to be able to extract the wisdom of the crowd from the stupidity of the crowd, and the only way to do that is to apply a weighting gradient to users and their votes.

The problem isn't the points, it's the people. Everything starts to suck beyond some critical mass.