The overhead of duplicated data across the network. Not reposts on different instances, but the software itself on those different instances needing to cache/store this one single post for their users locally
Asklemmy
A loosely moderated place to ask open-ended questions
Search asklemmy π
If your post meets the following criteria, it's welcome here!
- Open-ended question
- Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
- Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
- Not ad nauseam inducing: please make sure it is a question that would be new to most members
- An actual topic of discussion
Looking for support?
Looking for a community?
- Lemmyverse: community search
- sub.rehab: maps old subreddits to fediverse options, marks official as such
- [email protected]: a community for finding communities
~Icon~ ~by~ ~@Double_[email protected]~
Donβt large services have many duplicates/caches spread across the globe to balance load and reduce latency? Couldnβt this be seen as a positive? It could also be seen as a redundancy layer.
Yes. It's very common to cache content closer to the user, otherwise the site would be slow. Some services like Netflix and Facebook even provide custom caching servers to internet providers to install in their data centers. These are called Netflix Open Connect and Facebook Network Appliance respectively. They significantly reduces costs for the ISP, as Netflix and Facebook are generally two of the heaviest users of bandwidth on an ISP's network, and traffic entirely within their own network is effectively "free" for them.
This is a good part of federation IMO - if users join an instance physically close to them, their experience is going to be nice and fast, since everything is cached on their instance. It's also pretty easy to spin up a new Lemmy instance in your country if one doesn't exist yet.
Scalability. Most federated Lemmy instances are hobbiest run projects started by every day joes and privacy advocating sysadmins. These instances can handle a modest amount of activity. Lemmy.world is slowing to a crawl and barely working due to being overloaded. At the scale of tens of thousands of active users you NEED proper infrastructure and a dedicated team. These are not things that come easy when the instance generates no revenue besides meager donations. Lemmy.world is looking for on call system operators willing to contribute 5-10 hours per week. Good help is rarely cheap let alone free.
You are exactly correct.
I posted this in response to the DDOS attacks a few weeks ago. Same idea.
"... This is a shame. Hosting a high visibility server is no joke, and I don't envy the admins and the very difficult work they do. It's simultaneously an argument for and against decentralization. For - a single instance can get knocked out without talking out the whole fediverse. Against - it seems as though high visibility communities are potentially fairly easy to target and take down.
I think that decentralization wins out here in the end, but it does feel like there may be a need for some sort of fallback mechanism to be in place at an instance/community level. I suspect this might evolve somehow over time. It would require some way to expand trust between instances and or portability of communities (which could be fraught with user trust/data integrity issues).
If things don't evolve it could grow into a whack-a-mole game for bad actors, or there might need to be more investment into server infrastructure (which could work against decentralization if only because of economies of scale).
Or maybe there's no issue after all? I'm just imagining potential implications of a scaling fediverse - it's fascinating and exciting stuff! ..."
The person hosting lemmy.myserv.one is trying to acquire more users because they want to take some of the load off of lemmy.world.
If you want something less burdened than lemmy.world, you should make an account over here. Do your Lemmy browsing from here, you know?
Lack of centralized control.
Until there's some kind of organizing central committee of servers that could mutually defederate problematic instances, every server is forced to play whack-a-mole to deal with fascists and pedophiles and the like. Every server can not be an island onto themselves, they should be in communication with each other and then collectively decide on the rules of the federation.
I forsee in the future federation boards, like servers that work together to vote on good/bad actors/instances and from those other instances could subscribe to their moderation. Still open moderation, you can still set up an instance that doesn't adhere to group A or group B's mod lists, but for the vast majority of people you could have a good experience.
For example, dunno how many saw but had to remove an anti-LGTBQ post in a LGTBQ community today. I'm sure I'm not the only mod who removed that from their instance today, it'd be great if there was a way other instance admins could share that and "team up" with moderation.
Like internet countries. Choose a virtual citizenship, vote for your moderator and wait to be disappointed
Poop ~~poop~~
less like countries, but I would view that more like the federation UN, with each instance getting a vote and a majority passes. You're still in charge of your country, but you could say "I like how this group moderates, I'm going to auto apply moderation from them on here", maybe you could choose which communities are automoderated too. If I ever started disagreeing with that group I could unsubscribe and subscribe to a different group's.
For example, the post I mentioned was not in a community that I host, but for my users I had to remove it too. Would just be nice to say "whoever gets there first can remove it"
I see that as a pro and a con. If one narcissist manages to get to a position of authority, they canβt derail the whole network. That also means that people can form their own echo chamber islands of like-minded instances. There could be the main island of random interests and then a separate extremist island of all the instances that got defederated from all the big instances. Not an ideal solution, but itβs still better than a fully centralized Reddit.
What if instances could "subscribe" to the list of defederated instances of each other?
So for example. Let's say that Alice and Bob have their own instances, alice.ml and bob.ml. Bob trusts Alice, so he sets up the following rule in bob.ml: "if alice.ml defederates an instance, then bob.ml defederates it too."
Then Charlie starts charlie.ml. It's a bad instance. Alice manually defederates alice.ml from charlie.ml. Bob won't need to do anything - bob.ml would do it automatically.
I feel like this idea would address the issue of playing whack-a-mole, since admins of multiple servers can split the busywork if they so desire, and only with whomever they desire. And there's no risk of a central control going rogue, since there's no central control on first place.
It could be even further refined with more complex rules on when to automatically defederate other instances. Such as taking into account if the other instance did it manually or automatically, or how many among X instances defederated it.
It's interesting to see the mirror between Fediverse philosophies, and the history of international relations. For every person who believes every physical country should be an autonomous island unto themselves, you'll find someone else who believes every country should be policed by the standards of another country or group of countries.
The fact that we can have this debate on the internet is interesting...but I also find it interesting that the internet was already federated to begin with. And we all see how that turned out. The Fediverse is just an internet within the internet.
Democracy. All people want it, but many people struggle with it. The comments up in this thread are all basically talking about this topic: People have to agree on what their society should be about. And that ~~can~~ is hard work. It means reconcile and debating. It is not very different from every other Federation like the EU or Germany with its 16 states. Here is an Example:
During COVID, Germany - as a Federation of 16 states - all had to decide on what is the best way to recognize the threat, mitigate it, and build up protections. In the Federal Republic of Germany, that meant that the Goverment took over some aspects, but many things were left to the states (Instances). People had a hard time seeing how this is a good thing. Many people - esspecially conservatives - ask for a strong man and are not able to hold long discussions. They want pragmatic decisions even if it will not guarantee the best outcome in the long run.
The good thing about a Federation is/was, that you have 16 "Working groups" running to the same goal, trying to find their best solutions. Some come up with great ideas on their own, some get inspired how the neighbors do it, some take an international approach and look into europe and some are just overwhelmed with the given task and struggle. People were really put off how "Everyone does his own soup" and some were really angry why there was no central plattform. Like China. Where one man said what to do. Not realizing that this could mean, that this one person has either the right solution, or is ending up locking down whole cities and incarcerating people into camps. For Years. People thing highly of centralized approaches, but do not see how bad it can go - and Germany went to that in a very bad example not only 80 years ago. Yet, we still struggle to see the benefit in Federation as soon as problems arise. In normal times they love Federation.
So my point would be: Federation is great, but the huge downside will be, that we have to talk a lot. Maybe even include a voting tool. Make it secure enough that it can not be abused too much (because it will the bigger the instance gets). We have to define or at least trust certain people, that they will take care of our instances, that we can get behind. And if not, - contrary to living in a Federated country - we are at least able to move to the next instance without a pain (if the instances support account moving one day). But people will get tired of talking too much. They want action. They want a simple and easy solution and continue their life. Some will invest a lot of time into making the instance bearable for many, while some users will just sit in a soft crib, not contributing anything and not understanding why those people "in the glas palast" will not come up with the right solutions. Because they are not debaters. They want pragmatism and will accept more authoritarian instances, if it can make them feel like they are getting lead in a strong way - disregarding if it will play nice with others or not.
In the end, Federated Systems will be a mirror of our societies, closer than what plattforms were ever be able to reflect. But this will come with the exact same problems. I can see a bright future for federated systems if enough people invest their time in it to design the experience what was previously done by worker in multi billion dollar corporations. Now people are given the tools to create their own federated experiences in a digital place. Die instances will prosper by it. Some instances will lose. Some software will burn. Some instances will be too small to have a solid team to answer all this. Some users will be appalled by all of this. But if a critical mass of people can survive and is willing to carry the stick and some form of general consent can be reached via a declaration and a living and growing and changing body of rules, that will adapt to the new challenges of time, it will be THE BEST system out there.
Except if you think a communistic/chinese approach with a central figure and a central single party is the best, that will tell you what the right thing is to do and if you do not follow, your are an deviationist and must be handled/expelled. Some people people love that shit. interestingly, mostly only if they were born into this and were indoctrinated into such a system. There is not a single country in the last 50 years where the people where asked and they willingly decided for themself, that they want such a system. Those systems were always created above the heads of the people - as it is their nature of those systems.
A good approach would be several Cartas that can be nested/cascaded that define what people share as a general consent. Two Instances agreeing into a strong bond of the same value. Another one that wants to join them. Some instances might group as The United Instances of the Fediverse with some basic rights that are not debatable and some views that might change over time. Some communities maybe want to be a left alone and do their own thing with a unorthodox decision tree. Some will not share this carta, so they will come up with their own what would lead to interesting paradoxes or even expose some fallacies in some communities.
Time will show how much strength and endurance we have and how worth it will be for us, to govern our self: Put some things in the hands of the Software we want to use (Government), keep some rules to us (instances) and decide for our own where we want to live as a user. In reality - at least in Germany - it took decades to grow organically. Police and Schools is in the hand of the state, for them to decide what to teach (to some degree) and and when to neglect a criminal/unwanted behavior (to some degree) e.g. for what amount of canabis/hatespeech he can be picked up. In the same way will the instances in the Fediverse define for themself where to draw the line and people will move to those places that give them the best balance of having enough freedoms to life a fulfilling life, but not too much freedom that it will end in anarchy. Basically Democracy.
TLDR:
Pro: Democracy
Contra: Democracy.
π
One downside/senario I'm worried about is what happens when something really bad happens. Like illegal authorities-get-involved bad? Like leaking sensitive government information or a homegrown r/ jailbait situation that the media catches wind of. Stuff can't be permanently deleted, at least not without nuking everything around it...which people might be tempted to do. And that's basically turning anything seriously incriminating into essentially an infohazard that could get you nuked because you're in an instance where someone else from it commented on the thing or something. And any attempt to and defederation from the offending parties probably isn't the hard shutoff that the authorities would be demanding in such a situation. Even if nothing effectively happens to the greater Federation, it would be a PR nightmare that would probably kill any future attempts of evangelising the platform in the future, especially to bigger communities looking for a new place to stay.
Places like Reddit have mods and admins that worst case scenario, can be the scapegoats. Lemmy doesn't really have that layer of protection because of how esoteric it is to the layman.
You have duplicate communities, posts, etc.
It's hard to find communities.
Duplicate communities also existed on reddit, though. There were just so many people, it was a feature.
Evangelizing.
If I want to share a cool link with someone who has an account but is not yet active, I have to:
- ascertain their instance if they are on the site
- visit their instance on a browser
- search their instance for the post I want to share
On centralized platforms I can hit the "share" button the moment I find something interesting. When I do, I will receive a single link that will work for all users of the service.
Granted (because the platform then harasses the user who follows the link, trying to annoy them into getting an account and/or logging in so that it can more accurately harvest their data) it's not a ton better centralized.
But it does make it extra difficult to evangelize this way. I convinced a friend to get an account, and yet when I shared a link with him (without taking the above steps), he sent back a screenshot of the banner telling him he wasn't logged in.
I'd like an easier way to pull the uninitiated into a conversation occurring on this network of sites.
I get it's some form of tracking and that scares people here, but I keep on thinking there must be a way to set up cookies or whatever the right term is so that when you click on a link you'll automatically get sent to the Lemmy post through your specific instance. I would suggest an extension but I'm personally of the opinion that any site that needs a third party extension (like say, RES or Xkit) to fully work isn't a well designed site (not to mention it makes evangelising harder because now you gotta sign up for a new confusing thing and download this extension)
Like everyone's screaming "use smaller instances!!!1!" But like, this issue pretty much tells you "you should be using the same big instances for the best sharing/viewing experience"
There's not a great solution to this and it's a real problem. The easiest way is an app or browser extension that could recognize lemmy domains and swap in your preferred instance. That gets into problem territory with defederation though.
Another way would be federating identity, people would still get log in messages at least the first time per instance, but they could log in as user@myinstance and get a logged in experience then. This is a huge technical pain in the ass, and still not great for user experience though.
You could also share links in a Url shortened style and use that redirect to let someone select an instance or log in to another service to know where to send links. This also isn't great.
You could also share links in a Url shortened style and use that redirect to let someone select an instance or log in to another service to know where to send links. This also isn't great.
The ideal would be a site that asks you for your instance once, saves it as a cookie, then automatically redirects you.
There's much less control about the software.
In a federated system you have no control about wheter remote instances are running up-to-date software or even the same type of software (think Lemmy vs Kbin), which makes breaking changes really hard to impossible, since you never know what ancient version another instance might run.
This is part of the reason why e-Mail works the same now as it did in the 80s. If e-Mail was a centralized service, it would be a full communications- and office-suite now, but since it's federated it's still separate messages in folders and stuff like grouping messages by thread are considered innovative.
No unnecessary bloating features and very slow implementation of new stuff seems like a plus to me
If you subscribe to the old Unix mantra of "one tool, one purpouse", then yes.
If you prefer convenience and the ability to accomplish things, then no.
Using eMail for video chat isn't really an option.
This is part of the reason why e-Mail works the same now as it did in the 80s.
I still want to see a proof that there isn't a technical solution for this.
There are things like versioned APIs, backwards compatibility... You can make your network protocol modular and extensible... Think of XMPP and some other examples.
E-Mail is somewhat alright and has a few good design choices. That's why it's still around today. With the additional lessons learned since then, todays knowledge and tools, I bet we can design some technical solutions to the upgradeablility-problem.
It's absolutely just a skill issue, matrix has made breaking changes without significant issues.
Turns out that if you just design a protocol with changes in mind you can simply reserve a version namespace for all but the most fundamental functionality and crank the number up for every breaking change.
1: Anything that's federated is public (to instance admins) and can't be reliably deleted.
For ActivityPub, that's pretty much everything except user account.
For email (SMTP) that's sender, recipient, subject, and usually body.
Etc. Instance admins can log whatever they want. Laws like the GDPR or CCPA don't apply to all instances.
2: User signup is much harder because choice paralysis over which instance to join often sets in. That in turn leads to default recommendations, resulting in centralization in a few instances. E.g. lemmy.world, beehaw.org, sh.itjust.works, lemmy.ml for lemmy, Gmail, Apple mail, MS Live email, AWS email options for email.
From running multiple accounts across multiple instances, I've found that each instance feels like a separate forum of posts. Sure some of the big ones federate with each other, but that still doesn't lead to being able to see the same federated content when you log into infosec.pub or lemmy.world. I think a lot of the differences in content lie with which instances federate with which other instances.
Yep it's important to pick an instance that doesn't block many other instances, if you want as much content as possible.
It is difficult to control users, to ban them permanently etc. It is difficult to make money with federated software. You could maybe show ads. But nothing that'd make you rich.
That second point is a feature, not a bug.
More of a wish than a challenge but federated identities would be awesome. Home instance offline? No problem, just switch servers. No need to try and sync settings and subscriptions between accounts.
Blockchains already do this with public key cryptography. Your "login and password" would just be a Mnemonic Phrase. The fediverse just distributes the public information to use that phrase.
Agreed, portability of accounts should be much higher priority that it currently seems to be on either mastodon or lemmy. But also, that limitation is not an option at all on non-federated platforms.
Identity theft. Not as serious as the real life version but imagine that I make an account with your username on another instance, maybe under a domain that's very similar to yours, and start stirring up trouble. If you're someone people recognize I could hurt your reputation or scam people.
Where I notice the most annoying downside to me most is Mastodon: You cannot see any previous discussions and interactions.
When some makes a post I see zero replies, zero boosts, and zero likes when viewing it from another instance. The user also has zero previous posts and zero people following them. When opening the profile on their instance I see hundreds of previous posts, a couple of thousand follows and the toot in question has some likes, some boosts, and a lot of replies.
You have to run and maintain several instances. What if one instance goes down forever?
Then all of its content was already synced to the other instances. And, you technically can re-activate the down instance's communities on another instance, if needed.
Each individual actor in the system has less incentive to provide value and no incentive to maintain continuity. As a result, you are basically reliant on a small number of unconnected and pseudonymous volunteers who could walk away at any time. Add to that managing a server with thousands of users is basically a part-time job with little pay and you have a system that is sustained by the kindness of a couple dozen strangers.
You cannot censor content. I could make an instance where I post the most vile things and even if 99.99% of lemmy hated my guts and wanted me shutdown I could continue to host my instance and federate with like minded communities. In a non federated platform Admins would delete my instance.
This is a positive to some and a negative to others.
This has been a thing since even before the web existed, with Usenet (the original federated forum) in the 1980s.
Would you really want admins controlling what you can and can't say online? What if the admins have different political or societal views than you, and delete you / your content just because they disagree with what you're saying? The world needs fewer power-hungry admins and mods, not more of them.
Also, the the thing with open source software is that you can't control how people use it - a key feature of open-source is that it's accessible to everyone.
IMO anyone should have the power to start their own Lemmy instance, but other instances should have the power to block you. I do agree that there's some instances that 99% of Lemmy would block. For cases like that, an optional global blocklist of awful instances, that any instance could opt-in to blocking, would be useful.
Personally I do not want that but there's a lot of people that want to shut down things they don't like.
I'll put it this way. In the US, there used to be a rule where, if you broke the law and the police were after you and you drove into another state, the police from the first state you were in had to rely on that state's police to do anything. There was an episode of the Simpsons that spoofed this once. Now apply this to websites.
As we've learned here on hexbear with our recent federation, reddit people are almost unimaginably bad at making memes. Suddenly having your feed look like 9gag is a downside till you block a couple comms