this post was submitted on 11 Jul 2023
110 points (99.1% liked)

Fediverse

27398 readers
857 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to [email protected]!

Rules

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration), Search Lemmy

founded 1 year ago
MODERATORS
 

As the question states. I have the skiils and know how to setup a new instsnce and from looking through the documentation its relatively straight forward. Im just wondering would it actually help the fediverse and lemmy as a whole? There seems to already be plenty of instances to choose from. What are your guys thoughts?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 9 points 1 year ago (3 children)

I created mine because I am a systems engineer by trade and I moved on from Reddit. Nobody else has used my instance except for me, but I think it's worth it. I like being in control of my own account and can be assured my instance wont impose rules that i dont agree with or worse, just disappear. If other people find it useful, then that's even better.

[–] [email protected] 5 points 1 year ago (2 children)

How much storage does it take to host your own instance that’s federated with large servers? I am really curious about hosting my own instance but I don’t really understand how the storage works and don’t want my computer filled with thousands of strangers comments.

[–] [email protected] 2 points 1 year ago

If you're the only user on your instance, your server will only know about and fetch from communities you're personally subscribed to. If there's a second user, add the communities that user is subscribed to, etc.

[–] [email protected] 2 points 1 year ago

In the month I've been running my server, I have accumulated about 8GB of data. I've subscribed to about 30 communities or so, but my server only has be actively using it.

[–] [email protected] 2 points 1 year ago (1 children)

@bionicspud, I've been thinking of doing the same thing for the same reasons. How much storage does your instance use? I haven't looked in to how asset caching works yet. It seems like it could easily get out of hand.

[–] [email protected] 4 points 1 year ago* (last edited 1 year ago) (1 children)

Running the Instance for 3 Days now. Added multiple new Subs and cleared pictrs (but not Postgres) folder yesterday. My instance is mostly used by me.

87M ./pictrs

335M ./postgres

Edit: Small update. Original Post was posted ~9AM. Now its ~11AM

112M ./pictrs

351M ./postgres

As far as i know, images shouldn't be stored locally if not posted from the local instance. This looks to be a proxing problem as far as i understood.

[–] [email protected] 2 points 1 year ago* (last edited 1 year ago) (1 children)

what happens when you clear pictrs? you mean just deleting the folder? does that break stuff?

for comparison, my instance is only communities and no users (FAQ here: https://programming.dev/post/442419 )

it's about 5 days old but not much activity

# du -h --max-depth=2 ./
73M     ./volumes/postgres
7.8M    ./volumes/pictrs
8.0K    ./volumes/lemmy-ui
81M     ./volumes
81M     ./

the latest backup is only 7.4 MB zipped, I use this backup script

#! /bin/bash
# https://join-lemmy.org/docs/administration/backup_and_restore.html#a-sample-backup-script
now=$(date +"%Y-%m-%d_%H.%M.%S")

cd ~/lemmy && (docker-compose exec -T postgres pg_dumpall -c -U lemmy 1> dump.sql 2> dump.errors)
cd ~/lemmy && zip -r9 ~/bak-lemmy-$now.zip ./ --exclude "volumes/postgres/*"
rm -f ~/lemmy/dump.sql

like I said though, not much activity

and here's how my backup zip files have grown in size over time

6.6M bak-lemmy-2023-07-08_03.00.01.zip
6.6M bak-lemmy-2023-07-08_06.00.01.zip
6.6M bak-lemmy-2023-07-08_09.00.01.zip
6.6M bak-lemmy-2023-07-08_12.00.01.zip
6.6M bak-lemmy-2023-07-08_15.00.01.zip
6.6M bak-lemmy-2023-07-08_18.00.01.zip
6.6M bak-lemmy-2023-07-08_21.00.01.zip
6.6M bak-lemmy-2023-07-09_00.00.02.zip
6.6M bak-lemmy-2023-07-09_03.00.01.zip
6.6M bak-lemmy-2023-07-09_06.00.01.zip
6.6M bak-lemmy-2023-07-09_09.00.01.zip
6.6M bak-lemmy-2023-07-09_12.00.01.zip
6.6M bak-lemmy-2023-07-09_15.00.01.zip
6.6M bak-lemmy-2023-07-09_18.00.01.zip
6.6M bak-lemmy-2023-07-09_21.00.01.zip
6.7M bak-lemmy-2023-07-10_00.00.01.zip
6.7M bak-lemmy-2023-07-10_03.00.01.zip
6.7M bak-lemmy-2023-07-10_06.00.01.zip
6.7M bak-lemmy-2023-07-10_09.00.01.zip
6.8M bak-lemmy-2023-07-10_12.00.01.zip
6.8M bak-lemmy-2023-07-10_15.00.01.zip
7.0M bak-lemmy-2023-07-10_18.00.01.zip
7.0M bak-lemmy-2023-07-10_21.00.01.zip
7.0M bak-lemmy-2023-07-11_00.00.01.zip
7.0M bak-lemmy-2023-07-11_03.00.01.zip
7.0M bak-lemmy-2023-07-11_06.00.01.zip
7.0M bak-lemmy-2023-07-11_09.00.01.zip
7.0M bak-lemmy-2023-07-11_12.00.01.zip
7.0M bak-lemmy-2023-07-11_15.00.01.zip
7.4M bak-lemmy-2023-07-11_18.00.01.zip
[–] [email protected] 2 points 1 year ago* (last edited 1 year ago) (1 children)

Tested deleting the pictrs/files/001 which was at that point at ~150mb. And yes, it broke stuff. For example my Avatar and a local test community logo. To "purge" it, something would need to compare it to the database i guess. My size probably comes from /c/memes 😅
I thought remote images aren't cached localy 🤔

[–] [email protected] 1 points 1 year ago (1 children)

I think it might just be thumbnails that are cached locally? And obviously your own banner and local images

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago)

Looks like random? Both images are from [email protected] didn't post on any of these 2 threads. It would be nice to know why sometimes its get copied. https://lemmy.ml/pictrs/image/b2e8d1e4-b638-4d04-9710-9fa28756261d.jpeg?format=webp https://lemmy.gwa.app/pictrs/image/962b1734-d524-468c-b3f9-4d615f91f094.png?format=webp

The interesting thing is, both posts originated from .world and when opened from the original sources are also hosted the.

https://lemmy.world/post/1318708

https://lemmy.gwa.app/post/1437

https://lemmy.world/post/1348802

https://lemmy.gwa.app/post/2310

[–] [email protected] 1 points 1 year ago

That is exactly the reason why I run mine.