A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
For Example
We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.
Useful Lists
Look at K3s. Since a while it has built-in support for Tailscale (can also use Headscale).
Alternatively, it doesn't really matter how or where your nodes are located, if you add a VPN to allow them to talk to each other.
Your main issue would be storage. But that's easily fixed with a topology aware CSI and then keeping your stateful workloads either wherever they got their volumes provisioned, or forcing them to be provisioned on your home servers.
That is what rook-ceph or longhorn is for. Longhorn is good for beginners
Good point about Tailscale. It hadn't occurred to me.
How does DNS work for a Tailscale-networked cluster of servers?
My understanding is at least one of the nodes would need to be designated as the ingress. I could potentially also have all the master nodes hold the ingress, but then I believe that means I'd need to use round robin DNS in cloudflare to ensure the domains are always pointing at the cluster.
Storage might be a problem, but being more cloud aware potentially means I can run DuckDB against minio to scan S3 objects when doing data-intensive tasks.
As another option why not docker swarm? I think it will do what you need and is much simpler than k8s.
I’ve been using caprover and really liking how simple and reliable it’s been. In the process of going from a single node to a swarm, still researching / experimenting but liking it so far!
I read into Docker Swarm, the community surrounding it is much smaller and there appear to be far fewer tutorials compared with k8s.
In addition to hosting the usual self-hosted applications that are often mentioned, I also do a good amount of processing of crypto and other financial data. Being able to more dynamically add/remove servers and have the containers automatically assigned / routed should at least in theory save me a lot of time administering the infrastructure.
The problem with hosting kubernetes on VPSes is that exposing the Kubernetes API to the public is pretty sketchy. I know a lot of people do it, but I don't like the idea.
I also like having multiple smaller Kubernetes clusters then a single big one. Easier to manage and breakage is more isolated. You can incorporate external services into kubernetes pretty easily using kubes services and endpoints.
I suggest using K3s as it is very lightweight, easy to deploy, and is k8s compliant. There are default set of services k3s deploys by default and are designed for more 'IOT' applications. Things like service-lb. These things can be disabled if you want during install time.
For managing it I like to ArgoCD on a 'administrative' kubes cluster local to you. It has no problem connecting to multiple clusters and has a nice declarative yaml files for configuring things that work well with a git-based workflow. The web UI is nice and is used widely.
What's your take on inter-cluster communication?
E.g. I could hypothetically have 3 clusters:
Potential use cases:
Service mesh is what you're looking for here. Istio is a front runner in this space.
Without knowing more of your use case though multi cluster is really adding a lot of complexity here and I'm not sure what you're getting over, say, namespaces and network policy.
The cheapest and most straightforward solution would be to use Docker Swarm. You will benefit from the cluster without the cost or complexity of Kubernetes. Much less to learn, reuse the docker compose. Here is my go-to stack for similar needs: Swarm, Portainer, Caddy.