Self hosted

154 readers

1 users here now

A place to share, discuss, discover, assist with, gain assistance for, and critique self-hosted alternatives to our favorite web apps, web services, and online tools.

founded 2 years ago

MODERATORS

lol

-1

Best web archiving software for complex sites and sites requiring logins? (lemmy.world)

submitted 2 weeks ago by [email protected] to c/selfhosted

1 comments fedilink hide all child comments

For years I've on and off looked for web archiving software that can capture most sites, including ones that are "complex" with lots of AJAX and require logins like Reddit. Which ones have worked best for you?

Ideally I want one that can be started up programatically or via command line, an opens a chromium instance (or any browser), and captures everything shown on the page. I could also open the instance myself and log into sites and install addons like UBlock Origin. (btw, archiveweb.page must be started manually).

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 1 points 2 weeks ago

https://www.httrack.com/ may not be exactly what you want but fits much of what you describe.

I haven’t tried to, but there does seem to be a way to capture “logged in” websites:
https://stackoverflow.com/questions/20362821/httrack-possible-using-cookies#58354077