[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / r / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip / qa] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/t/ - Torrents

Name
Options
Comment
Verification
4chan Pass users can bypass this verification. [Learn More] [Login]
File
  • Please read the Rules and FAQ before posting.

08/21/20New boards added: /vrpg/, /vmg/, /vst/ and /vm/
05/04/17New trial board added: /bant/ - International/Random
10/04/16New board for 4chan Pass users: /vip/ - Very Important Posts
[Hide] [Show All]


[Advertise on 4chan]


File: 1707902570702504.jpg (305 KB, 1288x2256)
305 KB
305 KB JPG
Hello /t/

With the changing face of the internet and censorship as a whole I would like to personally consider siterips for archival, I do not know how to do this personally and would like your help

Question 1: is there any software that can rip a site currently without any captcha bullshit in a functional form to place on a HDD, for example archiving gelbooru with search function and tags intact so it can work entirely as an backed up offline collection?

Question 2: Is there any dedicated resource or forum for the collection of torrents that contain siterips?

In the meantime, post any siterips you have in this thread, if anyone has gelbooru or danbooru siteripped I would be grateful, thank you

>Wicked.com siterip
magnet:?xt=urn:btih:e188a075fbdbeddb803afb4a4aa5ea5f81486363&dn=Wicked.com%E7%B3%BB%E5%88%97.Siterip&tr=udp://tracker.openbittorrent.com:80&tr=udp://tracker.opentrackr.org:1337/announce
>>
I respect your craft anon for you have posted a siterip and not just requested. Let me share with you what I know
1) porno siterips - lots on here, otherwise use bt4rg and just search for "siterip" and you get a lot, mostly prons
2) Archive Team.

Definitely check out (2). Archive Team is a community of autists that rips many sites (non-pron) and uploads to archive.org. Most of their stuff is in WARC. So you have off the top of my head, pastebin is on there, a few others.

You may also want to check out "the common crawl" which is fuel for LLM/AI stuff, but it is a siterip of the whole internet (a webcrawl). There are releases per each year and it's recommended if you want to do it right, you download every single release and compact them into one file, bit of a pain.

You can use bt4rg to find whatever, for example I have stack exchange, some twitter, all of reddit (pre API change), etc.

But really, again, look up Archive Team, those guys really go hard and have a massive amount of data, insane. it's clunkified and buried inside archive.org so you need to learn up on using that site and some python download tools, but if you go down that rabbit hole you'll find tons and tons and tons of wild shit.
>>
>>1301739
Looking into the archive team it seems very complete/useful, so thank you anon that is basically a /thread

Unfortunately it does not look like I can use their "warrior" to archive sites of my own choosing and I'd rather not assume the risks associated with joining a group, I appreciate them for what they've done though
>>
now that I think about it neither has any of the boorus listed as archived, the boorus are important to me and I'd like to back them up, what kind of software could I use to do it myself?

>Masterclass siterip
magnet:?xt=urn:btih:425b660fabe162263d7ef8b43c076e03e9f3b27c&dn=Masterclass.com%20SITERIP%201080p%20WEB-DL%20H.264%20AAC2.0&tr=error%20code%3A%20525
>>
>SexAndSubmission.com Full SiteRip 540p [WPz]
magnet:?xt=urn:btih:aeb2661bcfed7b06dee8d0fb144d31d5aa2a56fe&dn=SexAndSubmission.com%20Full%20SiteRip%20540p%20%5BWPz%5D&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337&tr=udp%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce&tr=http%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce

>X-Art mkv Site Rip
magnet:?xt=urn:btih:7aa8b4e80c053feb53de872b79624ea90aefeadb&dn=X-Art%20mkv%20Site%20Rip&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337&tr=udp%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce&tr=http%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce

>Powershotz_SiteRip
magnet:?xt=urn:btih:92d41afc0ae58b83374ca5506ebc4a74b91c88ba&dn=Powershotz_SiteRip&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337&tr=udp%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce&tr=http%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce

>Insex Siterip 2001-2003 (1000 Videos&60000 Photos)
magnet:?xt=urn:btih:2d7a0d1233682605182902790bedceddc1e964ac&dn=Insex%20Siterip%202001-2003%20%281000%20Videos%2660000%20Photos%29&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337&tr=udp%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce&tr=http%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce

>teenkasia.com Teen Kasia all videos siterip 2012-12-11 corrected aspect ratio
magnet:?xt=urn:btih:61641d43bfb580f633bdfe54a8b719f1b6253cc3&dn=teenkasia.com%20Teen%20Kasia%20all%20videos%20siterip%202012-12-11%20corrected%20aspect%20ratio&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337&tr=udp%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce&tr=http%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce
>>
>Hentaied SiteRip
magnet:?xt=urn:btih:646ad9480fa75a2d8fb19e9d59a6c4157b3af3ed&dn=Hentaied%20SiteRip&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337&tr=udp%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce&tr=http%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce

>ShibariStudy.com.SiteRip.012024.MP4.AAC.FullHD.Internal-CyberCrime
magnet:?xt=urn:btih:4924d87cd3abca968295eff38078667332393cfb&dn=ShibariStudy.com.SiteRip.012024.MP4.AAC.FullHD.Internal-CyberCrime&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337&tr=udp%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce&tr=http%3A%2F%2Fbittorrent-tracker.e-n-c-r-y-p-t.net%3A1337%2Fannounce
>>
>>1302912
>>1302913
requesting for sexycandidgirls dot com pls anon
i'd be happy with just the shorts section
>>
i'm seeding these for few weeks more.

[metart.com] Photosets - 1999 to 2023
bWFnbmV0Oj94dD11cm46YnRpaDo1ZmQyN2Y0MDc2YzQ0ZGEwM2I5NDI3OTQ5MzVmNWQ4M2E0MTUyODQ5JmRuPSU1Qm1ldGFydC5jb20lNUQlMjBQaG90b3NldHMlMjAtJTIwMTk5OSUyMHRvJTIwMjAyMyZ0cj11ZHAlM0ElMkYlMkZvcGVuLnN0ZWFsdGguc2klM0E4MCUyRmFubm91bmNl

[nubiles.net] Photosets - 2004 to 2023-10
bWFnbmV0Oj94dD11cm46YnRpaDoxMDYxMDQ5MmI4M2Q1ZmI5MGUyZGVkMTYxMTViZDk2MmIxMjJjZDBiJmRuPSU1Qm51YmlsZXMubmV0JTVEJTIwUGhvdG9zZXRzJTIwLSUyMDIwMDQlMjB0byUyMDIwMjMtMTAmdHI9dWRwJTNBJTJGJTJGb3Blbi5zdGVhbHRoLnNpJTNBODAlMkZhbm5vdW5jZQ==

[amourangels.com] Photosets 2006 - 2023-10
bWFnbmV0Oj94dD11cm46YnRpaDo2YjQ0ZDQ2YmU5ZWFlOWJjNjFjMDM4ZGQ4YjU5NzRmYjgwNWUzNjBhJmRuPSU1QmFtb3VyYW5nZWxzLmNvbSU1RCUyMFBob3Rvc2V0cyUyMDIwMDYlMjAtJTIwMjAyMy0xMCUyMCUyOHB1YmxpYyUyOSZ0cj11ZHAlM0ElMkYlMkZvcGVuLnN0ZWFsdGguc2klM0E4MCUyRmFubm91bmNlCg==

[ftvgirls.com] Photosets - 2002 to 2023-06
bWFnbmV0Oj94dD11cm46YnRpaDpkNWUxN2YyODBiNmMyMGY5YmFjNDQwZWViYWIzM2ZmZDkxNGRlYjVjJmRuPSU1QmZ0dmdpcmxzLmNvbSU1RCUyMFBob3Rvc2V0cyUyMC0lMjAyMDAyJTIwdG8lMjAyMDIzLTA2JTIwJTI4cHVibGljJTI5JnRyPXVkcCUzQSUyRiUyRm9wZW4uc3RlYWx0aC5zaSUzQTgwJTJGYW5ub3VuY2U=

[showybeauty.com] Photosets 2011 - 2023-10
bWFnbmV0Oj94dD11cm46YnRpaDphMzNmYTk3ODE5OTEyYWQ0OGIyOWNiNjFlZTIyNDA4YzJiMGRmMzcxJmRuPSU1QnNob3d5YmVhdXR5LmNvbSU1RCUyMFBob3Rvc2V0cyUyMDIwMTElMjAtJTIwMjAyMy0xMCUyMCUyOHB1YmxpYyUyOSZ0cj11ZHAlM0ElMkYlMkZvcGVuLnN0ZWFsdGguc2klM0E4MCUyRmFubm91bmNl

[femjoy.com] Photosets - 2004 to 2023-06
bWFnbmV0Oj94dD11cm46YnRpaDowYTY4N2E2MDNlMDNhMDc2NTM2NWRkN2ZmYmIyNmU5NGUyNDU3OTk4JmRuPSU1QmZlbWpveS5jb20lNUQlMjBQaG90b3NldHMlMjAtJTIwMjAwNCUyMHRvJTIwMjAyMy0wNiUyMCUyOHB1YmxpYyUyOSZ0cj11ZHAlM0ElMkYlMkZvcGVuLnN0ZWFsdGguc2klM0E4MCUyRmFubm91bmNl

[hegre.com] Photosets - 2002 to 2023-07
bWFnbmV0Oj94dD11cm46YnRpaDpmYzk2YTA4YjcyNjUyZDAyZmY1NmEzMDIxOWE1MzNlNmIzNDk5ZTlhJmRuPSU1QmhlZ3JlLmNvbSU1RCUyMFBob3Rvc2V0cyUyMC0lMjAyMDAyJTIwdG8lMjAyMDIzLTA3JnRyPXVkcCUzQSUyRiUyRm9wZW4uc3RlYWx0aC5zaSUzQTgwJTJGYW5ub3VuY2U=
>>
>>1303373
[mplstudios.com] Photosets - 2003 to 2023-07
bWFnbmV0Oj94dD11cm46YnRpaDpkZmFlZDFhODI4MzBlNDM3MzIwZGFjMmJhOTFlOTYyZmI5NDQyOWU4JmRuPSU1Qm1wbHN0dWRpb3MuY29tJTVEJTIwUGhvdG9zZXRzJTIwLSUyMDIwMDMlMjB0byUyMDIwMjMtMDcmdHI9dWRwJTNBJTJGJTJGb3Blbi5zdGVhbHRoLnNpJTNBODAlMkZhbm5vdW5jZQ==
>>
can someone share magnet link for fuckedhard18?
>>
All of this is boring ass shit
>>
>>1301479
HTTrack can perform an offline rip IIRC
>>
>>1301479
>software
i share your concern anon and while i'm not a pro at this i've shared some siterips and large megapacks myself and based off of my experience you'll need to learn at least some basic programming and the basics on how modern webpages work, a good place to start would be something like scrapy https://scrapy.org/ it's relatively noob friendly and easy to use plus you can probably get some tutorials on getting started and once you get some experience you'll be able to get around logins, dynamic content loading and other bullshit like that

for people interested in generic web archival rather than siterips i'd recommend checking this https://github.com/iipc/awesome-web-archiving , here you can find a lot of web archiving tools and tutorials, these tools don't require a lot of previous knowledge
but they are not nearly as powerful as something like scrapy

>dedicated siterip forum
i'm not aware of anything like that, the closest you can get are private torrent trackers, other than that there are a lot of siterips here on /t albeit on different threads
>>
File: Deleted.png (1.65 MB, 1423x828)
1.65 MB
1.65 MB PNG
Does anyone have a magnet for D18 video?
>>
>>1301479
I've only used this for wikis which are fairly open, but wget can recursively grab most/everything from a site. I used wget -w1 -crpnp URL to get everything from a few video game sites.
>>
With the cracking down on game ROMs and abandonware in general, is there a working archive of myabandonware? It's not a perfect collection but impressive nonetheless and it would be a shame if it got lost to DCMA nonsense.
>>
Looking for a site rip of uralesbian and fellatiojapan

I just did a site rip of aozora bunko (japanese book website). If people are interested I can seed it. For OPs curiosity, I wrote the python script and scraped the site myself.



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.