Archiving things online, 101

LACUNA

Administrator
The subject of this forum (general weirdness, crime, debauchery) is prone to things going down, often quite speedily. Hence, it is extremely important that original or unique things to the case be archived. Posting something relevant, anywhere, ESPECIALLY if it is a case that has the eye of the media, means it is VERY LIKELY TO BE DELETED. Even if not, link rot is common and links go down all the time. Hence: ARCHIVE EVERYTHING. If you need help it is fine to post about it first.

Internet archiving sites
An online archive hosted somewhere is more subject to censorship than one you have, but it is more accessible to others and not subject to your house burning down or something.

Wayback Machine / Internet Archive
Very useful and has many features. However, it takes things down upon request and does not archive some "offensive" sites. Archives can be wiped with little notice. If anything is especially significant, mirror it to other archive sites.

There is also a media section of the Internet Archive that is not a website archive. Some media is uploaded by archive.org itself and some is by users. User uploads are often taken down but often not because it is poorly monitored. This is a good place to post things like videos, images, that were archived, though not for permanent archiving.

There are browser extensions to make using it easier, just click and it archives: Chrome, Firefox

Archive.today
Aka archive.is, archive.ph, archive.md, it has many URLs it shuffles by demand.
In theory, you can download the archive in its original form from the download button. However, a lot of the time this does not work, for reasons I cannot discern. Usefully, you can transfer Wayback captures to archive.today with similar functionality

There are browser extensions to make using it easier, just click and it archives: Chrome, Firefox

Ghostarchive
Decent. Better at archiving videos than Internet Archive.

Megalodon.jp
In Japanese, but has the unique ability to capture some JavaScript-heavy or paywalled things the others do not.

Video archiving
yt-dlp
A very complete and useful video downloader used by a command line. Can download almost anything anywhere with ease. If you don't want to use it with a command line, I have heard this frontend is good: Parabolic

My command for downloading original uploads (where the source is the original copy) is:

yt-dlp --write-info-json --write-description --add-metadata --embed-metadata --cookies-from-browser [whatever your browser is, chrome, firefox, etc) --write-thumbnail --embed-thumbnail --write-subs --embed-subs --sub-langs all --write-playlist-metafiles --write-comments -o "%(title)s/%(title)s [%(id)s].%(ext)s"

For reuploads, it is:

yt-dlp --write-description --write-subs --embed-subs --sub-langs all --cookies-from-browser [whatever your browser is] -o "%(title)s/%(title)s [%(id)s].%(ext)s"

--cookies-from-browser makes it so, if your account is logged in on that browser, it will view it in-account, bypassing age verification. If the title is too long (this happens with twitter), replace the end with -o %(title).200B.%(ext)s

Other video downloading sites
There are a lot of garbage YouTube downloaders out there. They are all running yt-dlp on the backend and they are all TRASH. I guess they're useful if you're on a mobile device.

Image archiving
Gallery-dl
Another command line tool, very effectively downloads all the images for things like Instagram or any gallery upload site.

Downloading full websites
These give local copies.

HHTrack
Simple, very easy website downloader with a gui. Does not give archival grade copies but gives useful, accessible ones.

Wget
Command line tool to download anything, anywhere. Far more complicated but far more powerful. You can configure it to give archival grade copies.

Other guides
This is only a basic guide for use on this forum, so if one wants to go beyond this you will have to look elsewhere

Archiveteam Wiki
Much more in depth guides on archiving a wide variety of things.

Kiwi Farms - Archival Tools
More in-depth guide on how to archive/convert videos for archiving.

What Next?
Where do you upload the things? Mirroring to the Internet Archive media section is a good short term solution for things such as videos, or less moderated video sites. If they are links or images, link here.
 
Last edited:
Very good stuff, I'll add to that with a few tricks and tools I use for YouTube specific archival.

YouTube Unique IDs
This particular ID will be vital for some of the tools I provided below.. Unique IDs are 24 characters long, all of them start with the first two letters UC with the remaining 22 digits being randomized characters. This ID cannot be changed and every YouTube channel will have their own individual ID similar to it.
Automated method: To find your target's Unique ID, input their YouTube channel url https://www .youtube .com/@pewdiepie into https ://commentpicker .com/youtube-channel-id.php which will provide the ID. UC-lHJZR3Gqxm24_Vd_AJ5Yw
Manual method: Open up your target's YouTube channel, go into inspect element and search for channel/UC. First result should be something like https ://www .youtube .com/channel/UC-lHJZR3Gqxm24_Vd_AJ5Yw. Though just to sure your not copying someone else's ID, open up their url like the one above and it should redirect to your target's channel.



Uncovering unlisted videos
Filmot.com
You can search your target's YouTube channel and potentially uncover videos that may be set to unlisted. You may simply search them by their username/or handle, but they may not show up at times as filmot may not have cached account yet or their current username/handle (if they previously went by an older name), best way of doing a channel lookup is by opening up their unique youtube url and replacing YouTube with Filmot

web.archive.org
Input your target channel URL and you may find some older archived webpage(s) of the account. Those archives may uncover some additional videos that may no longer appear on their current page when you view the archives.
To check it, copy the video url in question and remove the wayback machine parameter only keeping the YouTube portion of it and open it up on another tab.
web.archive.org/web/20201016134650/https://www.youtube.com/watch?v=rMjpPOEVAPU -> https ://www .youtube .com/watch?v=rMjpPOEVAPU

TIP FOR WAYBACK MACHINE:

When you search your target's YouTube channel, click the urls button in the bottom right of the search bar in the middle, you may find even older archives of the channel which the calender may not reveal. This trick may be useful the next time you search your target's channel so you don't overlook any previous archives which may include some unlisted videos as well.
EXAMPLE: I did a lookup of the Uvalde Elementry School Shooter's YouTube which only showed up one snapshot from May 24th, but now that I click the urls button, boom, it pops up an older archive that goes as far back as October 2020.



YouTube channel to Google User ID
Google User IDs are 21-digit numeric numbers that tie to a Google account. The first two numbers usually start with 10 or 11 with the remaining 19 being randomized. This particular set of numbers can be very useful for uncovering Google Map reviews and Google Plus accounts which can reveal some aliases your target may have went by.

90% percent of the time, Any YouTube channel that was archived on the Wayback Machine between 2014-July 31st 2020 will reveal a hidden Google Plus url in the source of the webpage. Simply use inspect element and lookup plus.google.com/1, you should be able to find their Google ID/Google Plus URL.
Example: Searching up PewDiePie's channel, I uncovered his Google ID which is 117663191659499528404, using that ID alone, I was able to find his Google Plus account on the Wayback Machine, I tried Google Maps but since he hadn't posted any reviews, his account didn't show up.


Additional examples
https ://www .google .com/maps/contrib/110204689250931734415 (Guy Bartkus/Palm Springs Shooter's Google account)
https:// web.archive .org/web/20260000000000*/plus .google.com/117663191659499528404 (PewDiePie's Google Plus)
 
Last edited:
Back
Top