this post was submitted on 28 Nov 2023
0 points (50.0% liked)

Data Hoarder

168 readers
1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago
MODERATORS
 

Example 1:
Right during the pandemic, TFI (French TV) put up all past seasons of its show 'Star Academy'. It was something I have been trying to get hold of but did not have any luck. As soon as it popped I thought I got it all. (2 years ago). Today I found out I was missing the first season (8 in total) and went to try to grab it. ALL seasons have now been removed. I am quite pissed at it!

Example 2:
A user upscaled Britney Spear music videos using AI. The results were mind blowing. I grabbed all the videos I could (official ones are 480p/720 p max limited). Less than 1 week later, the content was gone....forever.

Example 3: (Non YT)
Not YT. Koh Lanta (French equivalent of Survivor) is aired on french TV (TFI again). As soon as the season is over, they take it down. You are unable to rewatch/watch it if you missed the air/stream time. ALL past seasons are also not available and that spans to about 20+ years of contents and 30+seasons. Same applies to US Survivor but to a lesser extent. And you need to keep paying to 'stream' it.

Conclusion:
Always archive media you want to rewatch/collect. Streaming is not your friend. It is just another way of controlling content distribution, tying you up to the 'subscription' slavery model instead of owning your contents and worse, down the line downright CENSORING or MODIFYING contents to fit whatever garbage narrative is currently en vogue.

Stay focused brothers!

top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 1 points 11 months ago

i have (checks drive) about 4 TIB of archived youtube content, there is a non zero chance i have something you want if you like the same stuff i do lol.

Somewhere between 7-14 thousand videos. I havent checked the real number.

It's content i like mostly, with some definite deletions later on. Archived for posterity since if i don't do it nobody else will, even though unlikely to go bunk. It could happen someday :)

[–] [email protected] 1 points 11 months ago

A reminder for people in the US who may be concerned, the same time shifting principle from this SCOTUS decision applies to saving streaming content. Simply, if you had legal access to the content at one point in time, you are allowed to time shift by recording and playing back for personal use at another point in time.

!IANAL YMMV!<

[–] [email protected] 1 points 11 months ago

you can setup a cron job to run yt-dlp with a link to your "liked videos" playlist periodically

[–] [email protected] 1 points 11 months ago

Greetings ye, I still am lamenting the long-ago deletion of that “Ed, Edd, n’ Eddy” video, in which “Nigh of Fire” is synchronized onto the film’s opening vehicle-chase; such was the means that I was formally introduced into Euro’beat. -__-

~Waz

[–] [email protected] 1 points 11 months ago

My thing is I just want something to watch my personal playlists/ favorites and save them so I never have that "this video was removed" problem again.

However, I don't know what can do it. I tried TubeArchivist and another one using their Docker containers in my Unraid server but it doesn't really do what I'm trying.

[–] [email protected] 1 points 11 months ago

They say there’s a server with everything on it. I don’t know if it’s true but I hear a lot about google just hoarding everything. I assume most of the big companies have offset archives in storage for that later day. They keep them private for reasons. Unlocking them takes skill, guidance, and friendships. You won’t get into any of those rich peoples servers without some clean tea bargaining that’s for sure. S as though some of us are crazy enough to just convince them to open up the whole thing in just a few sweet ledgers of conversation. Call it human instinct. But it’s true. We’re all just people on this world. If the ends meet, well, maybe we’ll just get all that data we’ve been asking for and get to have a drunken party afterwards! Ya know? Anyways…good luck!

[–] [email protected] 1 points 11 months ago

I did analysis of my liked videos, based on Google Takeout and 10% of my liked videos are gone.

On the other side I would not watch them again anyways. I just backup important stuff.

[–] [email protected] 1 points 11 months ago

Indeed, so many videos I took for granted disappeared later. Max the storage, max the network speed... hoard everything!

[–] [email protected] 1 points 11 months ago

This is something I have been able to work much better on thanks to TheFrenchGhosty's Ultimate YouTube-DL Scripts Collection. It's easy to download, but hard to curate and sort as I would like playlists to be in numerical order, but it doesn't scale well if a new video is added or an order is swapped. Best stick to iso date format as that is some form of an order. I may make some tweaks to them such as better sponsorblock support and just for archival use only.

[–] [email protected] 1 points 11 months ago

it's just such a shame that yt liked playlist got completely privated some years ago so you can't automatically download everything

[–] [email protected] 1 points 11 months ago (3 children)

I've set up "Tube Archivist" and don't regret it whatsoever. Automatically scans my playlists or channels I add at the times I set the cron to. It's still somewhat in early development and the cookie-parsing doesn't work half the time for me sadly, tho I seem to be one of just a few cases who have this issue.

It's a game-changer when it comes to archiving :) It even saves subtitles, comments and SponsorBlock timestamps.

[–] [email protected] 1 points 11 months ago

I did as well last week. And I am in love. I’m still conservative on what I download and specifically what I subcribe to. But the process is now sooooo much easier compared to the manual labour I did before (and have for five years). Maybe my top docker app install this year!

load more comments (2 replies)
[–] [email protected] 1 points 11 months ago

Sigh, I used to. But have run out of storage space. I'm feeling very anxious.

[–] [email protected] 1 points 11 months ago

I (finally!) installed Tube Archivist last week and went through my library of already archived YT videos and saved them manually in TA (it’s the easiest way if you haven’t saved the metadata to go with the video, which I hadn’t for the oldest videos). Out of almost 1000 videos over five years or so, maybe 5% have gone private or is gone from YT. And it was mostly videos I really wanted to keep. Now comes the dirty work of trying to find the metadata for those missing videos since I do have them locally. I have done some research around how to do it, but if anyone has actually figured it out it would be nice to know!

[–] [email protected] 1 points 11 months ago (7 children)

Way too much stuff is disappearing these days, my archive has over 200k videos that have been removed from YouTube

[–] [email protected] 1 points 11 months ago (1 children)

That’s impressive. Only ones that has been removed, or in total?

[–] [email protected] 1 points 11 months ago (3 children)

Just the removed ones, the total's over a million

[–] [email protected] 1 points 11 months ago

How do you find out a video is gone from YT at that scale?

load more comments (2 replies)
load more comments (6 replies)
[–] [email protected] 1 points 11 months ago

I basically throw every YT video I watch into TubeArchivist. The browser extension makes this a single click. Currently have over 5TB of YT videos saved, including whole channels.

[–] [email protected] 1 points 11 months ago (1 children)

I learned this one the hard way. I am an NBA fan and YouTube used to be a bastion of full games from 80 - early 2000s.

I started archiving, but then the Last Dance happened and the NBA scrubbed the Internet of all old full games.

I got half way through backing up all the 90s bulls championships before the purge and it still bugs me.

[–] [email protected] 1 points 11 months ago

It’s annoying when you know they where there at some point and you just never got to them. At least they actually published som classic games on YT during the pandemic and most (all?) of them are still there. I have archived them of course :)

[–] [email protected] 1 points 11 months ago

A user upscaled Britney Spear music videos using AI.

Care to share ? :D

[–] [email protected] 1 points 11 months ago (2 children)

Sooner or later all these streaming first movies and shows that had zero physical release will start to go missing or in limbo when these companies go under and people will wonder where they can find them.

I know a lot of the shows I enjoy watching on netflix will be gone someday unless I start backing them up now.

[–] [email protected] 1 points 11 months ago (1 children)

That’s why I pay for some streaming services but never actually use them to watch shows. If you know what I mean? ;)

load more comments (1 replies)
[–] [email protected] 1 points 11 months ago

I have 10-12 channels I back up. I have a windows task schedule to run YT-DLP every 12 hours on each channel and they are spaced out as much as I can so there is as little overlap as possible and the ones that do are the ones that done update regularly.

[–] [email protected] 1 points 11 months ago

Wow, a Koh-Lanta reference outside of r/survivor. Not something I expected.

[–] [email protected] 1 points 11 months ago

It's TF1 (one), not TFI :crying:

[–] [email protected] 1 points 11 months ago

This is why I save all music/audiobooks/etc. In flac from deezer. Its so fucked up if theres something coming to mind which you want so Bad after remembering it just to Disco ver its gone.

[–] [email protected] 1 points 11 months ago

I've done similarly, RedLetterMedia, some of my fav streamers and long plays, Gaki no Tsukai - and recently DnD streams. If I'm on my PC at least, I play the videos straight from youtube as a means of support to the channels, but any other time? I've got my copies on a loop.

Had been using Tartube and I never delved deep into youtube-dl cmd prompts. Recently it seems to have issue downloading the highest available quality, but I'm beginning to not care as much most of the time, I just rip it to a lo bit rate mp3 to listen to when I'm driving, cooking, w/e. Most of the time, the content I have is very conducive to just audio only.

[–] [email protected] 1 points 11 months ago (5 children)

Tu sauvegarde la Star Académie !!! Mais honte à toi ! C'est déjà assez dur comme ça, même sans TV d'essayer d'y échapper, aux pubs en ville, et leurs reprises de merdes à la radio... Et toi tu sauvegarde ça sur ton setup de geek ! Mais vas marcher sur des Lego !!!! C'est dingue ça !!!

Bon OK Koh Lanta, je peux comprendre, entre les aventuriers toujours plus dingues à chaque saison et les changements de règles toujours inattendus de Denis, ça reste ce qu'il y a de mieux sur TF1.

Mais bordel, la Star Ac....

J'ai 31 ans, déjà quand l'autre grognasse Bretonne de Nolwenn Leroy a gagné j'en avais déjà marre (saison 3 je crois ?), j'avais 12 ans à l'époque.

S'il te plaît OP, laisse donc cette merde mourir dans les oubliettes de TF1. Puisse qu'aucun archéologue dans le futur, tomber sur cette daube et prétendre que "c'était la musique populaire en ce temps là".

Si tu veux sauvegarder des émissions ou D ela musique, choisis au moins du contenu audible et de bon goût, s'il te plaît !

load more comments (5 replies)
load more comments
view more: next ›