Asklemmy

43753 readers

1282 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

Open-ended question
Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
Not ad nauseam inducing: please make sure it is a question that would be new to most members
An actual topic of discussion

Looking for support?

Looking for a community?

Lemmyverse: community search
sub.rehab: maps old subreddits to fediverse options, marks official as such
[email protected]: a community for finding communities

~Icon~ ~by~ ~@Double_[email protected]~

founded 5 years ago

MODERATORS

[email protected]

How are private front-ends built without APIs? (lemdro.id)

submitted 3 months ago by [email protected] to c/[email protected]

15 comments fedilink hide all child comments

I'm referring to projects like redlib or invidious.

I was thinking about doing something similar for a local second-hand marketplace and got curious. Redlib seems to use token spoofing to get past rate limits and Invidious doesn't even use the official YouTube API.

The only way I thought of, which would be slow, is to scrape the site (like you would with Beautiful Soup).

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 3 months ago

RedLib and Invidious hoster here;

I can confirm they do not use any backend API, however this means eventually they (YouTube and Reddit) kick on automatic rate limiting after a while and I have to switch up my vpn connection on my server. it's annoying, but it works if you know a thing or two about proxies and web scraping (the knowledge from scraping can be cross applied to implementing a suitable proxy config)

that said, RedLib's backend token spoofing works a lot better than the Invidious method (Invidious emulates web traffic via Android mobile devices and gets the videos from Google Videos directly, bypassing YouTube for the heavy lifting).