209
The surreal joy of having an overprovisioned homelab (2025) - from Anubis creator (xeiaso.net)
submitted 6 months ago* by to c/selfhosted@lemmy.world
39 comments fedilink hide all child comments
 

Video https://files.xeiaso.net/talks/2025/surreal-joy-homelab/index.m3u8

all 40 comments

sorted by: hot top controversial new old
[–] 59 points 6 months ago (28 children)

I am glad I bought 128gb of ram last year.

  • permalink
  • fedilink
  • source
  • hideshow 28 child comments
    •
  • [–] 27 points 6 months ago (8 children)

    I am angry at myself for delaying the purchases of a mini PC about 4 months ago /:

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 8 child comments
    •
  • [–] 23 points 6 months ago (6 children)

    If you buy now you can still brag about missing the next price increase when South Korea runs out of helium for chip production in 2 weeks.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 13 points 6 months ago (4 children)

    Gee I wonder who else has a lot of tappable helium- ah, right. russia.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 1 point 6 months ago (3 children)

    Russians aren't brown skinned people tho. We almost exclusively bomb brown skin people.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 16 points 6 months ago (2 children)

    We do, but what I mean is this is yet another way Russia will benefit from the pedo-war. Oil goes up, they become a critical supplier of helium, they'll make shitloads of billions to try and prop their own war machine back up. One big huge giant present to Putin, one dictator to another.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 6 months ago (1 child)

    to try and prop their own war machine back up.

    I don't honestly think that Russia couldn't already afford modern infrastructure and military, as much as I think the government crippled because it's basically run mafia style where everyone is skimming heavily. on the take. and money being funneled to already wealthy pockets. This sounds vaguely familiar. Even down to people 'falling' out of a window from great heights. I get what you are saying tho. Russia is rich in natural resources if they can figure out how to extract a lot of it from the frozen tundra.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 10 points 6 months ago

    https://en.wikipedia.org/wiki/National_Helium_Reserve

    The National Helium Reserve, also known as the Federal Helium Reserve, was a strategic reserve of the United States, which once held over 1 billion cubic meters (about 170,000,000 kg)[a] of helium gas.

    The Bureau of Land Management (BLM) transferred the reserve to the General Services Administration (GSA) as surplus property, but a 2022 auction[10] failed to finalize a sale.[11] On June 22, 2023, the GSA announced a new auction of the facilities and remaining helium.[12] The auction of the last helium assets was due to take place in November, 2023.[13] Though the last of the Cliffside reserve was to be sold by November 2023, more natural gas was discovered at the site than was previously known, and the Bureau of Land Management extended the auction to January 25, 2024 to allow for increased bids.[14] In 2024 the remaining reserve was sold to the highest bidder, Messer Group.[15]

    Arguably not the best timing on that.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 8 points 6 months ago (4 children)

    And here I thought $399 for a 4TB Samsung NVMe 990 Pro was a bit too expensive. Little did I know. I'm so glad my friend talked me into impulse purchasing it last year. What I'm more annoyed about is not picking up HDDs for my NAS last year, I refuse to pay NVMe prices for HDDs.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 4 points 6 months ago (2 children)

    Wouldn't it have been cheaper to buy a few smaller ones and a PCIe card?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 4 points 6 months ago (1 child)

    Then you’re losing pcie lanes, and you have to deal with split storage or software raid which doesn’t always work the best.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 6 months ago*

    Yup, and originally I was also aiming to put together a full SSD NAS, so I wanted to use multiple 4TB sticks for that since it was reasonably priced (at the time) for the amount of storage and speed. Alas, now I'm just waiting to see if it'll ever go back under $400, but I'm not holding my breath.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 6 months ago (8 children)

    Serious question, what does RAM help with in the context of self hosting? I recently bought 32G for my server, and it's DDR3 ecc so it's so cheap I could have afforded 64 but I just kept wondering what will I use it for? I rarely go north of 6G usage and that's with half a dozen services, a Minecraft server etc... I just don't know what kind of services are RAM hungry.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 8 child comments
    •
  • [–] 5 points 6 months ago (2 children)

    VMs mostly. What are you hosting on Minecraft that isn’t using >=4 gigs?

    Also ZFS.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 6 months ago (1 child)

    VMs mostly

    oh yeah i see how that can be hungry

    What are you hosting on Minecraft that isn’t using >=4 gigs?

    Just a vanilla server i play on with my son, it's got 2G and i haven't noticed anything out of the ordinary. Chunk gen is slow-ish but i suppose that's CPU-bound.

    BTW i exagerated in my initial comment, i looked at the machine and it's sitting just under 8G of used RAM.

    Also ZFS

    Jesus christ 😅 no idea if you're jesting

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 3 points 6 months ago (2 children)

    My use case might not be very relatable, but I run a bunch of stuff cached in ramdisk.

    One example is if my jellyfin server has to transcode something, I have it use ramdisk instead of my SSD for the transcoding cache.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 6 months ago (1 child)

    I see, that's interesting. I do a lot of transcoding but offline so i don't have usage for such a cache. I've tested various storage solutions but on my setup, transcoding is always CPU-bound, even on old ass HDDs the bottleneck is never I/O.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 6 months ago

    I do reencode bluray remuxes too, and also then use ramdisk for it.

    I've just, always had enough ram to do it so I've stuck with it. And the ram is probably gonna take the wear better than SSDs do.

    I also use it for download cache for some things, smaller things like music and books/manga.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 6 months ago (1 child)

    Probably not a lot.

    My system idles at 3gb.

    But then I do AI stuff and it needs 15-80gb. And I do data analyses that can use a lot.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 6 months ago

    Yeah i specifically don't do any AI workloads on my server, that would be stupid slow with my old ass hardware. But my buddy (who's a bit impulsive with money) bought two Spark GX10s and we're likely to get some fun out of them :)

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 6 months ago* (last edited 6 months ago) (2 children)

    I bought 3 kits of ddr5 last January before i realized the approved vendor list actually mattered for this mobo (I've never had this happen before). I was too lazy to return them at the time because you can never have too much memory laying around.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 6 months ago (1 child)

    I have to ask… are you sure it matters? Last time I had this happen the mobo was trying to use extremely incorrect settings by default and causing the ram to be extremely unstable. I had to enable xmp and manually put in the correct settings.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
    • [–] 28 points 6 months ago

    Remember that if you get an idea, fuck around, find out, and write down what you’ve learned: you’ve literally just done science. Well, with computers, so it’d be computer science, but you get my point.

    Honestly it’s never been easier to start doing things, and doing things is very fun. Good advice!

    Also, how is the author using 1password for credentials on server? They have service accounts now, but is there a better way than just always providing a credential when asked?

  • permalink
  • fedilink
  • source
    •
    [–] 18 points 6 months ago* (last edited 6 months ago) (2 children)

    What makes this worse is that git servers are the most pathologically vulnerable to the onslaught of doom from modern internet scrapers because remember, they click on every link on every page.

    The especially disappointing thing is that, for the specific case that Xe was running into, a better-written scraper could just recognize that this is a public git repository and just git clone the thing and get all the useful code without the overhead. Like, it's not even "this scraper is scraping data that I don't want it to have", but "this scraper is too dumb to just scrape the thing efficiently and is blowing both the scraper's resources and the server's resources downloading innumerable redundant copies of the data".

    It's probably just as well, since the protection is relevant for other websites, and he probably wouldn't have done it if he hadn't been getting his git repo hammered, but...

    EDIT: Plus, I bet that the scraper was requesting a ton of files at once from the server, since he said that it was unusable. Like, you have a zillion servers to parallelize requests over. You could write a scraper that requested one file at once per server, which is common courtesy, and you're still going to be bandwidth constrained if you're schlorping up the whole Internet. Xe probably wouldn't have even noticed.

  • permalink
  • fedilink
  • source
  • hideshow 2 child comments
    •
  • [–] 18 points 6 months ago (1 child)

    Sorta like how people complain about bots scraping Lemmy, even though federation already exists as a standardized protocol for distributing data. Like any scraper who wanted to efficiently scrape Lemmy would just spin up their own instance and let federation do the scraping for them. It would even have the added benefit that they could set their server to ignore delete requests, so deleted posts/comments wouldn’t get automatically removed from their server. And then they could scrape as much as they wanted without impacting anyone else.

    But they don’t want to do that, because it would require the smallest modicum of forethought. They don’t care that scrapers are trashing the Internet and causing massive bandwidth issues for hosters. They just want the data, and they want it now. All of those “bots are flooding my server and eating all my bandwidth, so legitimate users can’t actually access the site” complaints are for other people.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 6 months ago*

    I bet that if someone went to The Internet Archive, they could pay them to get timestamped snapshots of professionally-spidered stuff at zero load to the websites. I'm sure that it'd cost something for all the hard drives and probably something for labor, but so does spidering the whole Internet yourself. The people running the bots clearly have the funds available to run them at massive scale.

  • permalink
  • fedilink
  • source
  • parent
    • [–] 11 points 6 months ago

    looks at slides

    I see where the anime catgirl logo that Anubis uses came from.

  • permalink
  • fedilink
  • source
    •
    [–] 5 points 6 months ago (1 child)

    I'm sorry, but this was too difficult to read, the author is kinda cringe.

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •
    • [–] 5 points 6 months ago (1 child)

    Xe Iaso my beloved

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •
    • [–] [B] 5 points 6 months ago* (last edited 6 months ago)

    Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I've seen in this thread:

    Fewer Letters More Letters
    Git Popular version control system, primarily for code
    NAS Network-Attached Storage
    NVMe Non-Volatile Memory Express interface for mass storage
    PCIe Peripheral Component Interconnect Express
    SSD Solid State Drive mass storage
    ZFS Solaris/Linux filesystem focusing on data integrity

    [Thread #163 for this comm, first seen 14th Mar 2026, 04:40] [FAQ] [Full list] [Contact] [Source code]

  • permalink
  • fedilink
  • source
    •
    [+] 1 point 6 months ago
    [deleted]
  • permalink
  • fedilink
  • source
    •