1202
Major IT outage affecting banks, airlines, media outlets across the world (www.abc.net.au)
submitted 2 years ago* (last edited 2 years ago) by to c/technology@lemmy.world
539 comments fedilink hide all child comments
 

All our servers and company laptops went down at pretty much the same time. Laptops have been bootlooping to blue screen of death. It's all very exciting, personally, as someone not responsible for fixing it.

Apparently caused by a bad CrowdStrike update.

Edit: now being told we (who almost all generally work from home) need to come into the office Monday as they can only apply the fix in-person. We'll see if that changes over the weekend...

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 2 years ago (1 child)

not that bad since I can just walk over and restart it.

You can try to use watchdog to automatically restart on crashes. Or go through RMA.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago (1 child)

    I could, but it's a pretty rare nuisance. I'd rather just replace the CPU than go through RMA, a newer gen CPU is quite inexpensive, I could probably get by with a <$100 CPU since anything AM4 should work (I have an X370 with support for 5XXX series CPUs).

    I'm personally looking at replacing it with a much lower power chip, like maybe something ARM. I just haven't found something that would fit well since I need 2-4 SATA (PCIe card could work), 16GB+ RAM, and a relatively strong CPU. I'm hopeful that with ARM Snapdragon chips making their way to laptops and RISC-V getting more available, I'll find something that'll fit that niche well. Otherwise, I'll just upgrade when my wife or I upgrade, which is what I usually do.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago* (1 child)

    I just haven't found something that would fit well since I need 2-4 SATA (PCIe card could work), 16GB+ RAM, and a relatively strong CPU.

    4 SATA, 8GB RAM is easy to find. What do you need 16 gigs for? Compiling Gentoo?

    Star64 for ARM and Quartz64 for RV.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago* (1 child)

    Running a few services:

    • NextCloud + Collabora (or maybe OnlyOffice, haven't decided)
    • Jellyfin - terabytes of data, need memory to avoid buffering
    • Linux package mirror - higher RAM when running updates
    • compile-farm for my personal Rust projects (e.g. CI/CD)
    • in the future, HomeAssistant and security camera streaming

    Star64 for ARM and Quartz64 for RV.

    You got those backwards.

    But yeah, I've had my eye on those, but I think 8GB will be a bit limiting, and the CPU in both the Star64 and Quartz64 may be a bit weak. I was about to buy one, then decided to upgrade my desktop PC to a SFF PC, which meant I had some decent hardware lying around. It's mostly up and running now (still working on Collabora/Only Office), so I'll be monitoring RAM usage to see if I really need 16GB or if I can get away with 8GB instead, but I have a feeling something like either of those two SBCs will be a bit limiting.

    I don't need all of those services, but I definitely want the first two, and they wouldn't need to be used at the same time (e.g. if I'm watching a movie, I'm probably not messing with big docs in NextCloud). The last one is very nice to have, but it could be a separate box (I'm gusesing Quartz64 would be plenty, though I may want to play with object detection).

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago (1 child)
    • Jellyfin - terabytes of data, need memory to avoid buffering

    At 8GB it won't matter going for 16. Even 4 is a lot. It's not like you watch same video many times.

    • Linux package mirror - higher RAM when running updates

    Wierd. Is it not rsync? I ran mirror for my local network on 1GB SBC.

    • compile-farm for my personal Rust projects (e.g. CI/CD)

    I was joking about compiling Gentoo. Might need that much RAM here.

    • in the future, HomeAssistant and security camera streaming

    So, powerful CPU or hardware encoder.

    Star64 for ARM and Quartz64 for RV.

    You got those backwards.

    My brain got SIGBUS.

    then decided to upgrade my desktop PC to a SFF PC, which meant I had some decent hardware lying around.

    Not bad decision. Why buy something new, when something old works too.

    but I have a feeling something like either of those two SBCs will be a bit limiting.

    Maybe. I wish I knew PC-style computers on ARM or RV with upgradable memory. Maybe something from SiFive? Dunno.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 2 years ago (1 child)

    I can probably run the CI/CD on my desktop, so if that's the only bottleneck, I can work around it. Or I can spin up a temporary VPS to handle it. I'll have a VPS always running to traffic over my VPN, so it could also manage orchestration (sounds like a fun project imo).

    Wierd

    It's just one more thing running. It's not a ton of resources, but it runs an HTTPS server and more RAM means faster updates. Since I run Tumbleweed, an update could be 1-2GB (everything gets rebuilt when a core dependency gets updated).

    I could probably run it on a Raspberry Pi (have one for RetroPie), so I'm not too worried about it.

    powerful CPU or hardware encoder

    I probably won't need that, I'd just store the video in whatever format the cameras send in. I do have a GPU on this PC (nothing special, just a GTX 750ti), but I think I could live without that if I moved to an SBC.

    The main thing I'm concerned about it Collabora/OnlyOffice, which is really RAM heavy. I'll probably only have 1-2 users at a time (me or my wife), and I just think 8GB will be a little lean.

    I was super close to getting a Quartz64, but realized upgrading the motherboard and case on my desktop would be about the same price (as Quartz64 + case + PCIe SATA card) and the Quartz64 only has 1x PCIe, so I went for the upgrade (had a Ryzen 1700 w/o motherboard and a couple cases just sitting around). I'd love to go ARM, and a 16GB RAM SBC would probably convince me to switch.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •