I woke up this morning to a text from my ISP, “There is an outage in your area, we are working to resolve the issue”

I laugh, this is what I live for! Almost all of my services are self hosted, I’m barely going to notice the difference!

Wrong.

When the internet went out, the power also went out for a few seconds. Four small computers host all of my services. Of those, one shutdown, and three rebooted. Of the three that ugly rebooted some services came back online, some didn’t.

30 minutes later, ISP sends out the text that service is back online.

2 hours later I’m still finding down services on my network.

Moral of the story: A UPS has moved to the top of the shopping list! Any suggestions??

  • JovialSodium@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    9 months ago

    My suggestion just changes your threat model, so may not be a good one based on your wants.

    Perhaps consolidate systems? Managing less devices = less points of failure. But adds the risk of any given failure being more severe.

    • Padook@feddit.nlOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      9 months ago

      This thought came to me this morning. I have 4 machines both because the BEAST grows organically, and because we’re always trying to avoid that single point of failure. Then a scenario comes along that makes you question your whole way of thinking, diversifying may actually create more problems