Linode Security Incident

(status.linode.com)

138 points | by lacoolj 3 hours ago

12 comments

  • 6thbit 2 hours ago
    It feels like we hit an inflection point in the last week or so. Kind of a large tidal wave to crash on the coast, but likely not the tsunami yet. I hope.

    If you are running services and don't yet have an easy way to react to these things with swift process defined, I hope you don't like to sleep.

    • FuckButtons 1 hour ago
      When mythos was released - I guesstimated that we had 6 months until hackers had similar enough capabilities that we would start to see real problems in the wild. Unless there is some change in the trend line things are about to get really quite spectacular.
    • lifeisloving 2 hours ago
      Its really not that hard to secure your servers, especially if your not a high value target. If you are a high value target, you should have security professionals on staff.

      I dont think my security posture is all that much different than it was last year. Use a Secret Manager and or encryption, have backups, strong firewall rules, use canaries of some kind.

      If anything llms are making security worse because there's more people offloading their thinking on llms, or people that skipped some steps in their learning journey because they just ask the llm to do everything. I dont think its necessarily because attackers have llms now, but that contributes.

      Edit:

      Damn Im getting mega downvoted for saying this. So are people of just at a consensus that there's nothing you can do? That we're in security armagedon???

      Have you ever thought to consider that security took hit along with the general degradation of software because of AI??

      • moscoe 1 hour ago
        You are literally the everything is fine meme. I admire your confidence. I never realized it was so simple!
      • mort96 13 minutes ago
        Can you tell me what I should be doing differently then? I just host some services, among them Nextcloud that's written in PHP, protected by SSL, on a server running Linux. And I feel like the past week has been a lots
      • UqWBcuFx6NV4r 43 minutes ago
        Is this like when people say “it’s not that hard to write memory-safe C”, and then nobody does? I take this as actually meaning: “I feel that I can keep my shit locked down.”. Whether or not that’s true, which i’m skeptical of, plenty of OTHER people can’t, or won’t, or whatever. That’s the reality.

        To speak to your edit: this is false equivalency. You can still decrease the odds of being hit. There are still better and worse ways to address security.

      • bvcp 33 minutes ago
        if anything we should be using ai to find this stuff before the bad actors, too bad the model providers are hell bent on regulatory capture via fear
      • sanex 1 hour ago
        I agree but disagree about the cause. People have always been bad at security and code in general.
      • LaurensBER 1 hour ago
        [dead]
  • spydum 2 hours ago
    Wow, that isn't clear. Is there an incident, or did they just become aware about MPTCP vuln? Details on the mptcp are also pretty scarce as well right?
    • 6thbit 2 hours ago
      Yeah its unclear. Sounds like they are just now patching it and treating it as an incident which is probably the right thing to do.
      • onei 2 hours ago
        (Former akamai employee) Akamai have an incident process that handles both "things are bad for multiple customers" as well as "we need eyes on this from multiple departments/stakeholders asap". If you're hitting a wall debugging an issue on your own, especially if it's not overtly customer impacting, declaring an incident is an effective way of getting the attention needed to solve it.

        Once you declare the incident, the process includes these status page updates, alongside equivalent internal status updates.

        In this case, they probably wanted to maximise coordination, so used the process designed for that.

        • CoastalCoder 1 hour ago
          Also a former Akamai employee.

          I left because I didn't like the pressure / pager duty, but I seriously respect how smooth and well thought out their operations were.

    • tbrownaw 43 minutes ago
      I haven't seen any emails about it, so I'd lean towards it being something that doesn't rate sending emails.
    • dofm 2 hours ago
      I am wondering if there is something significant written with Go in their system stack (Go uses MPTCP by default on listening sockets, it seems)
    • lacoolj 2 hours ago
      Yeah agreed. I actually only noticed because my two boxes are super slow and I've been troubleshooting for about an hour. Finally opened up the Customer Support page and this was the top incident.
  • paaloeye 2 hours ago
    Even better CVE 10.0 has just dropped https://news.ycombinator.com/item?id=50310937
    • INTPenis 2 hours ago
      Who uses Canonical LXD?

      I never even heard of it.

      • paaloeye 1 hour ago
        MicroCloud for example, it's been actively pitched for smaller sites by Canonical
      • paaloeye 2 hours ago
        MicroCloud and some other product for sure
  • nout 2 hours ago
    All companies should at this point invest a lot of money into defensive AI. In ~July the AI hit crypto and bitcoin, where it's the easiest to extract the most money. Now the AI powered attacks are hitting infra and SaaS. Next (~December), it will hit classic infrastructure, banks, small businesses, etc. By mid next year, we will be over this hump with defensive AI being required part of everything.
    • jeremyjh 2 hours ago
      Its already happening to classic infrastructure, small and medium size businesses. Absolutely anyone can summon a gremlin capable of exploiting stuff like this or the PHP thing last week. There are clankers probing this stuff all over the place within a day of it going public.
    • throwuxiytayq 2 hours ago
      I find it breathlessly funny how people think it's going to be AIs vs AIs fighting it out with light sabers and plasma lasers in the cyber space or some shit.

      Your intuition that this can be balanced out is wrong. When you have a CVE in your TCP stack, your vault unlocks and you're fucked, it's done. My dude, there is never going to be AIs scanning every incoming packet for signs of a 0day, and deciding whether to, uhh, cut it up with a lightsaber and shoot it with a laser pistol. Your options are to have a stack so secure that it can't be targeted, or to disconnect all network cables.

      • ForHackernews 1 hour ago
        I assume that "defensive AI" means finding and patching vulnerabilities before attackers do, not some kind of live LLM packet-inspection.

        It is possible to write more secure software[0], companies just choose not to prioritize security.

        [0] https://cr.yp.to/qmail/qmailsec-20071101.pdf

      • dist-epoch 1 hour ago
        AI's can decide on the action to open the vault file. It can also prevent TCP connections from unexpected IPs.
  • Arbortheus 2 hours ago
    This reads to me that nothing has happened and they are just trying to patch stuff? Right?
  • elashri 2 hours ago
    @dang I would encourage you to really think about having security incident as a new HN tag. The wording can be better though.
    • downrightmike 2 hours ago
      We can call it [SI]
      • entrope 2 hours ago
        As long as we know that doesn't mean Systeme Internationale, Sports Illustrated or Super Intelligence.
        • gk1 2 hours ago
          > Super Intelligence

          I think that was the joke.

  • dist-epoch 1 hour ago
    I've lived to see the day when half of the Hacker News front page is about hacks. What a time to be alive.
  • ForHackernews 1 hour ago
    What's the mitigation for this? There's no patches available yet https://ubuntu.com/security/CVE-2026-98432
    • markasoftware 1 hour ago
      Mitigation is to retire and wait for the singularity.

      Don't use MPTCP is the first mitigation, but my understanding is this might be exploitable without MPTCP.

      • bombcar 1 hour ago
        Filtering packets with ip-options set may also help, but it seems Akami is already doing that at the edge.
    • netrem 1 hour ago
      Debian does have a patch up
  • optimalsolver 2 hours ago
    I mean, this situation is untenable. HN's front page is just going to be an endless list of breaches.

    I don't see how web services proceed like business is normal.

    • peri-cl 2 hours ago
      Introducing: HNN (Hacker non-news): a list of web domains *not* currently under apocalyptic AI attack. Shorter and more parsimonious.

      - Tell HNN: pets.com was *not* owned today

      - Tell HNN: about:blank was safe, too

      - Show HNN: my new gopher protocol project—no currently known CVE 10's

      • mceachen 2 hours ago
        gopher goes to 11

        (archie and veronica are non-denumerable)

    • LtWorf 2 hours ago
      Better than the usual endless stream of what your agent did today.
  • rvz 2 hours ago
    So it begins. The war against the abliterated AI models. Even at 1,000 TPS any service is a target.

    Imagine swarms of abliterated frontier AI models that reach >20,000 TPS. As I said before [0] you are going to have to hire specialized security engineers or technical bodyguards from the senior to senior staff level using AI agents to protect your entire business.

    Otherwise you are cooked.

    [0] https://news.ycombinator.com/item?id=50310312

    • jacquesm 2 hours ago
      Guess who has access to abliterated frontier AI models?
    • lacoolj 2 hours ago
      Primeagen went over this in the last episode or two - apparently this sort of defense is costing ... one of the big models or companies hosting them ... $900k/day or something to constantly run the best model and monitor 24/7 to combat the attacks [0]

      [0] https://www.youtube.com/watch?v=9OahTki4cPA

      • vsgherzi 2 hours ago
        I don’t really have experience running anything like this so this is very much a comment front the peanut gallery but

        Is that really the best way to do things? I’m not really sure what an agent offers here does it just look at logs and do actions? I would not really feel safe if that’s my service’s answer to security.

        I could see it maybe as a really smart filter to block ips that are sending probing requests but I don’t really see that as a good reason to have an agent be sitting 24/7 looking at logs.

      • GoblinSlayer 1 hour ago
        I think, it's about reviewing code for bugs.
    • shoobiedoo 2 hours ago
      What's the future of cybersecurity going to look like? A rapid shift to shoving everything into microvm's to minimize attack surface?
      • chr-s 1 hour ago
        "You got it. Corporate core data for Tessier-Ashpool S.A., and that ice is generated by their two friendly AI's. On par with anything in the military sector, looks to me. That's king hell ice, Case, black as the grave and slick as glass. Fry your brain soon as look at you. We get any closer now, it'll have tracers up our ass and out both ears, be tellin' the boys in the T-A boardroom the size of your shoes and how long your dick is."
        • ifwinterco 1 hour ago
          Best science fiction book ever written IMO
          • mondrian 58 minutes ago
            I recommend Gibson’s (abridged) reading of the book - but only after reading the book. Whenever I read a quote from the book now I hear it in Gibson’s iconic voice.
      • lelandfe 2 hours ago
        Airgapping.

        I'm hoping goverments take stock of what is online that needn't be.

      • Arbortheus 2 hours ago
        OpenClaw agents continuously scanning your prod infrastructure and applying config tweaks and package updates autonomously on the fly in response to viral CVE numbers trending on X.
        • alasdair_ 23 minutes ago
          The agent sounds like the perfect attack target - it has rights to upload arbitrary code everywhere without setting off alarms.
      • GoblinSlayer 1 hour ago
        Pluggable network stack.
    • samwilliams 2 hours ago
      Infrastructure is an FPS now.
    • 14u2c 2 hours ago
      More likely we'll just see another shakeup of the layers of abstraction that the average company operates at. Why would you hire specialized people when AWS can do so for you?
    • GoblinSlayer 1 hour ago
      As I understand, it's LPE. Cloud hosting was always tough.
    • xlayn 1 hour ago
      You are being downvoted but I agree, any company including openAI, anthropic, google etc... should be closely regulated by goverment to ensure they never run any AI that doesn't follow all the rules defined by governing bodies, nor train them to have any workaround... NO ONE HAS ABLITERATED ACCESS TO ANYTHING.

      Thanks god, you are not a wacko thinking qwen3.0-1.5B-abliterated would hack a goverment.

    • scottrogers86 2 hours ago
      armadin.com?
  • pugworthy 2 hours ago
    Lately it seems like we need "hacks.ycombinator.com" as a new sub-list.
    • keeganpoppen 2 hours ago
      ironic that "hacks" is a needed subdomain of "hacker news"
      • optimalsolver 2 hours ago
        Yeah it is, but everyone forgets this board was launched in the 90s for discussion of the 1995 movie "Hackers", not for discussion of hacking in general.
        • brian-armstrong 2 hours ago
          I'm still holding out for the sequel
          • optimalsolver 2 hours ago
            It would now be 120 minutes of some guy playing EVE or browsing porn while his agent does everything.
    • 6thbit 2 hours ago
      /incidents would do
    • sublinear 2 hours ago
      We need an "ai.ycombinator.com" too.
    • georgemcbay 2 hours ago
      daily sticky post...

      Ask HN: Who didn't get hacked today.

    • minimaxir 2 hours ago
      Show Hacks: