• BillBurBaggins@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    40
    ·
    8 hours ago

    Pretty sure they thought of this. But maybe you are the first very smart person ever to think of it, who knows

    • Meron35@lemmy.world
      link
      fedilink
      English
      arrow-up
      27
      ·
      6 hours ago

      They have and they’ve explicitly said it’s not solved lmao

      A 1% attack success rate—while a significant improvement—still represents meaningful risk. No browser agent is immune to prompt injection, and we share these findings to demonstrate progress, not to claim the problem is solved

      Mitigating the risk of prompt injections in browser use \ Anthropic - https://www.anthropic.com/research/prompt-injection-defenses

      • BillBurBaggins@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        13
        ·
        6 hours ago

        I’ve used agents, they tell you everything they’re going to do. And they’re incredibly slow and stupid. I don’t think OPs original premise of it instantly and secretly stealing your bank account details is realistic.

        I don’t think I said prompt injection didn’t exist, just that it didn’t need to be worried about by users in exactly the way that was described

        • Pup Biru@aussie.zone
          link
          fedilink
          English
          arrow-up
          5
          ·
          edit-2
          5 hours ago

          and these browsers are specifically not that… these browsers are intended to do things like categorise tabs, complete forms, etc automatically without your interaction

          of course they’ll ask before they do things they consider destructive, but what they consider destructive and what a malicious actor can use are very different things

          some of that is certainly benign, but the point with prompt injection is that it can take benign things and make them plausibly malicious

    • KyuubiNoKitsune@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      28
      ·
      8 hours ago

      It doesn’t matter that they’ve thought of it.

      Dont worry guys, we’ve thought about viruses, and we’ve solved viruses now, no more work needs to be done. We’ll never have problems with virus again…

      • BillBurBaggins@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        31
        ·
        8 hours ago

        I haven’t actually worried about a virus on a computer for like 15 years. Never installed third party antivirus either.

        I think for all intents and purposes it is kind of a solved problem. You have to do something really stupid to get one, and worrying about a virus isn’t a reason that people would normally give to not use a technology either.

        • KyuubiNoKitsune@lemmy.blahaj.zone
          link
          fedilink
          English
          arrow-up
          17
          arrow-down
          4
          ·
          8 hours ago

          Damn, this is a fucking brain dead take. It doesn’t even warrant a proper response.

          Its “solved” because of decades of ongoing research and the fact that OS’s like Windows have an antivirus built in that regularly get updates.

          • pressanykeynow@lemmy.world
            link
            fedilink
            English
            arrow-up
            13
            ·
            7 hours ago

            There’s whole industry to solve this problem and yet there are many millions affected each year meaning it’s not even close to being solved. Maybe quite the other way around judging how companies like Google recently said it’s a big problem for them.

            The dude above says it themselves: you need to be smart to not fall for some malware(which they are wrong about, there many examples of smart people falling to phishing). Luckily LLMs are perfectly smart and never do stupid shit, right?

          • BillBurBaggins@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            15
            ·
            7 hours ago

            For users, yeah. I think you are mixing up things that developers have to worry about and things that users have to work about? Maybe some cognitive issues?