• @bitfucker@programming.dev
    link
    fedilink
    English
    65 months ago

    So, you know LLM has a context window right? That means context overflow is a valid LLM attack strategy if you are somehow able to send more stuff than what is allowed.

        • @ShakingMyHead
          link
          English
          95 months ago

          Probably would have been easier when the context window wasn’t 128k.

          Though what the point would be should someone actually achieve that eludes me a bit.

          • @bitfucker@programming.dev
            link
            fedilink
            English
            105 months ago

            I don’t know man. Maybe a chat bot for help center that forgot they shouldn’t give refund or non existent promotion?

          • @nfultz
            link
            English
            15 months ago

            I have LLMs translate novels, I can tell when they run over the window because they forget characters’ gender half way through, things like that. Lots of legal documents are even longer, maybe.