• DessertStorms
    link
    fedilink
    11
    edit-2
    7 months ago

    It doesn’t read on demand

    Yes, it does, from the information it was trained on (or - stored), which like you say, requires a lot of hardware power so it can be accessed on demand. It isn’t just manifesting the information out of thin air, and it definitely doesn’t “remember” in the same way we do (E: even the best photographic memory isn’t the same as an indexable one).

    • @abruptly8951@lemmy.world
      link
      fedilink
      English
      67 months ago

      It’s definitely not indexed, we use RAG architectures to add indexing to data stores that we want the model to have direct access to, the relevant information is injected directly in the context (prompt). This can somewhat be equated to short term memory

      The rest of the information is approximated in the weights of the neural network which gives the model general knowledge and intuition…akin to long term memory

      • @selfA
        link
        English
        157 months ago

        or it can be equated to a shitty database and lossy compression (with artifacts in the form of “hallucinations”), but that doesn’t make the tech sound particularly smart, does it?

        but half the posts in your history are in this thread and that’s too many already

        • @selfA
          link
          English
          137 months ago

          oh do fuck off

          • @froztbyte
            link
            English
            117 months ago

            awww, I just got another bowl of popcorn!

            but rofl holy shit at “glad to see someone else knows how they work” given the … depth of understanding, shall we say? that was demonstrated in this thread