Last year, the corporate-dominated web came alive, much thanks to the help of corporate-owned social media platforms - how long will it take until the open sections of the web do so?

And if that has been achieved: with stuff happening in the digital world that doesn’t in the real world, it could actually be worthwile for people to immerse further into the digital world, which up until now was always the problem behind the idea of the “Metaverse” (I’m not necessarily for this; its just something that came to my mind yesterday). Could that be the actual next iteration of the web and realize what was in the past considered the “smart” web or would it be a dystopia?

And one last question that came to my mind: would it be possible to make the LLMs somehow run independently (could the blockchain maybe be finally put to some use here?) and how would all of that be experienced like from the user perspective?

  • simple@lemm.ee
    link
    fedilink
    English
    arrow-up
    8
    ·
    2 years ago

    I’m not sure what you mean at all. Why would someone run an LLM on an instance? If you’re saying how long it’ll take for people to use the Fediverse for training data, it’s already happening. It’s no secret the web is being scraped entirely for training data.

    would it be possible to make the LLMs somehow run independently (could the blockchain maybe be finally put to some use here?)

    ???

    I think you’re confusing a lot of different topics together.

  • Poplar?@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    2 years ago

    Why would instances want to train an LLM on text users post? What does it mean for an LLM to be distributed?

    • blue_berry@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 years ago

      But wasn’t ChatGPT trained on huge amount of data from social media, Reddit etc.? With distributed I mean that if the server fails the LLM still stays alive, like this. So I thought about fail-safe. Maybe I didn’t thought it through enough …

      • sparse_neuron@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        2 years ago

        What do you mean by “stay alive”? LLMs are statistical models that require a lot of number crunching in order to output a response. That’s not something you can just host without some major costs associated (Far more than any single Fediverse instance for sure, GPUs are not cheap to rent).

  • TheOneCurly@lemmy.theonecurly.page
    link
    fedilink
    English
    arrow-up
    4
    ·
    2 years ago

    There’s no need to run an LLM on the same system it was trained on. Once the model is built it contains all the information already. If you want a model to live on long term you would just release the file(s) publicly, like hugging face does with theirs, then anyone could use it or host an interface for it.

  • Diabolo96@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 years ago

    I see many good uses of LLMs:

    • Auto generated Images descriptions.( untapped potential )
    • video summeriser
    • news summeriser ( already exists.Thanks to the dev(s) ! )
    • Automatic credibility check of news by searching other sources.
  • pizza_is_yum@slrpnk.net
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    2 years ago

    The real world is where things that matter happen. Life, love, nature. The Web is distracting and loud, but it’s a big, flimsy illusion. So I don’t think there is any chance that Metaverse ideas will take off.

    Regarding LLMs: good news! You can already run them at home. Check out KoboldAI. LLMs will become smaller as time goes on, too. There’s lots of room for improvement in that field.