• David Gerard
    shield
    OPMA
    link
    English
    233 months ago

    how the hell did this of all the posts turn into a promptfondler shooting gallery

  • @swlabr
    link
    English
    873 months ago

    LLMs, and everyone who uses them to process information:

  • @hex@programming.dev
    link
    fedilink
    English
    633 months ago

    Facts are not a data type for LLMs

    I kind of like this because it highlights the way LLMs operate kind of blind and drunk, they’re just really good at predicting the next word.

    • @CleoTheWizard@lemmy.world
      link
      fedilink
      English
      283 months ago

      They’re not good at predicting the next word, they’re good at predicting the next common word while excluding most unique choices.

      What results is essentially if you made a Venn diagram of human language and only ever used the center of it.

      • @hex@programming.dev
        link
        fedilink
        English
        153 months ago

        Yes, thanks for clarifying what I meant! AI will never create anything unique unless prompted uniquely and even then it will tend to revert back to what you expect most.

  • @swlabr
    link
    English
    483 months ago

    ATTN: If you’re coming into this thread to say, “The output of AI is bad because your prompts suck,” I’m just proud that you managed to figure out how to use the internet at all. Good job, you!

    • @froztbyte
      link
      English
      153 months ago

      remember remember, eternal september

      (not that I much agree with the classist overtones of the original, but fuck me does it come to mind often)

  • Sibbo
    link
    fedilink
    English
    313 months ago

    Well, to be fair, AI can do it in seconds. Which beats humans.

    But if that is relevant if the results are worthless is another question.

    • HubertManne
      link
      fedilink
      123 months ago

      Yeah it changes the task from note taking or summarizing to proofreading.

      • @YourNetworkIsHaunted
        link
        English
        53 months ago

        And proofreading is notably more complex and has a worse failure state than just writing your own summary.

        • HubertManne
          link
          fedilink
          -43 months ago

          Thing is you can do in real time and not pay as much attention to the goings on as you write or do it in the end and forget stuff. there is no harm in the ai summariziation. you could instead write a summary and check if you left anything out via the ai.

          • @selfA
            link
            English
            43 months ago

            that’s great thanks

  • kbal
    link
    fedilink
    223 months ago

    Made strange choices about what to highlight.

    They certainly do. For a while it was common to see AI-generated summaries under links to articles on lemmy, so I got a feel for them. Seems to me you would not need any fancy artificial intelligence to do equally well: Just take random excerpts, or maybe just read every third sentence.

  • David GerardOPMA
    link
    English
    203 months ago

    i have seen the light from the helpful posters here, made up bullshit alleged summaries of documents are great actually

  • @GBU_28@lemm.ee
    link
    fedilink
    English
    153 months ago

    Dang everyone here needs to look at a tree or a cat or something. Energy is wack in here

    • David GerardOPMA
      link
      English
      293 months ago

      I just went outside and appreciated the rendering

        • @froztbyte
          link
          English
          83 months ago

          DANGER WILL ROBINSON, godposting detected

            • David GerardOPMA
              link
              English
              83 months ago

              if people don’t appreciate the kitties their tamagotchi is in some fucking trouble

    • @V0ldek
      link
      English
      93 months ago

      While reading this entire stuff I periodically looked at my cat and let out a sigh, and he just looks at me with that knowing gaze

      “Ye, you are all dumb, hoomans. Don’t think about it. Pet me now.”

  • @khalid_salad
    link
    English
    113 months ago

    Could it be because a statistical relation isn’t the same as a semantic one? No, I must be prompting it wrong. I’ll just add “engineer” to my title and then everyone will take me seriously.

  • @RagnarokOnline@programming.dev
    link
    fedilink
    English
    93 months ago

    I had GPT 3.5 break down 6x 45-minute verbatim interviews into bulleted summaries and it did great. I even asked it to anonymize people’s names and it did that too. I did re-read the summaries to make sure no duplicate info or hallucinations existed and it only needed a couple of corrections.

    Beats manually summarizing that info myself.

    Maybe their prompt sucks?

    • @froztbyte
      link
      English
      413 months ago

      “Are you sure you’re holding it correctly?”

      christ, every damn time

        • David GerardOPMA
          link
          English
          163 months ago

          we find they tend to post here, though not for long

          • @froztbyte
            link
            English
            123 months ago

            it makes me feel fucking ancient to find that this dipshit didn’t seem to get the remark, and it wasn’t even that long ago

            • @istewart
              link
              English
              143 months ago

              Jobs is Tech Jesus, but Antennagate is only recorded in one of the apocryphal books

        • Steve
          link
          English
          163 months ago

          “tools” doesn’t mean “good”

          good tools are designed well enough so it’s clear how they are used, held, or what-fucking-ever.

          fuck these simpleton takes are a pain in the arse. They’re always pushed by these idiots that have based their whole world view on fortune cookie aphorisms

        • @V0ldek
          link
          English
          83 months ago

          Said like a person who wouldn’t be able to correctly hold a hammer on first try

    • David GerardOPMA
      link
      English
      293 months ago

      I got AcausalRobotGPT to summarise your post and it said “I’m not saying it’s always programming.dev, but”

    • @TexasDrunk@lemmy.world
      link
      fedilink
      English
      -83 months ago

      I also use it for that pretty often. I always double check and usually it’s pretty good. Once in a great while it turns the summary into a complete shitshow but I always catch it on a reread, ask a second time, and it fixes things up. My biggest problem is that I’m dragged into too many useless meetings every week and this saves a ton of time over rereading entire transcripts and doing a poor job of summarizing because I have real work to get back to.

      I also use it as a rubber duck. It works pretty well if you tell it what it’s doing and tell it to ask questions.

      • @YourNetworkIsHaunted
        link
        English
        93 months ago

        Isn’t the whole point of rubber duck debugging that the method works when talking to a literal rubber duck?

        • @selfA
          link
          English
          83 months ago

          what if your rubber duck released just an entire fuckton of CO2 into the environment constantly, even when you weren’t talking to it? surely that means it’s better

  • beefbot
    link
    fedilink
    English
    43 months ago

    Is it only me, or is the linked article not super long on details & is reaching a conclusion from 2 examples? This is important & I need to hear more, & I’m generally biased against AI at this point— but the article isn’t doing enough to convince me

    • @selfA
      link
      English
      143 months ago

      did you click through to any of the inline citations? David’s shorter articles on pivot mostly gather and summarize those, so if you need to read the original research and its conclusions that’s where to go

      • beefbot
        link
        fedilink
        English
        113 months ago

        Ah, that’s better, yes. Thank you , no sarcasm :) now sleepy brain is more informed

  • Lvxferre
    link
    fedilink
    English
    -2
    edit-2
    3 months ago

    You could use them to know what the text is about, and if it’s worth your reading time. In this situation, it’s fine if the AI makes shit up, as you aren’t reading its output for the information itself anyway; and the distinction between summary and shortened version becomes moot.

    However, here’s the catch. If the text is long enough to warrant the question “should I spend my time reading this?”, it should contain an introduction for that very purpose. In other words if the text is well-written you don’t need this sort of “Gemini/ChatGPT, tell me what this text is about” on first place.

    EDIT: I’m not addressing documents in this. My bad, I know. [In my defence I’m reading shit in a screen the size of an ant.]

    • queermunist she/her
      link
      fedilink
      English
      21
      edit-2
      3 months ago

      ChatGPT gives you a bad summary full of hallucinations and, as a result, you choose not to read the text based on that summary.

      • Lvxferre
        link
        fedilink
        English
        -53 months ago

        (For clarity I’ll re-emphasise that my top comment is the result of misreading the word “documents” out, so I’m speaking on general grounds about AI “summaries”, not just about AI “summaries” of documents.)

        The key here is that the LLM is likely to hallucinate the claims of the text being shortened, but not the topic. So provided that you care about the later but not the former, in order to decide if you’re going to read the whole thing, it’s good enough.

        And that is useful in a few situations. For example, if you have a metaphorical pile of a hundred or so scientific papers, and you only need the ones about a specific topic (like “Indo-European urheimat” or “Argiope spiders” or “banana bonds”).

        That backtracks to the OP. The issue with using AI summaries for documents is that you typically know the topic at hand, and you want the content instead. That’s bad because then the hallucinations won’t be “harmless”.

        • queermunist she/her
          link
          fedilink
          English
          143 months ago

          But the claims of the text are often why you read it in the first place! If you have a hundred scientific papers you’re going to read the ones that make claims either supporting or contradicting your research.

          You might as well just skim the titles and guess.

          • Lvxferre
            link
            fedilink
            English
            -83 months ago

            But the claims of the text are often why you read it in the first place!

            By “not caring about the former” [claims], I mean in the LLM output, because you know that the LLM will fuck them up. But it’ll still somewhat accurately represent the topic of the text, and you can use this to your advantage.

            You might as well just skim the titles and guess.

            Nirvana fallacy.

            • @selfA
              link
              English
              173 months ago

              not reading the fucking sidebar and thinking this is high school debate club fallacy

              • Lvxferre
                link
                fedilink
                English
                -83 months ago

                not reading the fucking sidebar

                Yeah, I get that this is a place to vent. And I get why to vent about this. LLMs and other A"I" systems (with quotation marks because this shite is not intelligent!) are being shoved down every bloody where, regardless of actual usefulness, safety, or user desire. Telling you to put glue on your pizza, to eat poisonous mushrooms, that “cherish” has five letters, that Latin had no [w], that the Chinese are inferior to Westerners.

                While a crowd of irrationals tell you “it is intelligent, you can’t prove otherwise! CHRUST IT YOU DIRTY SCEPTIC/INFIDEL/LUDDITE REEEE! LALALA I’M PRETENDING TO NOT SEE THE HALLUCINATION LALALA”.

                I also get the privacy nightmare that this shit is. And the whole deal behind “we’re using your content as training data, and then selling the result back to you”. Or that it’s eating electricity like there’s no tomorrow, in a planet where global warming is a present issue.

                I get it. I get it all. That’s why I’m here. And if you (or anyone else) think that I’m here for any other reason, by all means, check my profile - you’ll find plenty pieces of criticism against those stupid corporate AI takes from vulture capital. (And plenty instances of me calling HN “Redditors LARPing as Hax0rz”. )

                However. Pretending that there’s no use case ever for LLMs is the wrong way to go.

                and thinking this is high school debate club fallacy

                If calling it “nirvana fallacy” rubs you the wrong way, here’s an alternative: “this argument is fucking stupid, in a very specific way: it pretends that either something is perfect or it’s useless, with no middle ground.”

                The other user however does not deserve the unnecessary abrasiveness so I’ll keep simply calling it “nirvana fallacy”.

                • @selfA
                  link
                  English
                  103 months ago

                  holy shit, imagine getting a second chance to not be a fucking debatelord and doubling down this hard

                  off you fuck

                • @froztbyte
                  link
                  English
                  7
                  edit-2
                  3 months ago

                  this argument

                  I agree, you’re quite right, and I thank you for taking the time and putting in the effort on such a wonderfully thorough portrayal of why your argument is total horseshit

            • queermunist she/her
              link
              fedilink
              English
              133 months ago

              Unless it doesn’t accurately represent the topic, which happens, and then a researcher chooses not to read the text based on the chatbot’s summary.

              Nirvana fallacy.

              All these chatbots do is guess. I’m just saying a researcher might as well cut out the hallucinating middleman.

    • David GerardOPMA
      link
      English
      203 months ago

      Both the use cases here are goverment documents. I’m baffled at the idea of it being “fine if the AI makes shit up”.

      • Lvxferre
        link
        fedilink
        English
        23 months ago

        No, it’s just rambling. My bad.

        I focused too much on using AI to summarise and ended not talking about it summarising documents, even if the text is about the later.

        And… well, the later is such a dumb idea that I don’t feel like telling people “the text is right, don’t do that”, it’s obvious.

        • David GerardOPMA
          link
          English
          93 months ago

          You’d think so, but guess what precise use case LLMs are being pushed hard for.

    • @V0ldek
      link
      English
      63 months ago

      if the text is well-written you don’t need this sort of “Gemini/ChatGPT, tell me what this text is about” on first place.

      And if it’s badly written then the LLM will shit itself.

      Now let’s ask ourselves how much of the text in the world is “well-written”?

      Or even better, you could apply this to Copilot. How much code in the world is good code? The answer is fucking none, mate.

  • @z00s@lemmy.world
    link
    fedilink
    English
    -6
    edit-2
    3 months ago

    The problem is not the LLMs, but what people are trying to do with them.

    They are currently spoons, but people are desperately wishing they were katanas.

    They work really well for soup, but they can’t cut steak. But they’re being hyped as super ninja steak knives, and people are getting pissed when they can’t cut steak.

    If you give them watery, soupy tasks they can do successfully, they can lighten your workload, as long as you’re aware of what they are and aren’t good at.

    What people want LLMs to be able to do, ie. “Steak” tasks:

    • write complex documents

    • apply complex knowledge/rules to a situation

    • Write complex code and create entire programs based on vague description

    What LLMs can currently do ie. “Soup” tasks:

    • check this document and fix all spelling, punctuation and grammatical errors

    • summarise this paragraph as dot points

    • write a python program that sorts my photographs into folders based on the year they were taken

    Half of Lemmy is hyping katanas, the other half is yelling “Why won’t my spoon cut this steak?!! AI is so dumb!!!”

    Update: wow, the pure vitriol pouring out of the replies is just stunning. Seems there are a lot of you out there who have, in one way or another, tied your ego very strongly to either the success or failure of AI.

    Take a step back, friends, and go outside for a while.

    • @V0ldek
      link
      English
      183 months ago

      What LLMs can currently do summarise this paragraph as dot points

      The entire point here is that they can’t?

      • @fuzzzerd@programming.dev
        link
        fedilink
        English
        -123 months ago

        Clearly this post is about LLMs not succeeding at this task, but anecdotally I’ve seen it work OK and also fail. Just like humans, which is the benchmark but they are faster.

        • @selfA
          link
          English
          73 months ago

          humans are clearly faster at generating utterly banal shit, as proven by your posts in this thread

    • @selfA
      link
      English
      153 months ago

      they don’t do any of that soup shit reliably either and reading the article might have told you that

        • @selfA
          link
          English
          83 months ago

          hahaha ok fuck off now

    • @blakestaceyA
      link
      English
      123 months ago

      I’d offer congratulations on obfuscating a bad claim with a poor analogy, but you didn’t even do that very well.

      • David GerardOPMA
        link
        English
        73 months ago

        more of a Trabant analogy than a Corvette analogy

    • @froztbyte
      link
      English
      103 months ago

      good god this entire post is the most tortured believer whataboutism I’ve encountered this month and there’s extremely strong competition here

      are currently spoons, but people are desperately wishing they were katanas

      ie. “Steak” tasks

      you should make a youtube channel, The Katana Steak-Eater. I’d watch the shit out of that at least one saturday afternoon

    • @istewart
      link
      English
      103 months ago

      Why did this immediately give me a flashback to Donald Trump yelling, “when it comes to great steaks, I’ve just raised the stakes!

    • @sc_griffith
      link
      English
      103 months ago

      “spoons and katanas” has got to be the most baby brained analogy. are you a child

        • @sc_griffith
          link
          English
          83 months ago

          I get that this is some sort of attempt at an election related Epic Comeback, but it doesn’t make sense

        • @froztbyte
          link
          English
          103 months ago

          you do realize steaks arriving purple or green are bad things, right

        • @swlabr
          link
          English
          93 months ago

          it is stupid and wrong, and i pity your inability to understand that fact

        • @sc_griffith
          link
          English
          93 months ago

          it doesn’t do either of those things

    • @FredFig
      link
      English
      9
      edit-2
      3 months ago

      Food analogy

      This level of discourse wouldn’t fly on 4chan, how is it so popular with LLM fans?

      • David GerardOPMA
        link
        English
        93 months ago

        needs to be a car analogy

        • What people want LLMs to do, i.e. Corvette tasks
        • What LLMs actually do, i.e. Trabant tasks
        • @selfA
          link
          English
          63 months ago

          What LLMs actually do, i.e. Trabant tasks

          more of a Power Wheels Barbie Jeep whose battery got left out in the sun too long, but I’ll allow it

      • @froztbyte
        link
        English
        53 months ago

        don’t diss the course, this steak’s great

    • @swlabr
      link
      English
      73 months ago

      Actually, LLMs are syringes filled with brain-parasite-infested poop

    • @selfA
      link
      English
      193 months ago

      your post history tells me you’re pretty fucking comfortable with pointless nonsense

  • @lightnsfw@reddthat.com
    link
    fedilink
    English
    -93 months ago

    Ok? I don’t have another human available to skim a shitload of documents for me to find answers I need and I don’t have time to do ot myself. AI is my best option.

    • @s3p5r@lemm.ee
      link
      fedilink
      English
      303 months ago

      So long as you don’t care about whether they’re the right or relevant answers, you do you, I guess. Did you use AI to read the linked post too?

      • @jaemo@sh.itjust.works
        link
        fedilink
        English
        -83 months ago

        Yep. Go ahead and ignore all the cases where it’s getting answers correct and actually helping. We’re all just hallucinating, it’s in no way my lived experience. Your reality is the prime reality and we’re the NPC’s.

        • David GerardOPMA
          link
          English
          193 months ago

          sir has failed to achieve the reading comprehension level for this sub

        • @V0ldek
          link
          English
          12
          edit-2
          3 months ago

          Go ahead and ignore all the cases where it’s getting answers correct

          • Sir, half of the patients are dead!
          • Ye sure, just ignore the half that survived then!
          • @YourNetworkIsHaunted
            link
            English
            52 months ago

            Only it’s even worse because without redoing all the work yourself you can’t even tell which ones are dead or alive.

      • @lightnsfw@reddthat.com
        link
        fedilink
        English
        -143 months ago

        I didn’t read the post at all because its premise is irrelevant to my situation. If I had another human to read documentation for me I would do that. I don’t so the next best thing is AI. I have to double check its findings but it gets me 95% of the way there and saves hours of work. It’s a useful tool.

        • @ebu
          link
          English
          283 months ago

          I didn’t read the post at all

          rather refreshing to have someone come out and just say it. thank you for the chuckle

          • @selfA
            link
            English
            193 months ago

            we really do need “my source is that I made it the fuck up” for people who aggressively don’t want to read any of the text they’re allegedly commenting on

        • David GerardOPMA
          link
          English
          253 months ago

          everyone, we have a new worst poster

        • @sc_griffith
          link
          English
          223 months ago

          absolutely superb posting, thank you

        • @V0ldek
          link
          English
          113 months ago

          This is hall of fame shit right here, someone should study the way you use the internet sir