Google apologizes for “missing the mark” after Gemini generated racially diverse Nazis
www.theverge.com
It acknowledged ‘inaccuracies’ in historical prompts.

Google apologizes for ‘missing the mark’ after Gemini generated racially diverse Nazis::Google says it’s aware of historically inaccurate results for its Gemini AI image generator, following criticism that it depicted historically white groups as people of color.

  • RGB3x3@lemmy.worldEnglish
    55·
    3 years ago

    A Washington Post investigation last year found that prompts like “a productive person” resulted in pictures of entirely white and almost entirely male figures, while a prompt for “a person at social services” uniformly produced what looked like people of color. It’s a continuation of trends that have appeared in search engines and other software systems.

    This is honestly fascinating. It’s putting human biases on full display at a grand scale. It would be near-impossible to quantify racial biases across the internet with so much data to parse. But these LLMs ingest so much of it and simplify the data all down into simple sentences and images that it becomes very clear how common the unspoken biases we have are.

    There’s a lot of learning to be done here and it would be sad to miss that opportunity.

    • Buttons@programming.devEnglish
      8·
      3 years ago

      It’s putting human biases on full display at a grand scale.

      The skin color of people in images doesn’t matter that much.

      The problem is these AI systems have more subtle biases, ones that aren’t easily revealed with simple prompts and amusing images, and these AIs are being put to work making decisions who knows where.

      • intensely_human@lemm.eeBannedEnglish
        9·
        3 years ago

        In India they’ve been used to determine whether people should be kept on or kicked off of programs like food assistance.

        • rottingleaf@lemmy.zipBanned from communityEnglish
          1·
          3 years ago

          Well, humans are similar to pigs in the sense that they’ll always find the stinkiest pile of junk in the area and taste it before any alternative.

          EDIT: That’s about popularity of “AI” today, and not some semantic expert systems like what they’d do with Lisp machines.

    • Eyck_of_denesle@lemmy.zipEnglish
      1·
      3 years ago

      How are you guys getting it to generate"persons". It simply says It’s against my GOGLE AI PRINCIPLE to generate images of people.