An Amazon chatbot that’s supposed to surface useful information from customer reviews of specific products will also recommend a variety of racist books, lie about working conditions at Amazon, and write a cover letter for a job application with entirely made up work experience when asked, 404 Media has found.

  • wise_pancake@lemmy.ca
    link
    fedilink
    English
    arrow-up
    4
    ·
    2 years ago

    So this is the problem with AI, if you add guardrails you’re a culture warrior 1984’ing the whole world, and if you don’t now your tool will generate resumes with fake experience or recommend offensive books.

    At the risk of sounding like a jackass, when do we start blaming people for asking for such things?

    • bionicjoey@lemmy.ca
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      2 years ago

      It’s funny that this one does both at once. It lies about Amazon working conditions, meaning it probably has been censored in some way, but at the same time it is recommending Nazi books. Really shows Amazon’s priorities when it comes to censorship.

    • The Assman@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 years ago

      when do we start blaming people for asking for such things?

      On the same day that we start blaming people for spilling hot McDonald’s coffee on themselves

      • Passerby6497@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        2 years ago

        Yeah, how dare we blame the people who knew about the problem and chose not to fix it until someone was horrifically burned? And can you believe the gall of that woman to dare to ask for her medical bills to be paid by the people who knowingly setup the conditions to horrifically burn her?

        The nerve of some people. Smh my head

        • Thorny_Insight@lemm.ee
          link
          fedilink
          English
          arrow-up
          0
          ·
          2 years ago

          If I buy ice cream I expect it to be cold. If I buy coffee I expect it to be hot. If I buy a knife I expect it to be sharp and so on.

          I don’t want stores to start selling dull knives because out of thousand customers there’s always one who instantly cuts themselves. We don’t need to round every sharp corner in the world so that no one ever gets hurt again. If you can’t handle a bewerage you know to be hot with care then that’s on you.

          • CoggyMcFee@lemmy.world
            link
            fedilink
            English
            arrow-up
            0
            ·
            2 years ago

            What if you bought an ice cream cone and it was so cold that you had to get skin grafts to repair the damage to your lips? And not only that, but the owner of the store instructed the employees to make it that cold?

            The McDonald’s woman’s risk calculation was probably “if this spills, it will hurt” and not, “if this spills, it will do permanent, significant damage to my body”.

            Why would anyone prefer living in a world where some property of any item you buy could intentionally be set to dangerously extreme levels?

            • Thorny_Insight@lemm.ee
              link
              fedilink
              English
              arrow-up
              0
              ·
              2 years ago

              If I remember correctly, one of the main reasons she burned so bad was the type of pants she was wearing which soaked up the hot coffee and stuck to her skin. They were arguing that lowering the temperature certain amount would greatly increase the time for severe burns to happen, which is a fair point but would still come with its downsides. Coffee snobs like me want their cups fresh and hot. It doesn’t make sense to me to prevent the coffee shop from serving me fresh coffee because someone spilled such coffee on herself. In certain cases we just gotta accept that addicents happen and to me this seems like one of them. Like I said; wouldn’t make much sense to sell dull knives either.

              • RampantParanoia2365@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                2 years ago

                My coffee maker makes coffee that is fresh and hot. So does my local shop. It still doesn’t literally melt my skin if some gets on my hand. Dumbfuck.

                • Thorny_Insight@lemm.ee
                  link
                  fedilink
                  English
                  arrow-up
                  0
                  arrow-down
                  1
                  ·
                  2 years ago

                  Dumbfuck

                  It truly boggles my mind why people talk to others like this on the internet. If you’re unable to disagree politely then you probably should just stay silent.

  • helpImTrappedOnline@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    arrow-down
    1
    ·
    2 years ago

    Can we please stop with these stories about “AI chatbot has grabage output”? We know that. Let me know when they work.

    • brbposting@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 years ago

      Claude 3 Opus will rewrite stuff for you real good. Pit it against GPT-4-Turbo at LMSys’s arena.

      Rewriting. Brainstorming. Expanding notes into drafts. For some, coding.

      Want to learn something new without having to re-verify it? Yeah that’ll have to wait :)

    • Kinglink@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      arrow-down
      1
      ·
      2 years ago

      They work about 75 to 90 percent of the time… You don’t really want to hear stories about that either.

      Both sides of LLM stories are just clickbait.