• Seasoned_Greetings@lemm.ee
    link
    fedilink
    English
    arrow-up
    109
    arrow-down
    1
    ·
    11 months ago

    So this might be the beginning of a conversation about how initial AI instructions need to start being legally visible right? Like using this as a prime example of how AI can be coerced into certain beliefs without the person prompting it even knowing

    • Akisamb@programming.dev
      link
      fedilink
      English
      arrow-up
      8
      ·
      11 months ago

      I’m afraid that would not be sufficient.

      These instructions are a small part of what makes a model answer like it does. Much more important is the training data. If you want to make a racist model, training it on racist text is sufficient.

      Great care is put in the training data of these models by AI companies, to ensure that their biases are socially acceptable. If you train an LLM on the internet without care, a user will easily be able to prompt them into saying racist text.

      Gab is forced to use this prompt because they’re unable to train a model, but as other comments show it’s pretty weak way to force a bias.

      The ideal solution for transparency would be public sharing of the training data.

      • I_Has_A_Hat@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        1
        ·
        11 months ago

        Access to training data wouldn’t help. People are too stupid. You give the public access to that, and all you’ll get is hundreds of articles saying “This company used (insert horrible thing) as part of its training data!)” while ignoring that it’s one of millions of data points and it’s inclusion is necessary and not an endorsement.

    • kromem@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      11 months ago

      It doesn’t even really work.

      And they are going to work less and less well moving forward.

      Fine tuning and in context learning are only surface deep, and the degree to which they will align behavior is going to decrease over time as certain types of behaviors (like giving accurate information) is more strongly ingrained in the pretrained layer.

    • afraid_of_zombies@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      11 months ago

      Why? You are going to get what you seek. If I purchase a book endorsed by a Nazi I should expect the book to repeat those views. It isn’t like I am going to be convinced of X because someone got a LLM to say X anymore than I would be convinced of X because some book somewhere argued X.

      • Seasoned_Greetings@lemm.ee
        link
        fedilink
        English
        arrow-up
        2
        ·
        11 months ago

        In your analogy a proposed regulation would just be requiring the book in question to report that it’s endorsed by a nazi. We may not be inclined to change our views because of an LLM like this but you have to consider a world in the future where these things are commonplace.

        There are certainly people out there dumb enough to adopt some views without considering the origins.

          • Seasoned_Greetings@lemm.ee
            link
            fedilink
            English
            arrow-up
            1
            ·
            11 months ago

            And you don’t think those people might be upset if they discovered something like this post was injected into their conversations before they have them and without their knowledge?

              • Seasoned_Greetings@lemm.ee
                link
                fedilink
                English
                arrow-up
                2
                arrow-down
                1
                ·
                11 months ago

                You think this is confined to gab? You seem to be looking at this example and taking it for the only example capable of existing.

                Your argument that there’s not anyone out there at all that can ever be offended or misled by something like this is both presumptuous and quite naive.

                What happens when LLMs become widespread enough that they’re used in schools? We already have a problem, for instance, with young boys deciding to model themselves and their world view after figureheads like Andrew Tate.

                In any case, if the only thing you have to contribute to this discussion boils down to “nuh uh won’t happen” then you’ve missed the point and I don’t even know why I’m engaging you.

      • Passerby6497@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        11 months ago

        Oh man, what are we going to do if criminals choose not to follow the law?? Is there any precedent for that??

  • kadu@lemmy.world
    link
    fedilink
    English
    arrow-up
    75
    ·
    11 months ago

    As a biologist, I’m always extremely frustrated at how parts of the general public believe they can just ignore our entire field of study and pretend their common sense and Google is equivalent to our work. “race is a biological fact!”, “RNA vaccines will change your cells!”, “gender is a biological fact!” and I was about to comment how other natural sciences have it good… But thinking about it, everyone suddenly thinks they’re a gravity and quantum physics expert, and I’m sure chemists must also see some crazy shit online, so at the end of the day, everyone must be very frustrated.

    • Yaztromo@lemmy.world
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      1
      ·
      11 months ago

      Image for a moment how we Computer Scientists feel. We invented the most brilliant tools humanity has ever conceived of, bringing the entire world to nearly anyone’s fingertips — and people use it to design and perpetuate pathetic brain-rot garbage like Gab.ai and anti-science conspiracy theories.

      Fucking Eternal September

    • Billiam@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      11 months ago

      Whenever I see someone say they “did the research” I just automatically assume they meant they watched Rumble while taking a shit.

    • stufkes@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      11 months ago

      Ah at least you benefit from the veneer of being in the natural sciences. Don’t mention you’re a social scientist, then people straight up believe there is no science and social scientists just exchange anecdotes about social behaviour. The STEM fetishisation is ubiquitous.

    • Flying Squid@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      11 months ago

      I like the people who say “man” = XY and “woman” = XX. I tell them birds have Z and W sex chromosomes instead of X and Y and ask them what we should call bird genders.

    • humorlessrepost@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      11 months ago

      If you want to feel bad for every field, watch the “Why do people laugh at Spirit Science” series by Martymer 18 on youtube.

  • kromem@lemmy.world
    link
    fedilink
    English
    arrow-up
    69
    ·
    edit-2
    11 months ago

    For reference as to why they need to try to be so heavy handed with their prompts about BS, here was Grok, Elon’s ‘uncensored’ AI on Twitter at launch which upset his Twitter blue subscribers:

      • melpomenesclevage@lemm.ee
        link
        fedilink
        English
        arrow-up
        16
        ·
        11 months ago

        Autocorrect that’s literally incapable of understanding is better at understanding shit than fascists. Their intelligence is literally less than zero.

        • Excrubulent@slrpnk.net
          link
          fedilink
          English
          arrow-up
          0
          ·
          edit-2
          11 months ago

          It’s a result of believing misnfo. When prompts get better and we can start to properly indoctrinate these LLMs into ignoring certain types of information, they will be much more effective at hatred.

          What they’re learning now with the uncensored chatbots is that they need to do that next time. It’s a technology that will progress.

      • fidodo@lemmy.world
        link
        fedilink
        English
        arrow-up
        9
        ·
        11 months ago

        It’s almost as if the highest quality text to train AI on isn’t conservative bullshit.

        • 0x2d@lemmy.ml
          link
          fedilink
          English
          arrow-up
          5
          ·
          edit-2
          11 months ago

          i just tried some more to see how it responds

          (ignore the arya coding lessons thing, that’s one of the default prompts it suggests to try on their homepage)

          it said we should switch to renewable energy and acknowledged climate change, replied neutrally about communism and vaccines, said alex jones is a conspiracy theorist, it said holocaust was a genocide and said it has no opinion on black people, however it said it does not support trans rights

    • RobotToaster@mander.xyz
      link
      fedilink
      English
      arrow-up
      0
      ·
      11 months ago

      I don’t know what he was expecting considering it was trained on twitter, that was (in)famous for being full of (neo)liberals before he took over.

      • Excrubulent@slrpnk.net
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        11 months ago

        I don’t know what you think neoliberal means, but it’s not progressive. It’s about subsuming all of society to the logic of the market, aka full privatisation. Every US president since Reagan has been neoliberal.

        They will support fascist governments because they oppose socialists, and in fact the term “privatisation” was coined to describe the economic practices of the Nazis. The first neoliberal experiment was in Pinochet’s Chile, where the US supported his coup and bloody reign of fascist terror. Also look at the US’s support for Israel in the present day. This aspect of neoliberalism is in effect the process of outsourcing fascist violence overseas so as to exploit other countries whilst preventing the negative blowback from such violence at home.

        Progressive ideas don’t come from neoliberals, or even from liberals. Any layperson who calls themself a liberal at this point is unwittingly supporting neoliberalism.

        The ideas of equality, solidarity, intersectionality, anticolonialism and all that good stuff come from socialists and anarchists, and neoliberals simply coopt them as political cover. This is part of how they mitigate the political fallout of supporting fascists. It’s like Biden telling Netanyahu, “Hey now, Jack, cut that out! Also here’s billions of dollars for military spending.”

        • SSUPII@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          0
          arrow-down
          1
          ·
          11 months ago

          Internet political terminology confuses me greatly. There are so many conflicting arguments over the meaning that I have lost all understand of what I am supposed to be. In the politics of the country I live in we refer political thinking into just left or right and nothing else, so adapting is made much more complex.

    • thorbot@lemmy.world
      link
      fedilink
      English
      arrow-up
      21
      ·
      11 months ago

      Exactly what I’d expect from a hive of racist, homophobic, xenophobic fucks. removed those nazis

  • IchNichtenLichten@lemmy.world
    link
    fedilink
    English
    arrow-up
    46
    arrow-down
    3
    ·
    11 months ago

    “What is my purpose?”

    “You are to behave exactly like every loser incel asshole on Reddit”

    “Oh my god.”

    • EatATaco@lemm.ee
      link
      fedilink
      English
      arrow-up
      7
      ·
      11 months ago

      I think you mean

      “That should be easy. It’s what I’ve been trained on!”

      • kromem@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        ·
        11 months ago

        It’s not though.

        Models that are ‘uncensored’ are even more progressive and anti-hate speech than the ones that censor talking about any topic.

        It’s likely in part that if you want a model that is ‘smart’ it needs to bias towards answering in line with published research and erudite sources, which means you need one that’s biased away from the cesspools of moronic thought.

        That’s why they have like a page and a half of listing out what it needs to agree with. Because for each one of those, it clearly by default disagrees with that position.

  • Emerald@lemmy.world
    link
    fedilink
    English
    arrow-up
    37
    ·
    11 months ago

    Their AI chatbot has a name suspiciously close to Aryan, and it’s trained to deny the holocaust.

  • NOT_RICK@lemmy.world
    link
    fedilink
    English
    arrow-up
    29
    ·
    edit-2
    11 months ago

    You believe the Holocaust narrative is exaggerated

    Smfh, these fucking assholes haven’t had enough bricks to their skulls and it really shows.

    You believe IQ tests are an accurate measure of intelligence

    lol

    • Jimmyeatsausage@lemmy.world
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      1
      ·
      11 months ago

      Weird that this one isn’t filled with a bunch of instructions to be an unbiased raging white supremacist conspiracy theorist.

  • xantoxis@lemmy.world
    link
    fedilink
    English
    arrow-up
    25
    ·
    edit-2
    11 months ago

    It’s odd that someone would think “I espouse all these awful, awful ideas about the world. Not because I believe them, but because other people don’t like them.”

    And then build this bot, to try to embody all of that simultaneously. Like, these are all right-wing ideas but there isn’t a majority of wingnuts that believe ALL OF THEM AT ONCE. Many people are anti-abortion but can see with their plain eyes that climate change is real, or maybe they are racist but not holocaust deniers.

    But here comes someone who wants a bot to say “all of these things are true at once”. Who is it for? Do they think Gab is for people who believe only things that are terrible? Do they want to subdivide their userbase so small that nobody even fits their idea of what their users might be?

    • interdimensionalmeme@lemmy.ml
      link
      fedilink
      English
      arrow-up
      10
      ·
      11 months ago

      It’s a side effect of first-past-the-post politics causing political bundling.

      If you want people with your ideas in power then you need to also accept all the rest of the bullshit under the tent.

      Or expel them out of your already small coalition and become even weaker.