• turboSnail@piefed.europe.pub
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    3
    ·
    9 hours ago

    How about asking it to write a short political speech on climate change. Then, just count the number of rhetoric devices and em-dashes. A human dev wouldn’t be bothered to write anything fancy or impactful when they just want to submit a bug fix. It would be simple, poorly written, and filled with typos. LLMs try to make it way too impressive and impactful.

    • sp3ctr4l@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      3 hours ago

      The funnier thing is when you try to get an LLM to do like, a report on its creators.

      You can keep feeding them articles detailing the BS their company is up to, and it will usually just keep reverting to the company line, despite a preponderance of evidence that said company line is horseshit.

      Like uh, try to get an LLM to give you an exact number of uh, how much will this conversation we are having, how much will that increase RAM prices in a 3 month period?

      What do you think about ~95% of companies implementing ‘AI’ into their business processes reporting a 0 to negative boost to productivity?

      What are the net economic damages of this malinvestment?

      Give it a bunch of economic data, reports, etc.

      Results are usually what I would describe as ‘comical’.