Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

  • masterofn001@lemmy.ca
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    2 hours ago

    I agree that it should be able to infer the intent, but I stand by that it remain somewhat unclear and open to interpretation. Eg, If such language was used in a legal contract, it would not be enough to simply say, well, they should understand what I meant.

    The people doing this test, I’m sure, are not linguistic masters, nor legal scholars.

    There are lines of work where clarity is essential.

    And what if my question actually was asking, should I just go for a walk instead of driving that far?

    I know the answer. But as 30% demonstrated, clarity IS needed.