this post was submitted on 17 Jul 2023
179 points (92.0% liked)

Technology

58011 readers
2829 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 23 points 1 year ago (2 children)

That's really fascinating. In my experience, of all the LLM chatbots I've tried, Bard will immediately no hesitation lie to me no matter the question. It is by far the least trustworthy AI I've used.

[–] [email protected] 15 points 1 year ago (1 children)

i think that it’s trained to be evasive. I think there is information it’s programmed to protect, and it’s learned that an indirect refusal to answer is more effective than a direct one. So it makes up excuses, rather than tell you the real reason it can’t say something.

[–] [email protected] 15 points 1 year ago (1 children)

I'll give you an example that comes to mind. I had a question about the political leanings of a school district and so I asked the bots if the district had any recent controversies, like a conservative takeover of the school board, bans on crt, actions against transgender students, banning books, or defying COVID vaccine or mask requirements in the state, things like that. Bing Chat and ChatGPT (with internet access at the time) both said they couldn't find anything like that, I think Bing found some small potatoes local controversy from the previous year, and both bots went on to say that the voting record for the Congressional district the school district was in was lean Dem in the last election. When I asked Bard the same question it confidentiality told me that this same school district recently was overrun by conservatives in a recall and went on to do all kinds of horrible things. It was a long and detailed response. I was surprised and asked for sources since my searching didn't turn any of that up, and at that point Bard admitted it lied.

I don't know, my experience with Bard is it's been way worse than just evasive lying. I routinely ask all three (and now anthropic since they opened that up) the same copy and paste questions to see the differences, and whenever I paste my question into Bard I think "wonder what kind of bullshit it's going to come up with now". I don't use it that much because I don't trust it, and it seems like your more familiar with Bard, so maybe your experience is different.

[–] [email protected] 4 points 1 year ago

interesting. next time I’ll try a similar scenario and what happens.

[–] [email protected] 6 points 1 year ago

Maybe it gets its answers from the Google "other people asked" box