this post was submitted on 15 Aug 2023
89 points (88.7% liked)

Technology

58011 readers
4439 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

ChatGPT Isn't as Good at Coding as We Thought::undefined

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 34 points 1 year ago* (last edited 1 year ago) (5 children)

I've experimented a bit with chatGPT, asking it to create some fairly simple code snippets to interact with a new API I was messing with, and it straight up confabulated methods for the API based on extant methods from similar APIs. It was all very convincing, but if there's no way of knowing that it's just making things up, it's literally worse than useless.

[–] [email protected] 7 points 1 year ago

ChatGPT has been helpful in being an interactive rubber duck. I used it to help myself breakdown the technical problems that I need to solve and it helps to cut down time taken to complete a difficult ticket that usually take a couple of days of work to a couple of hours.

[–] [email protected] 5 points 1 year ago

"just good enough to be dangerous"

[–] [email protected] 4 points 1 year ago* (last edited 1 year ago)

I’ve had similar experiences with it telling me to call functions of third party libs that don’t exists. When you tell it “That function X does not exist” it says “I’m sorry, your right fucking X doesn’t not exist on library A. here is another example using function Y” then function Y doesn’t exist either.

I have found it useful in a limited scope, but I have found co-pilot to be much more of a daily time saver.

[–] [email protected] -5 points 1 year ago* (last edited 1 year ago)

So? Those mistakes will come up in testing, and you can easily fix them (either yourself, or by asking the AI to do it, whichever is faster).

I've successfully used it to write code for APIs that did not even exist at all a couple years ago when ChatGPT's model was trained. It doesn't need to know the API to generate working code - you just need to tell it what APIs are available as part of your conversation.