Discreet object recognition. Right now they can't answer the simplest questions that require counting discrete objects. Which to me implies they have no discreet object sense at all. They're just looking for word patterns.

I'll give you an example, If you were to ask one of these. "I was on my way to the store when I saw a sow with six piglets, how many feet do we have?"

We could have a lively debate about what potential answers would be acceptable. Maybe there's only 2 feet because the rest are hooves, maybe there's 30 because that's how many foot like appendages there are in total, but the answer it will give you will make absolutely no sense.

Chat GPT will be like, "11" or "15" and if you ask it any questions or follow up it genuinely does not have any answer for how any of these objects could be discreetly counted or partitioned. It can try to explain itself but quickly starts babbling nonsense.