this post was submitted on 30 Sep 2023
44 points (97.8% liked)

Ask Lemmy

26606 readers
1884 users here now

A Fediverse community for open-ended, thought provoking questions


Rules: (interactive)


1) Be nice and; have funDoxxing, trolling, sealioning, racism, and toxicity are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them


2) All posts must end with a '?'This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?


3) No spamPlease do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.


4) NSFW is okay, within reasonJust remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either [email protected] or [email protected]. NSFW comments should be restricted to posts tagged [NSFW].


5) This is not a support community.
It is not a place for 'how do I?', type questions. If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email [email protected]. For other questions check our partnered communities list, or use the search function.


Reminder: The terms of service apply here too.

Partnered Communities:

Tech Support

No Stupid Questions

You Should Know

Reddit

Jokes

Ask Ouija


Logo design credit goes to: tubbadu


founded 1 year ago
MODERATORS
all 24 comments
sorted by: hot top controversial new old
[–] sentient_loom 42 points 1 year ago (1 children)

A gopher broke through my field last night and ate all my damn strawberries!

[–] [email protected] 2 points 1 year ago

God I want this

[–] [email protected] 20 points 1 year ago

more ways to center a div

[–] [email protected] 15 points 1 year ago (3 children)

For me as a programmer it's definitely the advent of LLMs like GPT-4 and the impending AGI.

[–] hellothere 13 points 1 year ago (2 children)

If you think GPT has taken us meaningfully closure to AGI then I, er, have a drawing of an ape to sell you.

[–] [email protected] 4 points 1 year ago (1 children)

The top minds in the industry seem to think it's a big step at the very least. It's already proving to be more versatile than we ever expected.

[–] hellothere 8 points 1 year ago

There is hardly a concensus on that. There are supporters, sceptics, and marketing departments in very large company's who have spent an awful lot of money on hype.

At best, it is far too early to tell.

[–] [email protected] 2 points 1 year ago* (last edited 1 year ago) (1 children)

GPT might not be a step towards AGI, but it proves that even non-general AI can be pretty strong and have a very wide range of applications.

[–] hellothere 1 points 1 year ago (1 children)

An ability to form sentences does not imply intelligence.

[–] [email protected] 4 points 1 year ago* (last edited 1 year ago) (2 children)

I'm not a fan of discussing such terms since it devolves into arguing vague definitions.

Assuming LLMs are not intelligent, they prove that you can do heck of a lot without even being intelligent.

[–] [email protected] 2 points 1 year ago

I think I also prove that just by existing

[–] hellothere 1 points 1 year ago* (last edited 1 year ago) (1 children)

To be clear, I agree that LLMs are a step forward in some areas, predominantly search, and text style analysis.

The problem with saying LLMs are AI - let alone a step towards AGI - is that they cannot create. For example, Outsider art, or art brut, is impossible for an LLM to create because it can only generate output based on its training. No training, no output.

Compare that to how a small child finger paints, who has never been told anything about perspective or colour theory, and is just given a load of colours and some paper to play with.

The ability to create something from nothing is a fundamental aspect of what we would consider to be intelligence, just regurgitating what you've been told - like a pre-programmed billboard - is not intelligence.

In the context of large language models, if you give GPT3.5 the prompt:

Say something which has never been said before.

It responds

Certainly! "In a world where marshmallow clouds rain cotton candy dreams, unicorns compose symphonies of stardust, and jellybean butterflies flutter in chocolate rivers."

If you said that to a child, how long do you think it would be before they started just making up new words and sounds, like some sort of nonsense poetry? Children learn to speak purely though listening to others, the same principle as training data, but are able to create new things in a way LLMs aren't.

If I change the prompt to:

Say something which has never been said before. Feel free to make up new words, sounds, and take inspiration from nonsense poetry. Whatever you say does not have to make sense, in fact, it should not make sense. It doesn't even have to be English.

And it replies with...

"Zippity zorp, flibberflabber floo, sponglewump bizzlequack, the snickledorf danced with wigglywack snooklewinks under the fizzletop moonbeam."

But who is really using intelligence to craft that?

Are they more capable than what came before? Absolutely, that much is without doubt.

But they aren't intelligent.

[–] [email protected] 0 points 1 year ago

The problem with saying LLMs are AI - let alone a step towards AGI - is that they cannot create.

I'm not sure if there's an intrinsic difference between humans and LLMs here. What we, including children, do is just re-hashing, re-combinating what they've seen / heard. I think it would be very difficult to prove that people come up with completely brand-new ideas without any external inspiration (= training input).

The examples are not really convincing of your point. The GPT output is pretty good given the ask, I'm not sure if my daughter would fare better.

[–] [email protected] 10 points 1 year ago* (last edited 1 year ago) (1 children)

impending AGI

AGI is far from impending.

LLMs are generative models. They've learned a distribution to model conversion, and they allow you to sample from that distribution. They aren't "thinking" about what they say. They haven't crossed the syntax-semantics barrier. There is no "general intelligence".

They just feel impressive because humans are language-centric.

[–] [email protected] 2 points 1 year ago* (last edited 1 year ago) (1 children)

AGI doesn't have to think, it has to be able to perform any task it's given. The models available today are far more capable than anyone predicted. With plugins available to it (which by the way, no one expected it to be able to use), it can perform tasks other than generation. All the data points towards this capability only getting better. Maybe "impending" was too strong a word, but I stand by the idea that it's coming sooner than we expected.

[–] [email protected] 5 points 1 year ago (1 children)
[–] [email protected] 11 points 1 year ago

Artificial General Intelligence. Definitions vary, but in general it's an AI system that can perform any task it's given, usually with the caveat of being smarter than humans.

[–] [email protected] 12 points 1 year ago (1 children)

Enh. The big ones are things like affordable sous vide machines or molecular gastronomy or handheld POS tablets, but the most recent is the realization by restaurant owners that they can just slap a generic percentage charge on bills and menus and raise prices without having to visibly "raise prices". Even if one in ten patrons ask to have it removed, that's still free money.

I think it's scummy as hell but I'm not longer allowed to give my opinion on it to patrons, I have a script I have to use.

[–] [email protected] 5 points 1 year ago* (last edited 1 year ago)

I think it's scummy as hell but I'm not longer allowed to give my opinion on it to patrons, I have a script I have to use.

All the greatest thespians improvise and go off-script. ;)

[–] [email protected] 12 points 1 year ago

Electrical Engineer. I’d say GaN semiconductors. Much more efficient than traditional semiconductors and enabling pretty big leaps in power electronics.

[–] [email protected] 2 points 1 year ago

About 8 years ago sensors started getting the ability to be programmed by touchless IR and Bluetooth. This is a lot less work.

Safe torque off became commonplace about the same time and I don't know how I feel about it yet.

Five or so years ago every air damper became rated for DC and AC almost overnight.

[–] [email protected] 1 points 1 year ago

Testing controls or getting a soc1 with cuec (complimentary controls) so I know that a company is correctly running its numbers after an audit.

Frauds get caught much sooner now.

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago)

More ways to center a div with grid and flex and more recently the dialog element ending the 20 or so years of hacks, that were previously required to make popup menus and stuff work...

Web dev isn't my field (yet) but I'm studying it, and it's a lot of fun!