this post was submitted on 25 Aug 2024
328 points (92.9% liked)

Technology

58133 readers
4058 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 317 points 3 weeks ago (5 children)

The only people who would say this are people that don’t know programming.

LLMs are not going to replace software devs.

[–] [email protected] 135 points 3 weeks ago (1 children)

Wrong, this is also exactly what people selling LLMs to people who can't code would say.

[–] [email protected] 51 points 3 weeks ago

It's this. When boards and non-tech savvy managers start making decisions based on a slick slide deck and a few visuals, enough will bite that people will be laid off. It's already happening.

There may be a reckoning after, but wall street likes it when you cut too deep and then bounce back to the "right" (lower) headcount. Even if you've broken the company and they just don't see the glide path.

It's gonna happen. I hope it's rare. I'd argue it's already happening, but I doubt enough people see it underpinning recent lay offs (yet).

[–] [email protected] 33 points 3 weeks ago (2 children)

AI as a general concept probably will at some point. But LLMs have all but reached the end of the line and they're not nearly smart enough.

[–] [email protected] 8 points 3 weeks ago (3 children)

LLMs have already reached the end of the line 🤔

I don’t believe that. At least from an implementation perspective we’re extremely early on, and I don’t see why the tech itself can’t be improved either.

Maybe it’s current iteration has hit a wall, but I don’t think anyone can really say what the future holds for it.

[–] [email protected] 24 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

LLMs have been around since roughly ~~2016~~ 2017 (comment below corrected me that Attention paper was 2017). While scaling the up has improved their performance/capabilities, there are fundamental limitations on the actual approach. Behind the scenes, LLMs (even multimodal ones like gpt4) are trying to predict what is most expected, while that can be powerful it means they can never innovate or be truth systems.

For years we used things like tf-idf to vectorize words, then embeddings, now transformers (supped up embeddings). Each approach has it limits, LLMs are no different. The results we see now are surprisingly good, but don't overcome the baseline limitations in the underlying model.

[–] [email protected] 7 points 3 weeks ago (1 children)

The "Attention Is All You Need" paper that birthed modern AI came out in 2017. Before Transformers, "LLMs" were pretty much just Markov chains and statistical language models.

[–] [email protected] 2 points 3 weeks ago

You're right, I thought that paper came out in 2016.

[–] [email protected] 6 points 3 weeks ago

I'm not trained in formal computer science, so I'm unable to evaluate the quality of this paper's argument, but there's a preprint out that claims to prove that current computing architectures will never be able to advance to AGI, and that rather than accelerating, improvements are only going to slow down due to the exponential increase in resources necessary for any incremental advancements (because it's an NP-hard problem). That doesn't prove LLMs are end of the line, but it does suggest that additional improvements are likely to be marginal.

Reclaiming AI as a theoretical tool for cognitive science

[–] [email protected] -5 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

we're extremely early on

Oh really! The analysis has been established since the 80's. Its so far from early on that statement is comical

[–] [email protected] 3 points 3 weeks ago (1 children)

Transformers, the foundation of modern "AI", was proposed in 2017. Whatever we called "AI" and "Machine Learning" before that was mostly convolutional networks inspired by the 80's "Neocognitron", which is nowhere near as impressive.

The most advanced thing a Convolutional network ever accomplished was DeepDream, and visual Generative AI has skyrocketed in the 10 years since then. Anyone looking at this situation who believes that we have hit bedrock is delusional.

From DeepDream to Midjourney in 10 years is incredible. The next 10 years are going to be very weird.

[–] [email protected] 0 points 3 weeks ago

"at some point" being like 400 years in the future? Sure.

Ok that's probably a little bit of an exaggeration. 250 years.

[–] [email protected] 18 points 3 weeks ago* (last edited 3 weeks ago) (5 children)

I can see the statement in the same way word processing displaced secretaries.

There used to be two tiers in business. Those who wrote ideas/solutions and those who typed out those ideas into documents to be photocopied and faxed. Now the people who work on problems type their own words and email/slack/teams the information.

In the same way there are programmers who design and solve the problems, and then the coders who take those outlines and make it actually compile.

LLM will disrupt the programmers leaving the problem solvers.

There are still secretaries today. But there aren't vast secretary pools in every business like 50 years ago.

[–] [email protected] 15 points 3 weeks ago

There is no reason to believe that LLM will disrupt anyone any time soon. As it stands now the level of workmanship is absolutely terrible and there are more things to be done than anyone has enough labor to do. Making it so skilled professionals can do more literally just makes it so more companies can produce quality of work that is not complete garbage.

Juniors produce progressively more directly usable work with reason and autonomy and are the only way you develop seniors. As it stands LLM do nothing with autonomy and do much of the work they do wrong. Even with improvements they will in near term actually be a coworker. They remain something you a skilled person actually use like a wrench. In the hands of someone who knows nothing they are worth nothing. Thinking this will replace a segment of workers of any stripe is just wrong.

[–] [email protected] 12 points 3 weeks ago (2 children)

I wrote a comment about this several months ago on my old kbin.social account. That site is gone and I can't seem to get a link to it, so I'm just going to repost it here since I feel it's relevant. My kbin client doesn't let me copy text posts directly, so I've had to use the Select feature of the android app switcher. Unfortunately, the comment didn't emerge unscathed, and I lack the mental energy to fix it due to covid brain fog (EDIT: it appears that many uses of I were not preserved). The context of the old post was about layoffs, and it can be found here: https://kbin.earth/m/[email protected]/t/12147

I want to offer my perspective on the Al thing from the point of view of a senior individual contributor at a larger company. Management loves the idea, but there will be a lot of developers fixing auto-generated code full of bad practices and mysterious bugs at any company that tries to lean on it instead of good devs. A large language model has no concept of good or bad, and it has no logic. happily generate string- templated SQL queries that are ripe for SQL injection. I've had to fix this myself. Things get even worse when you have to deal with a shit language like Bash that is absolutely full of God awful footguns. Sometimes you have to use that wretched piece of trash language, and the scripts generated are horrific. Remember that time when Steam on Linux was effectively running rm -rf /* on people's systems? I've had to fix that same type of issue multiple times at my workplace.

I think LLMs will genuinely transform parts of the software industry, but I absolutely do not think they're going to stand in for competent developers in the near future. Maybe they can help junior developers who don't have a good grasp on syntax and patterns and such. I've personally felt no need to use them, since spend about 95% of my time on architecture, testing, and documentation.

Now, do the higher-ups think the way that do? Absolutely not. I've had senior management ask me about how I'm using Al tooling, and they always seem so disappointed when I explain why I personally don't feel the need for it and what feel its weaknesses are. Bossman sees it as a way to magically multiply IC efficiency for nothing, so absolutely agree that it's likely playing a part in at least some of these layoffs.

Basically, I think LLMs can be helpful for some folks, but my experience is that the use of LLMs by junior developers absolutely increases the workload of senior developers. Senior developers using LLMs can experience a productivity bump, but only if they're very critical of the output generated by the model. I am personally much faster just relying on traditional IDE auto complete, since I don't have to change from "I'm writing code" mode to "I'm reviewing code mode."

[–] [email protected] 8 points 3 weeks ago (1 children)

The one colleague using AI at my company produced (CUDA) code with lots of memory leaks that required two expert developers to fix. LLMs produce code based on vibes instead of following language syntax and proper coding practices. Maybe that would be ok in a more forgiving high level language, but I don't trust them at all for low level languages.

[–] [email protected] 5 points 3 weeks ago

I was trying to use it to write a program in python for this macropad I bought and I have yet to get anything usable out of it. It got me closer than I would have been by myself and I don't have a ton of coding experience so it's problems are probably partially on me but everything it's given me has required me to correct it to work.

[–] [email protected] 5 points 3 weeks ago (1 children)

Will there even be a path for junior level developers?

[–] [email protected] 4 points 3 weeks ago

The same one they have now, perhaps with a steeper learning curve. The market for software developers is already saturated with disillusioned junior devs who attended a boot camp with promises of 6 figure salaries. Some of them did really well, but many others ran headlong into the fact that it takes a lot more passion than a boot camp to stand out as a junior dev.

From what I understand, it's rough out there for junior devs in certain sectors.

[–] [email protected] 10 points 3 weeks ago (1 children)

The problem with this take is the assertion that LLMs are going to take the place of secretaries in your analogy. The reality is that replacing junior devs with LLMs is like replacing secretaries with a network of typewriter monkeys who throw sheets of paper at a drunk MBA who decides what gets faxed.

[–] [email protected] 3 points 3 weeks ago

I'm saying that devs will use LLM's in the same way they currently use word processing to send emails instead of handing hand written notes to a secretary to format, grammar/spell check, and type.

[–] [email protected] 6 points 3 weeks ago

I thought by this point everyone would know how computers work.

That, uh, did not happen.

[–] [email protected] 1 points 3 weeks ago
[–] [email protected] 5 points 3 weeks ago

The one thing that LLMs have done for me is to make summarizing and correlating data in documents really easy. Take 20 docs of notes about a project and have it summarize where they are at so I can get up to speed quickly. Works surprisingly well. I haven’t had luck with code requests.

[–] [email protected] 3 points 3 weeks ago

That’s not what was said. He specifically said coding.