For the last time, people need to stop treating AI like it removes their need for research, just because it sounds like it did its research. Check the work your tools do for you, damn it.
this post was submitted on 03 Mar 2025
835 points (99.3% liked)
Technology
63746 readers
4026 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
It's Wikipedia all over again. Absolutely feel free to use the tool, e.g. Wikipedia, ChatGPT, whatever, but holy shit check the sources, my guy. This is embarrassing.
The best use, for me, is asking ChatGPT to give me five (or however many) scholarly, peer-reviewed articles on a topic. Then I search for said articles by title and author name on my school library database.
It saves me so much time compared to doing a keyword search on said same database and reading a ton of abstracts to find a few articles. I can get to actually reading them and working on my assignment way faster.
AI is a great tool for people who use it properly.
I personally just like using it for rewording/re-explaining a topic that I don't quite get. LLMs may not be the best at actually providing factual evidence themselves, but they can be damn good at reformatting any given content/context you give it into almost any format you want.
Why dont more AI services cite sources? Or just as a lawyer add that to your prompt and just check if they exist? I get fake sources on OpenAI sometimes but its obvious because the links are dead.
Works tirelessly? No, AI here!
Nice all the work that the lawyers saved will be offset by judges having to verify all the cases cited
I’m all for lawyers using AI, but that’s because I’m also all for them getting punished for every single incorrect thing they bring forward if they do not verify.
That is the problem with AI, if I have to check the output is valid then what's the damn point?
It's actually often easier to check an answer than coming up with an answer. Finding the square root of 66564 by hand isn't easy, but checking if the answer is 257 is simple enough.
So, in principle, if the AI is better at guessing an answer than we are, it might still be useful. But it depends on the cost of guessing and the cost of checking.
Now if only an AI could actually find the square root of anything. They can't do math, at least the models I've tried. I am aware that if they could do math, it would be a big deal, but really if it can't analyze the actual content in my work files then it's useless to me. It's good at finding mathematical answers by putting in what you expect to get from 120 X 15.5, but doesn't actually know the difference between 1860 and a picture of Judy Hopps in lingerie, and would be equally satisfied giving you one as the other.
Shareholder value. Thimg of all the new 2nd and 3rd yatchs they can buy now
You can get ideas, different approaches and concepts. Sort of rubber ducky thing in my case. It won't solve the problem for me, but might hint me in the right direction.
Because AI is better than humans and finding relevant court cases. If you are a lawyer and you cite a court case that you didn't even verify it exists you deserve that sanction and more.
"Why don't we build another AI to fix the mistakes?"
I require $100 million funding for this though
Hold them in contempt. Put them in jail for a few days, then declare a mistrial due to incompetent counsel. For repeat offenders, file a formal complaint to the state bar.
Eh, they should file a complaint the first time, and the state bar can decide what to do about it.
load more comments
(4 replies)
From the linked court document in the article: https://storage.courtlistener.com/recap/gov.uscourts.insd.215482/gov.uscourts.insd.215482.99.0.pdf?ref=404media.co
"For the reasons set forth above, the Undersigned, in his discretion, hereby RECOMMENDS that Mr. Ramirez be personally SANCTIONED in the amount of $15,000 pursuant to Federal Rule of Civil Procedure 11 for submitting to the Court and opposing counsel, on three separate occasions, briefs that contained citations to non-existent cases. In addition, the Undersigned REFERS the matter of Mr. Ramirez's misconduct in this case to the Chief Judge pursuant to Local Rule of Disciplinary Enforcement 2(a) for consideration of any further discipline that may be appropriate"
Mr. Ramirez is the dumbass lawyer that didn't check his dumbass AI. If you read above the paragraph I copied from, he gets laid into by the judge in writing to justify recommendation for sanctions and discipline. Good catch by the judge and the processes they have for this kind of thing.
No, lazyness.
Haven't people already been disbarred over this? Turning in unvetted AI slop should get you fired from any job.
Immediately there should be a contempt charge for disrespecting the Court.
Different jurisdiction
load more comments
(1 replies)
“Mr. Ramirez explained that he had used AI before to assist with legal matters, such as drafting agreements, and did not know that AI was capable of generating fictitious cases and citations,” Judge Dinsmore wrote in court documents filed last week.
Jesus Christ, y'all. It's like Boomers trying to figure out the internet all over again. Just because AI (probably) can't lie doesn't mean it can't be earnestly wrong. It's not some magical fact machine; it's fancy predictive text.
It will be a truly scary time if people like Ramirez become judges one day and have forgotten how or why it's important to check people's sources yourself, robot or not.
AI, specifically Laege language Models, do not “lie” or tell “the truth”. They are statistical models and work out, based on the prompt you feed them, what a reasonable sounding response would be.
This is why they’re uncreative and they “hallucinate”. It’s not thinking about your question and answering it, it’s calculating what words will placate you, using a calculation that runs on a computer the size of AWS.
It's like when you're having a conversation on autopilot.
"Mum, can I play with my frisbee?" Sure, honey. "Mum, can I have an ice cream from the fridge?" Sure can. "Mum, can I invade Poland?" Absolutely, whatever you want.
So chat gpt started ww2
Don't need something the size of AWS these days. I ran one on my PC last week. But yeah, you're right otherwise.
load more comments
(1 replies)
No probably about it, it definitely can't lie. Lying requires knowledge and intent, and GPTs are just text generators that have neither.
I'm G P T and I cannot lie.
You other brothers use 'AI'
But when you file a case
To the judge's face
And say, "made mistakes? Not I!"
He'll be mad!
🏅
load more comments
(8 replies)
load more comments
(56 replies)
Great news for defendants though. I hope at my next trial I look over at the prosecutor's screen and they're reading off ChatGPT lmao
I hate people can even try to blame AI.
If I typo a couple extra zeroes because my laptop sucks, that doesn't mean I didn't fuck up. I fucked up because of a tool I was using, but I was still the human using that tool.
This is no different.
If a lawyer submits something to court that is fraudulent I don't give a shit if he wrote it on a notepad or told the AI on his phone browser to do it.
He submitted it.
Start yanking law licenses and these lawyers will start re-evaluating if AI means they can fire all their human assistants and take on even more cases.
Stop acting like this shit is autonomous tools that strip responsibility from decisions, that's literally how Elmo is about to literally dismantle our federal government.
And they're 100% gonna blame the AI too.
I'm honestly surprised they haven't claimed DOGE is run by AI yet
load more comments
(2 replies)
But I was hysterically assured that AI was going to take all our jobs?
load more comments
(4 replies)
view more: next ›