31337

I'm loading up on vacuum tubes.

Last time I looked it up and calculated it, these large models are trained on something like only 7x the tokens as the number of parameters they have. If you thought of it like compression, a 1:7 ratio for lossless text compression is perfectly possible.

I think the models can still output a lot of stuff verbatim if you try to get them to, you just hit the guardrails they put in place. Seems to work fine for public domain stuff. E.g. "Give me the first 50 lines from Romeo and Juliette." (albeit with a TOS warning, lol). "Give me the first few paragraphs of Dune." seems to hit a guardrail, or maybe just forced through reinforcement learning.

A preprint paper was released recently that detailed how to get around RL by controlling the first few tokens of a model's output, showing the "unsafe" data is still in there.

He can use his money to support challengers in their next elections. He's already said he's going to do this to the Democrats. As we've seen with AIPAC recently, it doesn't take much money to unseat politicians. Musk has enough money to basically control congress.

I've noticed a lot of very old Paris videos were removed this year. Not sure why. Google/YouTube seems to be heavily demoting them as well, because some songs don't show up in video search results at all, and you can only find them if you search for the album.

Looked it up, and looks like a local criminal justice reform non-profit bailed him out earlier this year. Looks like he's still awaiting trial though, is on an ankle monitor, and they keep resetting dismissal hearing dates.

Yeah, the company I was working at got bought out and then they layed the entire tech team and pretty much everyone else. Co-founded a business with coworkers, but it's not bringing in any revenue and not sure it ever will bring in very much, so have been applying to jobs. Only got a few interviews, then ghosted afterwards. I'm guessing a part of it is I have a criminal charge pending, and the first thing you see on Google when you search my name and town is one of those mugshot websites. Maybe I should go into construction, lol.

Yeah, the criminal justice system in the U.S. causes immeasurable harm. From a probation system designed to keep you in the system, to kids-for-cash-like schemes that I'm convinced are more common than has been prosecuted, to coercive delay tactics. All of which I have personal experience with. I've currently been out on bail for 2 years, and someone else in my county has been in jail without trial for 5 years because he can't afford bail. Not to mention the horrible conditions in many jails and prisons, slave labor, nearly complete lack of rehabilitation, and the system milking the incarcerated's families for money. I can't think of any other word to describe it than evil.

I think it's real. Though, it is kinda suspicious they were able to respond so fast to a McDonald's tip; could've been parallel construction.

I assume the leaders can be voted out? Maybe even a petitions for an immediate election or specific ballot measures? I'm not sure what typical union rules allow. I've worked a shitty union job for a little bit, and I think the problem is with low-paying, high turnover jobs, people don't really care about the job enough to participate in union functions (at least I didn't, and nobody else I worked with did). So, I think you just get the union catering to the high-seniority people who do participate, and then there's probably also corruption up top.

I think TikTok appeased the right by changing their algorithm. Charlie Kirk is apparently doing extremely well on the platform now.