AI Stuff

Coverage:

• A New Attack Impacts Major AI Chatbots—and No One Knows How to Stop It - Wired
• Researchers discover new vulnerability in large language models - TechXplore
• Keeping the Baby While Losing the Bathwater: AI’s Efficiencies and Concerns Collide - Pymnts

He has worked closely with a group of researchers building Google’s long-awaited AI model Gemini. They have discussed technical matters such as “loss curves,” a way of measuring an AI program’s performance over time, and Brin has convened weekly discussions of new AI research with Google employees. He also has intervened in personnel matters, such as the hiring of sought-after researchers, the people said.

Brin’s increased presence at Google reflects the pivotal moment in AI and his longstanding interest in the technology, which Google pioneered but was slower than rivals to turn into new products, said current and former employees.

cross-posted from: https://lemdro.id/post/161078

WSJ News Exclusive | Sergey Brin Is Back in the Trenches at Google Miles Kruppa and Deepa Seetharaman 8–10 minutes

Co-founder is working alongside AI researchers at tech giant’s headquarters, aiding efforts to build powerful Gemini system

Google co-founder Sergey Brin is back at work.

The multibillionaire has been visiting the tech giant’s Mountain View, Calif., offices in recent months generally three to four days a week, working alongside researchers as they push to develop the company’s next large artificial-intelligence system.

Brin participated in meetings about AI at Google’s offices late last year, but the frequency and intensity of his involvement has picked up, said people familiar with the matter. His new stance is a notable change from the relatively hands-off approach he adopted after stepping down from an executive role at parent company Alphabet GOOG 0.65%increase; green up pointing triangle in 2019.

He has worked closely with a group of researchers building Google’s long-awaited AI model Gemini. They have discussed technical matters such as “loss curves,” a way of measuring an AI program’s performance over time, and Brin has convened weekly discussions of new AI research with Google employees. He also has intervened in personnel matters, such as the hiring of sought-after researchers, the people said.

Brin’s increased presence at Google reflects the pivotal moment in AI and his longstanding interest in the technology, which Google pioneered but was slower than rivals to turn into new products, said current and former employees.

Competition is intensifying in AI research, with recent new offerings from companies including Meta Platforms. Google sped up product development in response to last year’s release of ChatGPT, an AI chatbot that can respond fluently to a range of written queries, by the Microsoft-backed research company OpenAI.

Gemini is Google’s attempt to build a general-purpose AI program that can rival OpenAI’s GPT-4 model, which powers a paid version of ChatGPT. Demis Hassabis, the Google executive overseeing the project, told employees during a recent companywide meeting that the program would become available later this year, according to people who heard the remarks.

Brin, 49 years old, started Google with Larry Page in 1998 based on web search research they worked on together as Stanford University doctoral students.

While Brin has been an occasional presence at Google headquarters in recent years, his attention had been largely directed toward outside interests such as airships and new forms of disaster aid, along with efforts to give away portions of his considerable wealth. He is Alphabet’s second-largest individual shareholder behind Page, with a stake valued at close to $90 billion, according to S&P Capital IQ data.

Shares in Alphabet have risen more than 10% since Google announced an array of AI-infused products at its annual developer conference in May, including a new version of the core search engine that provides lengthy summaries and invites follow-up questions. That increase is roughly in line with rival Microsoft’s share price and the broader Nasdaq Composite Index.

Brin has spent much of his time sitting alongside Mountain View-based AI researchers at the newly constructed Charleston East building, a short walk from the original heart of Google’s corporate campus, said people familiar with the matter. Sundar Pichai, chief executive of both Google and Alphabet, also has an office in the building.

When the founders stepped back from their daily roles four years ago and elevated Pichai to Alphabet CEO, they said they would speak with him regularly and offer “advice and love, but not daily nagging.” They still control a majority of Alphabet voting power and sit on an executive board committee with Pichai.

Pichai is excited about Brin’s involvement and has encouraged his contributions, according to a person familiar with his thinking.

Google had a head start on artificial intelligence, forming a research unit in 2011 called Brain to investigate how a computing technique called deep learning could be used to build widely useful AI programs.

Pichai merged the Brain team this year with DeepMind, an AI research company that previously operated independently under the Alphabet umbrella. The shake-up elevated Hassabis, a co-founder of DeepMind, to CEO of the combined group Google DeepMind.

Some researchers have embraced Brin’s involvement, viewing it as an endorsement of their work and a helpful intervention during a transitional period for the AI teams, said current and former employees. Hassabis and many Google DeepMind executives work from London, making that office a de facto power center in the new setup.

Brin’s involvement has ramped up since the release of ChatGPT in November. Google’s co-founders sat in on meetings to review AI products Google was preparing for its developer conference in May, said people familiar with the matter, a development earlier reported by the New York Times.

Brin has since maintained a strong presence at Google’s headquarters, making appearances at research gatherings and company celebrations. Google said Brin doesn’t have a formal new role at the company beyond being a co-founder and board member. A spokeswoman for Brin didn’t respond to a request for comment.

Whereas Page was sometimes a reclusive figure during his time running Google, Brin cultivated a more accessible persona, traversing the headquarters on roller skates and moving between the company’s far-flung projects.

Since the AI boom last year, Brin has attended a launch party for the company that popularized the image-generation program Stable Diffusion and occasionally attends events at a $68 million mansion in Hillsborough, Calif., known as the AGI House, said people who have interacted with him there. AGI stands for artificial general intelligence, the idea that computer programs could one day match human reasoning.

In March, Brin was photographed at Google headquarters with Pichai and Google’s president of global affairs Kent Walker during a visit from the prime minister of Luxembourg, dressed in gray sweatpants and a black long-sleeve shirt. The other attendees wore suits.

Brin’s work with Gemini is another layer in Google’s long-running efforts to build AI systems that can exhibit humanlike capabilities and more seamlessly meet the needs of the company’s billions of users.

At first Brin ignored the work of the Brain team and expressed skepticism that they could crack artificial intelligence, even though that group began in the Google X division he led, he said during an interview at the World Economic Forum in 2017.

“I didn’t pay attention to it at all, to be perfectly honest,” Brin said. A few years later, Brain’s research was used in many of Google’s largest products, he said, upending his previous assumptions.

Brin has focused in part on personnel issues, an area of difficulty for Google and other large tech companies as the talent wars for AI researchers intensifies. Multiple authors of a landmark 2017 Google paper credited with sparking the latest wave of AI development have left the company to raise hundreds of millions of dollars for competing startups.

Though he is one of the world’s most respected computer scientists, Brin has needed to catch up with the most recent developments in AI and hasn’t contributed significantly to coding projects, said current and former employees.

Brin promoted the possibilities of AI in his last shareholder letter, issued in 2018, writing that the “power and potential and potential of computation to tackle important problems has never been greater.”

“The new spring in artificial intelligence is the most significant development in computing in my lifetime,” he wrote.

cross-posted from: https://beehaw.org/post/6752986

A website called zleague.gg has been scraping Reddit threads, feeding them into an AI and publishing auto-generated summaries without proper oversight. World of Warcraft players on Reddit noticed this and created a fake thread about a made-up feature called Glorbo to trick the AI. The AI then published an article summarizing the fake Glorbo thread, showing that it was easily fooled. This highlights issues with AI-generated content crowding out human writers and the need for Google to better regulate such sites to ensure quality. The Glorbo prank provides an amusing example of how gaming communities can push back against AI overreach.

The main goal of minigpt4.cpp is to run minigpt4 using 4-bit quantization with using the ggml library.

https://github.com/Maknee/minigpt4.cpp

Crossposted from u/ElrasX.

The first comprehensive ML law, is expected to come into force by early 2024

The AI model startup is reviewing competing term sheets for a Series D round that could raise at least $200 million at a valuation of $4 billion, per sources.

Hugging Face is raising a new funding round that is expected to value the high-flying AI startup at $4 billion, multiple sources with knowledge of the matter tell Forbes.

The Series D funding round is expected to raise at least $200 million, two sources said, with Ashton Kutcher’s venture capital firm, Sound Ventures, currently leading an investor scrum. But cofounder and CEO Clément Delangue is shopping around as the company has received multiple offers this week, four sources added.

Delangue was expected to pick a preferred offer as soon as Friday, according to another source, who noted that the situation was still fluid, meaning no agreement has been reached, and the numbers involved could change. Several other sources, who asked to remain anonymous as they weren’t authorized to talk about the deal, said that Hugging Face could seek to raise more, as much as $300 million, while existing investors could still attempt to take the round in a last-minute bid. GV, the venture firm backed by Alphabet, and DFJ were said to be looking at the round, one source added.

Hugging Face didn’t respond to requests for comment. GV declined to comment. Coatue, DFJ, Kutcher, and Lux also didn’t respond.

The anticipated funding is the latest exclamation point in a cash frenzy for promising AI companies, particularly those providing large-language models, or LLMs, that power them. Just over a year ago, Hugging Face raised $100 million in a Series C round led by Lux Capital; Coatue and Sequoia were new investors in that round, joining A.Capital Ventures and Addition. The company had attained a $2 billion valuation in that round despite taking in less than $10 million in revenue in 2021. Its revenue run rate has spiked this year and now sits at around $30 million to $50 million, three sources said — with one noting that it had more that tripled compared to the start of the year.

Named after the emoji of a smiling face with jazz hands, Brooklyn-based Hugging Face has grown quickly by offering what Delangue has described as a “GitHub for machine learning.” It is a central company in a growing movement of AI models that are open sourced, meaning that anyone can access and modify them for free. Hugging Face makes money by charging for security and corporate tools on top of a hub of hundreds of thousands of models trained by its community of developers, including the popular Stable Diffusion model that forms the basis for another controversial AI unicorn, Stability AI. (On Thursday, a Stability AI cofounder sued CEO Emad Mostaque, alleging he was tricked into selling his stake for next to nothing.) Per a Forbes profile in 2022, Bloomberg, Pfizer and Roche were early Hugging Face customers.

Earlier this year, Delangue warned that model providers reliant on paying huge sums to Big Tech’s cloud providers would function as “cloud money laundering.” But training and maintaining models — and building enterprise-grade businesses around them — remains costly. In June, Inflection AI raised $1.3 billion, in part to manage its Microsoft compute and Nvidia hardware costs; the same month, foundation model rival Cohere raised $270 million. Anthropic, maker of the recently-released ChatGPT rival Claude 2, raised $450 million in May. OpenAI closed its own $300 million share sale in April, then raised $175 million for a fund to back other startups a month later, per a filing. Adept became a unicorn after announcing a $350 million fundraise in March. Stability AI, meanwhile, met with a number of venture firms in the spring seeking its own new up-round, industry sources said.

At a $4 billion valuation, Hugging Face would vault to one of the category’s highest-valued companies, matching Inflection AI and just behind Anthropic, reported to have reached closer to $5 billion. OpenAI remains the giant in the fast-growing category, Google, Meta and infrastructure companies like Databricks excluded; while its ownership and valuation structure is complex, the company’s previous financings implied a price tag in the $27 billion to $29 billion range.

Speaking for another Forbes story on the breakout moment for generative AI tools, Delangue predicted, “I think there’s potential for multiple $100 billion companies.”

Crossposted from /u/InevitableSky2801:

Want to start playing with Meta’s Llama 2?

It takes just 7 lines of shell script using llama.cpp to get you started!

Copy Code Snippet: https://lastmileai.dev/workbooks/clkbifegg001jpheon6d2s4m8

Redmond-Puffin-13B / Llama 2 Fine-tune

Download Links:

• https://huggingface.co/FPHam/Free_Sydney_13b_HF
• https://huggingface.co/FPHam/Free_Sydney_13b_GPTQ (slow on AutoGPTQ, fast on ExLLama)