If you are lurker please help us grow the community by commenting and posting interesting on topic quality info/discussions so we can attract more people and make this community more interesting to spend time on. ✌️

Previous milestone: https://lemmy.fmhy.ml/post/455602

Title, how much longer will I have to wait until I can buy a body for an AI GF?

To me, they would just have to be a bit better than our current 'best' ai, capable of remembering past conversations forever, and able to draw upon past interactions it had between each other to continually evolve its personality.

The Body can either be a full on robot-with little to no human characteristics to avoid the uncanny valley or near perfect human-like to pass the uncanny valley.

As Reddit chases after a legacy social media model are they killing the golden goose they intend on selling? Large Language Models and Machine Learning does a great job of locking the processes and feedback loops. What will that mean for how we build these models in the future and should we do more to consider where they are being trained before applying them to our lives?

AUISHfHAFhASIOUDBASDH;uAS :)

https://sizhean.github.io/panohead

https://arxiv.org/abs/2303.13071

About 40 people gathered in downtown Charlottetown Friday to urge the federal government to fund a basic income for Islanders.

As they gathered outside the Coles building, demonstrators encouraged passers-by to sign a petition in support of a universal basic income, which has been discussed on P.E.I. for years.

While the idea has support from all the parties, provincial governments have said they can't move on a livable income program without funding from Ottawa.

"Obviously the ideal would be to have both groups come together, the federal and provincial governments, to be able to support this. Because that's going to be able to make it the most successful. But if the feds won't come on board, then we'll definitely be pressuring the provincial government," said Michelle Neill, leader of the P.E.I. NDP and rally organizer.

"It's about helping people live a dignified life and that's what we need here on P.E.I.," she said.

Neill says recent inflation has made many Islanders' financial situation worse than it was when the motion was first passed.

She said there's a growing number of people who are unhoused, or barely making enough to pay rent.

https://hackaday.com/2023/06/12/blind-camera-visualizing-a-scene-from-its-sounds-alone/

https://www.trujillodiego.com/work/blindCamera/

Quick Read: https://www.marktechpost.com/2023/06/22/from-sound-to-sight-meet-audiotoken-for-audio-to-image-synthesis/

Paper: https://arxiv.org/abs/2305.13050

Abstract:

Connections between neurons can be mapped by acquiring and analyzing electron microscopic (EM) brain images. In recent years, this approach has been applied to chunks of brains to reconstruct local connectivity maps that are highly informative, yet inadequate for understanding brain function more globally. Here, we present the first neuronal wiring diagram of a whole adult brain, containing 5x10^7 chemical synapses between ~130,000 neurons reconstructed from a female Drosophila melanogaster. The resource also incorporates annotations of cell classes and types, nerves, hemilineages, and predictions of neurotransmitter identities. Data products are available by download, programmatic access, and interactive browsing and made interoperable with other fly data resources. We show how to derive a projectome, a map of projections between regions, from the connectome. We demonstrate the tracing of synaptic pathways and the analysis of information flow from inputs (sensory and ascending neurons) to outputs (motor, endocrine, and descending neurons), across both hemispheres, and between the central brain and the optic lobes. Tracing from a subset of photoreceptors all the way to descending motor pathways illustrates how structure can uncover putative circuit mechanisms underlying sensorimotor behaviors. The technologies and open ecosystem of the FlyWire Consortium set the stage for future large-scale connectome projects in other species.

It was recently reported that Valve has been banning any Steam games if its’ programs detect AI generated art, unless those submitting the title can prove ownership of the intellectual property. This information comes from Twitter user, @simoncarless, who posted an excerpt from a Steam denial template. The post says the following:

“After reviewing, we have identified intellectual property in [Game Name Here] which appears to belongs to one or more third parties. In particular, [Game Name Here] contains art assets generated by artificial intelligence that appears to be relying on copyrighted material owned by third parties.”

“As the legal ownership of such Al-generated art is unclear, we cannot ship your game while it contains these Al-generated assets, unless you can affirmatively confirm that you own the rights to all of the IP used in the data set that trained the Al to create the assets in your game.”

“We are failing your build and will give you one (1) opportunity to remove all content that you do not have the rights to from your build. If you fail to remove all such content, we will not be able to ship your game on Steam, and this app will be banned.”

At the end of every year, we give our AGI, ASI, and Singularity predictions.

We are now halfway through the year, and I think we should jump the gun a little bit and give our predictions.

Back on December 30, 2022, I said AGI 2030, ASI 2040, Singularity 2050. This is most probably going to age like milk.

Today, on July 1, 2023, I will say AGI 2028, ASI 2035, Singularity 2036.

What are your AGI, ASI, and Singularity predictions? Also, let us know if your timelines have shrunk in the last 6 months.

Abstract:

Though the advancement of pre-trained large language models unfolds, the exploration of building a unified model for language and other multimodal data, such as motion, remains challenging and untouched so far. Fortunately, human motion displays a semantic coupling akin to human language, often perceived as a form of body language. By fusing language data with large-scale motion models, motion-language pre-training that can enhance the performance of motion-related tasks becomes feasible. Driven by this insight, we propose MotionGPT, a unified, versatile, and user-friendly motion-language model to handle multiple motion-relevant tasks. Specifically, we employ the discrete vector quantization for human motionand transfer 3D motion into motion tokens, similar to the generation process ofword tokens. Building upon this “motion vocabulary”, we perform language modeling on both motion and text in a unified manner, treating human motion as a specific language. Moreover, inspired by prompt learning, we pre-train MotionGPT with a mixture of motion-language data and fine-tune it on prompt-based question-and-answer tasks. Extensive experiments demonstrate that MotionGPT achieves state-of-the-art performances on multiple motion tasks including text-driven motion generation, motion captioning, motion prediction, and motion in-between.

Website: https://motion-gpt.github.io/

Paper: https://arxiv.org/abs/2306.14795

Github: https://github.com/OpenMotionLab/MotionGPT

If you are lurker please help us grow the community by commenting and posting interesting on topic quality info/discussions so we can attract more people and make this community more interesting to spend time on. ✌️

Previous milestone: https://lemmy.fmhy.ml/post/322564

Next goal: 550 subs

Welcome to the FOSAI Nexus!

(v0.0.1 - Summer 2023 Edition)

The goal of this knowledge nexus is to act as a link hub for software, applications, tools, and projects that are all FOSS (free open-source software) designed for AI (FOSAI).

If you haven't already, I recommend bookmarking this page (the native one on lemmy.world). It is designed to be periodically updated in new versions I release throughout the year. This is due to the rapid rate in which this field is advancing. Breakthroughs are happening weekly. I will try to keep up through the seasons while including links to each sequential nexus post - but it's best to bookmark this since it will be the start of the content series, giving you access to all future nexus posts as I release them.

If you see something here missing that should be added, let me know. I don't have visibility over everything. I would love your help making this nexus better. Like I said in my welcome message, I am no expert in this field, but I teach myself what I can to distill it in ways I find interesting to share with others.

I hope this helps you unblock your workflow or project and empowers you to explore the wonders of emerging artificial intelligence.

Consider subscribing to /c/FOSAI if you found any of this interesting. I do my best to make sure you stay in the know with the most important updates to all things free open-source AI.

Find Us On Lemmy!

[email protected]

---

Fediverse Resources

Lemmy

• Your Lemmy Crash Course to Free Open-Source AI

• [email protected]

---

Large Language Model Hub

Download Models

oobabooga

text-generation-webui - a big community favorite gradio web UI by oobabooga designed for running almost any free open-source and large language models downloaded off of HuggingFace which can be (but not limited to) models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and many others. Its goal is to become the AUTOMATIC1111/stable-diffusion-webui of text generation. It is highly compatible with many formats.

Exllama

A standalone Python/C++/CUDA implementation of Llama for use with 4-bit GPTQ weights, designed to be fast and memory-efficient on modern GPUs.

gpt4all

Open-source assistant-style large language models that run locally on your CPU. GPT4All is an ecosystem to train and deploy powerful and customized large language models that run locally on consumer-grade processors.

TavernAI

The original branch of software SillyTavern was forked from. This chat interface offers very similar functionalities but has less cross-client compatibilities with other chat and API interfaces (compared to SillyTavern).

SillyTavern

Developer-friendly, Multi-API (KoboldAI/CPP, Horde, NovelAI, Ooba, OpenAI+proxies, Poe, WindowAI(Claude!)), Horde SD, System TTS, WorldInfo (lorebooks), customizable UI, auto-translate, and more prompt options than you'd ever want or need. Optional Extras server for more SD/TTS options + ChromaDB/Summarize. Based on a fork of TavernAI 1.2.8

Koboldcpp

A self-contained distributable from Concedo that exposes llama.cpp function bindings, allowing it to be used via a simulated Kobold API endpoint. What does it mean? You get llama.cpp with a fancy UI, persistent stories, editing tools, save formats, memory, world info, author's note, characters, scenarios, and everything Kobold and Kobold Lite have to offer. In a tiny package around 20 MB in size, excluding model weights.

KoboldAI-Client

This is a browser-based front-end for AI-assisted writing with multiple local & remote AI models. It offers the standard array of tools, including Memory, Author's Note, World Info, Save & Load, adjustable AI settings, formatting options, and the ability to import existing AI Dungeon adventures. You can also turn on Adventure mode and play the game like AI Dungeon Unleashed.

h2oGPT

h2oGPT is a large language model (LLM) fine-tuning framework and chatbot UI with document(s) question-answer capabilities. Documents help to ground LLMs against hallucinations by providing them context relevant to the instruction. h2oGPT is fully permissive Apache V2 open-source project for 100% private and secure use of LLMs and document embeddings for document question-answer.

---

Image Diffusion Hub

Download Models

StableDiffusion

Stable Diffusion is a text-to-image diffusion model capable of generating photo-realistic and stylized images. This is the free alternative to MidJourney. It is rumored that MidJourney originates from a version of Stable Diffusion that is highly modified, tuned, then made proprietary.

SDXL (Stable Diffusion XL)

With Stable Diffusion XL, you can create descriptive images with shorter prompts and generate words within images. The model is a significant advancement in image generation capabilities, offering enhanced image composition and face generation that results in stunning visuals and realistic aesthetics.

ComfyUI

A powerful and modular stable diffusion GUI and backend. This new and powerful UI will let you design and execute advanced stable diffusion pipelines using a graph/nodes/flowchart-based interface.

ControlNet

ControlNet is a neural network structure to control diffusion models by adding extra conditions. This is a very popular and powerful extension to add to AUTOMATIC111's stable-diffusion-webui.

TemporalKit

An all-in-one solution for adding Temporal Stability to a Stable Diffusion Render via an automatic1111 extension. You must install FFMPEG to path before running this.

EbSynth

Bring your paintings to animated life. This software can be used in conjunction with StableDiffusion + ControlNet + TemporalKit workflows.

WarpFusion

A TemporalKit alternative to produce video effects and animation styling.

---

Training & Education

LLMs

• Oobabooga's text-generation-webui

• Axolotl

• OpenAI Cookbook

• AemonAlgiz

Diffusers

• enigmatic_e

• Albert Bozesan

• ControlNet Tutorial

• Stable Diffusion + ControlNet + TemporalKit + EbSynth Workflow

• Stable Diffusion + Warp Fusion Workflow

---

Bonus Recommendations

AI Business Startup Kit

LLM Learning Material from the Developer of SuperHOT (kaiokendev):

Here are some resources to help with learning LLMs:

Andrej Karpathy’s GPT from scratch

Huggingface’s NLP Course

And for training specifically:

Alpaca LoRA

Vicuna

Community training guide

Of course for papers, I recommend reading anything on arXiv’s CS - Computation & Language that looks interesting to you: https://arxiv.org/list/cs.CL/recent.

---

Support Developers!

Please consider donating, subscribing to, or buying a coffee for any of the major community developers advancing Free Open-Source Artificial Intelligence.

If you're a developer in this space and would like to have your information added here (or changed), please don't hesitate to message me!

TheBloke

• https://www.patreon.com/TheBlokeAI

Oobabooga

• https://ko-fi.com/oobabooga

Eric Hartford

• https://erichartford.com/

kaiokendev

• https://kaiokendev.github.io/

---

Major FOSAI News & Breakthroughs

• (June 2023) MPT-30B: Raising the bar for open-source foundation models

• (May 2023) Google "We Have No Moat, And Neither Does OpenAI"

• (May 2023) Introducing MPT-7B: A New Standard for Open-Source, Commercially Usable LLMs

• (March 2023) OpenAI Releases Chat-GPT 4

• (November 2022) OpenAI Releases Chat-GPT 3

• (December 2017) Attention Is All You Need

Copied from reddit:

Not a lot of new information, but more discussion on Gemini and what it is going to focus on. It sounds like there's an emphasis on combining Reinforcement Learning with LLMs, but also a few other advancements they are keeping close to their chest. Relevant excerpts:

But Hassabis says his team will combine that technology with techniques used in AlphaGo, aiming to give the system new capabilities such as planning or the ability to solve problems. “At a high level you can think of Gemini as combining some of the strengths of AlphaGo-type systems with the amazing language capabilities of the large models,” Hassabis says. “We also have some new innovations that are going to be pretty interesting.” Gemini was first teased at Google's developer conference last month, when the company announced a raft of new AI projects.

...

Gemini is still in development, a process that will take a number of months, Hassabis says. It could cost tens or hundreds of millions of dollars. Sam Altman, OpenAI CEO, said in April that creating GPT-4 cost more than $100 million.

I do wonder what they will introduce. Maybe a memory system like what was seen in Retro, or maybe even some sort of continual learning paradigm that makes it easier to update? Time will tell