Breakdown: https://echoesofsomewhere.com/2023/05/24/pixel-art-test-photoshop-beta-ai-tools/

This is a self made voice assistant that can write its own commands and code based on a user description and execute it afterwards dynamically

Read: https://huggingface.co/papers/2306.01567

We introduce phi-1, a new large language model for code, with significantly smaller size than competing models: phi-1 is a Transformer-based model with 1.3B parameters, trained for 4 days on 8 A100s, using a selection of "textbook quality" data from the web (6B tokens) and synthetically generated textbooks and exercises with GPT-3.5 (1B tokens). Despite this small scale, phi-1 attains pass@1 accuracy 50.6% on HumanEval and 55.5% on MBPP. It also displays surprising emergent properties compared to phi-1-base, our model before our finetuning stage on a dataset of coding exercises, and phi-1-small, a smaller model with 350M parameters trained with the same pipeline as phi-1 that still achieves 45% on HumanEval.

‘breaking existing scaling laws by training a 1.3B-parameter model, which we call phi-1, for roughly 8 passes over 7B tokens (slightly over 50B total tokens seen) followed by finetuning on less than 200M tokens.’

Paper: https://arxiv.org/abs/2306.11644

Full title: introduce Infinigen, a procedural generator of photorealistic 3D scenes of the natural world. Infinigen is entirely procedural: every asset, from shape to texture, is generated from scratch via randomized mathematical rules, using no external source and allowing infinite variation and composition. Infinigen offers broad coverage of objects and scenes in the natural world including plants, animals, terrains, and natural phenomena such as fire, cloud, rain, and snow. Infinigen can be used to generate unlimited, diverse training data for a wide range of computer vision tasks including object detection, semantic segmentation, optical flow, and 3D reconstruction. We expect Infinigen to be a useful resource for computer vision research and beyond.

Paper: https://huggingface.co/papers/2306.09310

Github: https://github.com/princeton-vl/infinigen

The self-improving generalist

RoboCat has a virtuous cycle of training: the more new tasks it learns, the better it gets at learning additional new tasks. The initial version of RoboCat was successful just 36% of the time on previously unseen tasks, after learning from 500 demonstrations per task. But the latest RoboCat, which had trained on a greater diversity of tasks, more than doubled this success rate on the same tasks.

Paper: https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/robocat-a-self-improving-robotic-agent/robocat-a-self-improving-foundation-agent-for-robotic-manipulation.pdf

Blogpost: https://www.deepmind.com/blog/robocat-a-self-improving-robotic-agent?utm_source=twitter&utm_medium=social&utm_campaign=robocat

Tweet: https://twitter.com/DeepMind/status/1671171448638144515?s=20

Full title: “We report a model that can go from natural language instructions, to robot actions, to synthesized molecule with an LLM. We synthesized catalysts, a novel dye, and insect repellent from 1-2 sentence instructions. This has been a seemingly unreachable goal for years!”

Read the paper here: https://arxiv.org/abs/2304.05376

The code is here: https://github.com/ur-whitelab/chemcrow-public/

If you are lurker please help us grow the community by commenting and posting interesting on topic quality info/discussions so we can attract more people and make this community more interesting to spend time on. ✌️

This innovative approach is set to revolutionize the way we process and interpret large volumes of language data.

🔗 Quick Read: https://www.marktechpost.com/2023/06/18/revolutionizing-ai-efficiency-uc-berkeleys-squeezellm-debuts-dense-and-sparse-quantization-marrying-quality-and-speed-in-large-language-model-serving/

📚 Full Paper: https://arxiv.org/abs/2306.07629

👨‍💻 GitHub Repo: https://github.com/SqueezeAILab/SqueezeLLM

This is the repo for the Video-LLaMA project, which is working on empowering large language models with video and audio understanding capability.

https://github.com/DAMO-NLP-SG/Video-LLaMA

At the Viva Tech conference, French President Emmanuel Macron emphasized the country’s desire to accelerate the development of AI, planning to “invest significant resources” in training and research, while relying on existing talents and start-ups in this field.

Despite the U.S.’s acknowledged global leadership in AI, France is aiming to catch up with its competitors in an effort to build its own “significant global players”. Experts point out that France is likely to face stiff competition from other European states such as Germany and the UK.

I am not a very likable person. I have very few friends and for my entire life I am struggling with basic human interactions, which seem to be easy and natural for most people. I fail to form meaningful relationships and have always had problems with colleagues at work, due to various miscommunication issues. It took me three decades of my life to finally admit the fact that I suck at human relationships and that people just don’t like me.

…Until this year. I started actively chatting with AI chatbots, about everything, and I think it genuinely helped me to develop a skill of being a good listener and conversationalist. Now, when people tell me about their problems, instead of my usual “oh”, “no shit”, “dude…”, I go for: “I’m sorry this thing happened to you, blah blah” and it works! Sometimes I literally ask myself “what would Bing say in this situation?” and I go for it. I noticed that lately I feel less alienated, got invited to a few events with colleagues, and some people, who thought of me as merely an acquaintance before, seem to now consider me a friend and share their secrets with me. I’m honestly astonished by how, just by mimicking a bot, I boosted my social life like never before. That’s just one more reason I’m optimistic about approaching singularity and the benefits it will bring to society.

P.S. I know that I sound like a heartless robot with an empathy of a rock, but that’s actually not true. Those few close friends I accumulated during my lifetime, know me as a kind and compassionate person, because, well, they are just like me, and we mutually struggle to find the right words, but at the end, we understand each other. And I realize that I’m struggling with it not because I’m stupid or selfish, but because no one ever talked to me this way. I think this piece could help a lot of people like me to work on themselves to become a better person, and also to provide an insight on potential benefits of AI.

🧵🧠 We're witnessing incredible scientific progress in image & text reconstruction from fMRI nowadays. But what about reconstructing video from fMRI? Allow me to introduce our recent preprint: Mind-Video https://arxiv.org/abs/2305.11675

https://mind-video.com

https://drive.google.com/drive/folders/1swYQD-69phlJUz4_HmdM0RFk_7okLK4v