- The Renaissance Times
- Posts
- Elon Musks's xAI Open Sources Grok
Elon Musks's xAI Open Sources Grok
Dear Artisan,
OpenAI might have the name, but it’s looking like every other AI company is beating them to open source their work… including Elon Musk.
But first, we have another announcement. Episode 2 of the AI Renaissance podcast is live! Today we talk to my good friend Zach Hawtof, CEO of Tightnit, a community-building platform powered by AI. Enjoy!
Hot Off The Press
Elon Musk’s xAI Open Sources its Foundation Model, Grok
Apple and Google May Partner to Integrate Gemini into iOS
Adobe Launches new AI Features in Substance 3D Product
Perplexity Looks Like a Google Search Wrapper
India Backing Off Plans to Require Approval to Launch AI Models
The One Big Thing
Elon Musk Delivers on Promise to Open Source Grok
It’s been a big week for Elon Musk.
First, SpaceX sent the heaviest flying object ever, Starship, into space further than it has ever gone before. He also announced that Grok, the foundation model being developed by xAI, would be open-sourced this week.
Yesterday, X delivered on that promise and open-sourced the code and parameters for the entire model. Let’s dive in.
The Basics:
Grok is a 314 billion-parameter “Mixture of Experts” Model,
Trained on 8 experts (of which 2 are active)
Base model is not fine-tuned, so it needs work from the open source community to be as functional as other models out today
Contains 4x more parameters than the 2nd largest model
So far, early performance testing shows that Grok is behind many other comparable models. This is to be expected at this stage, given that the model has not been fine-tuned.
As of yet there is limited information on the model itself or how it can be used in production. The most interesting piece of this is what open source developers actually choose to build with this new model.
If X decides to allow Grok to access real time data, it opens up a whole world of possibilities for information sharing. You can have the most up-to-date news in your pocket, distilled in any format, with live analysis running and automated triggers connected to agents that run tasks for you based on this information.
You don’t need to look too far to see how this completely changes the game. If Perplexity brings you AI + Search, Grok brings you AI + Live Data. This is a world I want to live in.
The Gallery
Sora demos are back and looking glorious
OpenAI keeps dropping more insane Sora videos
These are 100% AI generated
9 reality bending videos
1. Elephant made out of leaves
— Linus ●ᴗ● Ekenstam (@LinusEkenstam)
12:00 PM • Mar 18, 2024
Deepfakes are Getting Scary Good, Scary Fast
Deep fakes are becoming more and more realistic; we are entering a world indistinguishable from reality.
This version of Marc Andreessen has been entirely cloned with our technology (The Argil deepfake model)
Proof by image is dead.
— Brivael (@BrivaelLp)
9:53 AM • Mar 17, 2024
Devin is HIM
🤯 crazy exchange on @modal_labs slack between @cognition_labs 's Devin & modal's support team
— Raunak Chowdhuri (@raunakdoesdev)
6:22 PM • Mar 16, 2024
Deep Tech
The newest and coolest in the research world that you need to know about:
VideoAgent: Long-form Video Understanding with Large Language Model as Agent
Mistral-Evolved-11b-v0.1: An upscaling and continued training of the Mistral-7B-v0.1 AI model
Isotropic3D: Image-to-3D Generation Based on a Single CLIP Embedding
MusicHiFi: Fast High-Fidelity Stereo Vocoding. Fast, high-fidelity stereophonic vocoding for music generation
Closing Thought
If Grok can read X data I am ending this newsletter to build an X summarization tool
Work With Us!
The AI Renaissance is coming and we are building the best community of the people making it happen.
Contact us to sponsor your product or brand and reach the exact audience for your needs across our newsletter and podcast network.