Clustering Sensor Data for Physical AI. Newton, our physical AI foundation model, learns to group sensor data into coherent clusters without the need for explicit labels. The image represents high-dimensional sensor embeddings of the AI model projected into two dimensions. The clusters highlight the model's ability to automatically identify patterns and relationships, directly from the data. Physical AI is transforming how we interpret and utilize sensor data! Stay tuned for more updates on our research.
Archetype AI
Technology, Information and Internet
Palo Alto, California 4,059 followers
Helping humanity make sense of the world with Physical AI
About us
We are a Physical AI company pioneering a new form of artificial intelligence that is capable of perceiving, understanding, and reasoning about the world. We solve real world problems using the power of AI to reveal the world’s hidden patterns and behaviors that escape our perception. Our vision is to encode the entire physical world. To achieve this, we are building Newton™, the first foundation model that can understand the physical world. Newton fuses multimodal temporal data – including signals from accelerometers, gyroscopes, radars, cameras, microphones, thermometers and other environmental sensors – with natural language to unlock insights about the physical world in real time.
- Website
-
https://www.archetypeai.io/
External link for Archetype AI
- Industry
- Technology, Information and Internet
- Company size
- 11-50 employees
- Headquarters
- Palo Alto, California
- Type
- Privately Held
- Founded
- 2023
- Specialties
- Physical AI
Locations
-
Primary
Get directions
3340 Hillview Ave
Palo Alto, California 94304, US
Employees at Archetype AI
-
Ivan Poupyrev, Dr.
Founder and CEO, Archetype AI / Scientist and Engineer / Technology and Innovation Executive / National Design Award Winner
-
Leonardo Giusti
-
Ethan Batraski
Partner at Venrock, early stage developer-first venture capital
-
Brandon Barbello
Founder and COO, Archetype AI
Updates
-
Curious about how AI can decode the complexities of our physical environment? #Newton, our AI foundation model, showcases its ability to make contextual judgments and understand its surroundings in real time, differentiating between various spaces and environments. Newton can even respond with icons, making interactions more intuitive! 🛏️ (bedroom) 🛋️ (living room) 🍳 (kitchen) This can be leveraged in many industries in the future — for example, real estate: 🔑 Newton can detail property layouts and features, offering a new way to explore spaces. 🔑 Newton can highlight features and key amenities — for example, in real estate, saving time on walkthroughs and putting listings together. Follow us for more demos on Newton's potential to solve real-world problems.
-
"Archetype's AI approach has some interesting consequences. It means that natural language becomes a translation layer used to both interpret input (i.e., sensing) and to issue commands (e.g., controlling a robot arm). The semantic “understanding” built into the LLM also makes certain tasks easier, such as prediction and anomaly detection." Great summary from Llewyn Paine, Ph.D. about Leonardo Giusti's presentation on physical AI and Newton, our large behavior Model (LBM).👇
Product strategy consultant | Helping emerging tech & innovation discover the right users | Spatial computing | Physical AI
Startup Archetype AI is fusing physical sensor data with LLMs to create an #AI model that will "encode the entire physical world." The recent surge of interest in LLMs has kicked off important (but less visible) conversations about AI that can make sense of real-world objects. Archetype AI is approaching this question through creation of a "large behavior model" that brings together sensors and LLMs. I recently attended a talk by Leonardo Giusti, founder of Archetype AI, where he shared why they think this is the right approach. Archetype AI’s founders have roots in #IoT. They’re known for Project Soli, which enabled gesture-based interactions for Google smartphones based on machine learning (ML)–but which encountered problems of scale. According to Giusti, training an ML model to reliably identify gestures can require millions of samples from participants all around the world. And this training process has to be repeated for each new device or sensor you want to use. Archetype AI aims to solve this problem by mapping sensor data to LLMs, enabling them to capitalize on LLMs’ scalability. This approach has some interesting consequences. It means that natural language becomes a translation layer used to both interpret input (i.e., sensing) and to issue commands (e.g., controlling a robot arm). The semantic “understanding” build into the LLM also makes certain tasks easier, such as prediction and anomaly detection. Personally, I’m quite excited about their work, but my one complaint is that it isn’t very accessible. This is often unavoidable with early-stage tech, but it leads me to ask: what can a regular person do to start experimenting with and preparing for this type of tech? You can, of course, request early access at their website, and perhaps start playing around with it yourself if you’re approved (and are an engineer). But even if you’re not, there are other steps you can take: 1️⃣ Learn about material exploration (a technique for exploring the capabilities and constraints of new-to-you materials and technologies) 2️⃣ Brush up on observational user research methods (which are critical for understanding humans’ physical behaviors and workflows) 3️⃣ Explore adjacent technologies (such as sensors/IoT, multimodal AI models, and LLMs–especially in applications that are trying to make output more contextual) I believe we’re going to see a lot more physical AI-type models in the near future, and now is a good time to begin preparing. If you’re looking to figure out what this means for your users, we should talk. #spatialcomputing
-
-
Great example of the rapidly decreasing cost of implementing real-time AI systems from OpenAI Join Archetype AI as we advance not only what is possible with real-time digital experiences but also bring real-time AI directly into the real world to positively impact numerous industries and applications. #physicalAI
We’re continuing to make advanced AI accessible to all with the launch of GPT-4o mini, our most intelligent and affordable small model. Now available in the API and rolling out in ChatGPT today.
-
Curious about how AI can decode the complexities of the physical world? Check out our demo showcasing Newton, our physical AI foundation model. In the video, we highlight Newton's ability to make contextual judgments and understand its environment. #Newton is shown differentiating between various spaces and ambient environments, showing how it perceives objects differently in different contexts. Watch until the end to see how Newton can differentiate between safe and dangerous scenarios, even when the same object is involved! (e.g., a knife can have very different meanings inside a kitchen vs outside a kitchen) Follow us to stay tuned for more demos showcasing the potential of AI to solve real-world problems.
-
"Physical AI is not just about collecting more data, but about analyzing it at scale. AI is the technology that can help us make sense of this data and optimize these projects, reducing waste, increasing speed, and lowering costs. It's not just about having more data, but about connecting different types of data together and placing it in context to unlock its true value." - Ivan Poupyrev, Dr. , co-founder and CEO of Archetype AI, discussed the potential of AI to understand the physical world on Jason Calacanis podcast "This Week in Startups." Join Ivan and Jason as they explore the real-world applications of AI and discuss how it will change the way different industries approach complex projects, from construction and healthcare to infrastructure and beyond. full episode 👉
Pioneering physical AI with Archetype AI’s Ivan Poupyrev | E1951
https://www.youtube.com/
-
Could Telcos become more than just conduits for data? Nick Gillian, Co-Founder & Head of AI at Archetype AI, contributed to this thought-provoking article by Jim Brisimitzis, "AI and 5G: A force Multiplier, or Lost Opportunity." This in-depth piece explores how the integration of Artificial Intelligence with 5G technology is set to improve industries worldwide, unlocking unprecedented advancements and efficiencies. In the article, Jim specifically mentions Archetype AI's pioneering work in leveraging #physicalAI to transform the data from any real-world sensor into value, turning security cameras from mere video recorders into intelligent safety monitors that can understand and act, expanding every CO2 sensor into a respiratory health monitor, among other applications. Read this article to learn how Telcos can play a crucial role in this digital transformation 🖇 https://lnkd.in/gSGSDMQZ
AI and 5G
jimbrisi.medium.com
-
Ever wondered how AI can transform Telco networks? Check out this insightful piece by Jim Brisimitzis from Khasm Labs on the transformative potential of AI at the edge, powered by on-prem compute and private 5G networks. It outlines the potential for a new AI reference architecture that aims to bring AI compute closer to users and unlock untapped opportunities for Telcos within the software ecosystem. Archetype AI demoed this reference architecture at the Khasm Labs #SummerSocial yesterday, alongside Radium, Graphiant, and partners like Accenture, Amdocs, and Dell Technologies. Some key takeaways from Jim’s blog: 📱 AI is driving a new "AI Infrastructure" cycle, potentially reshaping mobile app experiences. It is also creating significant compute traffic and, thus, new opportunities for local, lightweight AI computation. Providing this computation could be an opportunity for Telco networks. 🌐 He points to some of Archetype AI’s recent demos as early examples of what’s becoming possible: * Package handling analysis using accelerometer data * Step-by-step process guidance for complex tasks * "Vibe" detection at home using smartphone camera video 📡 He says Archetype AI's platform could help Telcos provide custom fine-tuned physical AI foundation models for their enterprise customers. This piece underscores the exciting possibilities at the intersection of AI, 5G, and edge devices. How do you see AI transforming connectivity? Read the full article and stay tuned for more product updates: https://lnkd.in/grudJDE3
AI and 5G
jimbrisi.medium.com
-
We are thrilled to have participated in Plug and Play Tech Center 2024 Maritime Expo in Antwerp as one of their top AI startups. Brandon Barbello, cofounder and COO, represented Archetype AI, showcasing our large behavior model, Newton, and our physical AI solutions. Our mission is to empower everyone to leverage physical AI to solve real world problems. It was great to meet so many industry experts face-to-face, and it's exciting to see the potential for impact in sectors like Logistics, Decarbonization, and Maritime Infrastructure. Watch Brandon's interview about Archetype AI 👇