AI

Brilliant Labs puts AI in front of your eye with its tiny open source AR lens

Comment

Man wearing Brilliant Labs Monocle, looking down
Image Credits: Brilliant Labs

Brilliant Labs’ augmented reality wearable stands in stark contrast to Apple’s pricey, bulky, stealthy Vision Pro. The startup’s inaugural product, Monocle, is an open source, pocket-sized AR lens that can be clipped on any eyewear or held to the eye, Launched in March, Monocle has a much more accessible price tag of $349.

“Other AR and VR headsets tend to keep you around your couch at home. We are running in the exact opposite direction,” said Bobak Tavangar, CEO and co-founder of Brilliant Labs, in an interview with TechCrunch.

To integrate its AR device into people’s daily life, Singapore-based Brilliant Labs aims to embed generative AI into its compact wearable. It’s raised some money to pursue this vision. Today, the startup announced its $3 million seed funding led by Brendan Iribe, co-founder of Oculus; Adam Cheyer, co-founder of Siri; Eric Migicovsky, founder of Pebble and former partner at Y Combinator; Plug & Play Ventures; among others.

An open approach

Monocle’s open-source community has already gained a dedicated following. In March, it went viral thanks to a group of Stanford students who transformed the eyepiece into a display for GPT-4. With the ability to listen to a user’s conversation through their phone’s microphone in real time, Monocle can generate personalized support, such as offering suggestions for what to say on a date.

The computing process happens on OpenAI’s server. The responses are then transmitted through Bluetooth from the user’s phone to Monocle and projected to the lens in front of the user’s eye.

Brilliant Labs has also developed a similar application in-house. The arGPT solution, as it’s called, is able to receive sound natively through Monocle’s mic and other sensors, enabling low-latency dialogue with GPT-4.

So far, Monocle has mostly attracted developers, hackers, hobbyists and researchers experimenting with the little palm-sized device, an approach that the founder believes can unleash the potential of fusing generative AI and AR.

“There is something important about allowing people to dig into [the AR device’s] heart and understand it and play with it and share that with others, not just passively receive something that’s the closed box that a few people far away have designed for the rest of us,” he said. “We think there’s something really philosophically important there.”

The challenge, of course, is how it branches out of the initial geeky customer base and comes up with a product that appeals to the broader consumer market.

A lightweight strategy

Monocle comes with five different processors, including a hackable field-programmable gate array (FPGA) accelerator chip that handles the data coming in from the device’s camera, microphone and capacitive touch sensor. The use of low-power electronics and miniaturized electronic parts, according to the founder, allows the lens to be compact and weigh only 15 grams.

“Every other device company was doing bulky, expensive headsets. They weren’t making money out of them,” said Tavangar. “This age of AI is upon us, and from day one — even before GPT — we saw a market opportunity with computer vision.”

At this stage, a smartphone is needed to act as a point of relay between Monocle and cloud-based AI apps. In the long term, however, the goal is to create a direct connection between the hardware and the cloud, doing away with the need for a phone host.

Eventually, the company’s vision is to run deep learning models directly on its tiny AR devices, which means even lower latency and functionality even if an internet connection is lost.

Brilliant Labs’ emphasis on a lightweight design extends to its management style. Despite being established in 2019, the startup is still run solely by its three co-founders, which makes one wonder why other mixed reality device makers need hundreds if not thousands of staff. There are signs of overhiring. In February 2021, as many as 200 people were affected during a layoff at Pico, a VR company acquired by ByteDance.

Tavangar attributes his management style to his time at Apple, where he worked as a program lead. He believes that focus is key, and that success comes from choosing one idea to pursue out of hundreds of potential options.

“How do you do really lightweight, affordable, focused hardware to deliver that AI-powered experience? [We are not chasing] the graphical intensity or big field of view [but rather] the singular AI in front of the eye experience,” the founder suggested.

“That means you don’t need an army of people who are battling with Qualcomm and all of these various different vendors and engaging in really risky, low-yield R&D and production, and still selling your end device at a loss. It means that we work with technology that has high yield and factory-floor partners that are eager to work with us, in some cases, have invested in us, like our key optics manufacturer and contract manufacturer.”

Path to profitability

While Tavangar declined to disclose Monocle’s sales figures, he said Brilliant Labs makes “a fair bit of money per unit” and “the margins are really good.” The company does “quite well” just from hardware sales without any marketing efforts, he added.

The Monocle AR lens weighs only 15 grams. Image: Brilliant Labs

“This is again something I learned from Apple. If you can get the unit economics right and if your yields are 80, 90% and above at low volume, then you’ve got the operational discipline, the good foundation, and are able to start scaling and be a profitable company,” the founder said.

Case in point, the startup is currently seeing “almost 3x in terms of what we’re able to sell it for versus what it costs us to make it.” In comparison, many other mixed reality companies are selling at zero or negative margins, Tavangar said.

Aside from selling hardware, Brilliant Labs plans to layer on more services powered by large language models, which presents an opportunity to charge for the services. Brilliant Labs integrated with GPT first because it has a “well-documented API.” But the large language model is compute-intensive and the team is constantly on the look for more compressed LLMs.

“I think over time we will see how compressed the models can become even as efficiency increases. As an undercurrent to that, the hardware we make will be more powerful even as the hardware stays low power,” the founder said.

The company is on track to “far exceed” its sales target this year. It has close to 2,000 developers in its Discord community to date.

When questioned about Brilliant Labs’ competitive edge, Tavangar reckoned that the startup’s tightly integrated software and hardware ecosystem is hard to copy, not least because it has a fledgling open-source community.

The company also enjoys a data advantage, he said, as the user information collected by the sensors continues to inform the AI services running on the platform, which in turn improves user personalization. Brilliant Labs does not store any customer data on its devices or server as it’s “not interested in selling data to advertisers,” the founder noted.

Apple’s Vision Pro reignites excitement in China’s XR world

More TechCrunch

A powerful new video-generating AI model became widely available today — but there’s a catch: The model appears to be censoring topics deemed too politically sensitive by the government in…

A new Chinese video-generating model appears to be censoring politically sensitive topics

Our growth as a civilization is tightly coupled to our ability to sufficiently generate ever-increasing amounts of electricity. Could the same be true in space?  Star Catcher Industries, a startup…

Star Catcher wants to build a space power grid to supercharge orbital industry

For frontier AI models, when it rains, it pours. Mistral released a fresh new flagship model on Wednesday, Large 2, which it claims to be on par with the latest…

Mistral’s Large 2 is its answer to Meta and OpenAI’s latest models

Researchers at MIT CSAIL this week are showcasing a new method for training home robots in simulation.

Researchers are training home robots in simulations based on iPhone scans

Apple announced on Wednesday that Apple Maps is now available on the web via a public beta, which means you can now access the service directly from your browser. The…

Apple Maps launches on the web to challenge Google Maps

AltStore, an alternative app store, has launched its first batch of third-party iOS apps in the European Union. The rollout comes a few months after the company launched an updated…

Alternative app store AltStore PAL adds third-party iOS apps in wake of EU Apple ruling

Microsoft this afternoon previewed its answer to Google’s AI-powered search experiences: Bing generative search. Available for only a “small percentage” of users at the moment, Bing generative search, underpinned by…

Bing previews its answer to Google’s AI Overviews

Hiya, folks, welcome to TechCrunch’s regular AI newsletter. Last Sunday, President Joe Biden announced that he no longer plans to seek reelection, instead offering his “full endorsement” of VP Kamala…

This Week in AI: How Kamala Harris might regulate AI

But the fate of many generative AI businesses — even the best-funded ones — looks murky.

VCs are still pouring billions into generative AI startups

Thousands of stories have been written about former NFL quarterback and civil rights activist Colin Kaepernick. If anyone knows a thing or two about losing control of your own narrative,…

Colin Kaepernick lost control of his story. Now he wants to help creators own theirs

Several people who received the CrowdStrike offer found that the gift card didn’t work, while others got an error saying the voucher had been canceled.

CrowdStrike offers a $10 apology gift card to say sorry for outage

TikTok Lite, a low-bandwidth version of the video platform popular across Africa, Asia and Latin America, is exposing users to harmful content because of its lack of safety features compared…

TikTok Lite exposes users to harmful content, say Mozilla researchers

If the models continue eating each other’s data, perhaps without even knowing it, they’ll progressively get weirder and dumber until they collapse.

‘Model collapse’: Scientists warn against letting AI eat its own tail

Astranis has fully funded its next-generation satellite program, called Omega, after closing its $200 million Series D round, the company said Wednesday.  “This next satellite is really the milestone into…

Astranis is set to build Omega constellation after $200M Series D

Reworkd’s founders went viral on GitHub last year with AgentGPT, a free tool to build AI agents that acquired more than 100,000 daily users in a week. This earned them…

After AgentGPT’s success, Reworkd pivots to web-scraping AI agents

We’re so excited to announce that we’ve added a dedicated AI Stage presented by Google Cloud to TechCrunch Disrupt 2024. It joins Fintech, SaaS and Space as the other industry-focused…

Announcing the agenda for the AI Stage at TechCrunch Disrupt 2024

The firm has numerous legs to it, ranging from a venture studio to standard funds, where it does everything from co-founding companies to deploying capital.

CityRock launches second fund to back founders from diverse backgrounds

Since launching xAI last year, Elon Musk has been using X as a sandbox to test some of the Grok model’s AI capabilities. Beyond the basic chatbot, X uses the…

X launches underwhelming Grok-powered ‘More About This Account’ feature

Lakera, a Swiss startup that’s building technology to protect generative AI applications from malicious prompts and other threats, has raised $20 million in a Series A round led by European…

Lakera, which protects enterprises from LLM vulnerabilities, raises $20M

Alongside a slew of announcements for Play — such as AI-powered app comparisons and a feature that bundles similar apps — Google has introduced new “Curated Spaces,” hubs dedicated to…

Google Play gets ‘Comics’ feature for manga readers in Japan

Farmers have got to do something about pests. But nobody really likes the idea of using more chemical pesticides. Thomas Laurent’s company, Micropep, thinks the answer might already be in…

Micropep taps tiny proteins to make pesticides safer

Play Store is getting AI-powered app comparisons, automatically organized categories for similar apps, dedicated hubs for content, data personalization controls, support for playing multiple mobile games on PCs, and more…

Google adds AI-powered comparisons, collections and more data controls to Play Store

Vanta, a trust management platform that helps businesses automate much of their security and compliance processes, today announced that it has raised a $150 million Series C funding round led…

Vanta raises $150M Series C, now valued at $2.45B

The Overture Maps Foundation is today releasing data sets for 2.3B building “footprints” globally, 54M notable places of interest, a visual overlay of “boundaries,” and land and water features such…

Backed by Microsoft, AWS and Meta, the Overture Maps Foundation launches its first open map datasets

The startup is not disclosing its valuation, but sources close to the company say the figure is just under $400 million post-money.

Dazz snaps up $50M for AI-based, automated cloud security remediation

The outcome of the Spanish authority’s probe could take up to two years to complete, and leave Apple on the hook for fines in the billions.

Apple’s App Store hit with antitrust probe in Spain

Proton’s first cryptocurrency product is a wallet called Proton Wallet that’s designed to make it easier to get started with bitcoin.

Proton releases a self-custody bitcoin wallet

Dental care is a necessity, yet many patients lack confidence in their dentists’ ability to provide accurate diagnoses and appropriate treatments. Some dentists overtreat patients, leading to unnecessary expenses, while…

Pearl raises $58M to help dentists make better diagnoses using AI 

Exoticca’s platform connects flights, hotels, meals, transfers, transportation and more, plus the local companies at the destinations.

Spanish startup Exoticca raises a €60M Series D for its tour packages platform

Content creators are busy people. Most spend more than 20 hours a week creating new content for their respective corners of the web. That doesn’t leave much time for audience…

Mark Zuckerberg imagines content creators making AI clones of themselves