Damon Hernandez

🚀 Exciting Developments in XR Technology! 🚀 Not having controllers is an exciting problem to solve for many XR creators. It pushes us to think beyond "which button should I use for X?" and instead, focus on the most natural way for users to interact with their hands, while ensuring the headset can recognize those movements. As XR becomes fully adopted, we won’t want to carry controllers everywhere; we'll want seamless interactions through XR glasses. However, some XR activities, like firefighter training, require controllers for interacting with various tools and providing haptic feedback. It’s thrilling to see companies working on controller solutions for Apple headsets, unlocking a new realm of XR content on the AVP. https://lnkd.in/gMXWcQHU #VRTraining #AppleVisionPro #XRDevelopment

4

5 Comments

🚀 Friday Recap! 🚀 It's been another exciting week for XR technology and innovation. Here's what we've been up to and what we've seen: 🔍 Understanding ROI in XR: Check out this insightful article by MACE Virtual Labs on the ROI of XR in your business or department. Thank you for sharing this valuable information! - https://lnkd.in/e_Us8Whq 📱 Apple Vision Pro Controllers: The Vision Pro is getting motion controllers soon from a third-party creator. This is crucial for expanding content, especially in education and training. 🎮 Spatial Ops by Resolution Games: This exciting game showcases the power of Mixed Reality and its ability to interact with large environments. 🎨 Pencil by 4th Wall Breakers: A fantastic MR app on a smaller scale, demonstrating how MR could soon revolutionize art classes and other educational settings. 🚒 San Diego Fire-Rescue Department Partnership: We're thrilled to announce our new partnership with San Diego Fire! The most exciting part? We're building a collaborative community in the fire service where solutions for one department are shared with everyone, regardless of size or location. - https://lnkd.in/efpziMke Follow me (Evan Sitler-Bates) and XpertVR for more exciting news in XR! 🌟 #XR #MixedReality #Innovation #Education #Training #FireService #Collaboration #TechNews #FridayRecap

22

8 Comments

While in the VR game Walkabout Mini Golf from Mighty Coconut, you can disable the rendered large spiders in the attic of the creepy golf course ’Widow's Walkabout’ if you suffer from arachnophobia, the situation for already captured immersive (stereoscopic) media is different. Read more about it in my latest article at MIXED: https://lnkd.in/dn-G4WS8

4

A quick 30-minute webinar we did with Maher Farraj on combining #AI and #VR - check it out below!

11

3 Comments

Making sure your design work performs well on the platforms you intend to is something designers don’t account for anymore because modern workflows allow for up to 8k outputs. With new technologies that require higher frame rates on two high resolution screens and in realtime, following devices requires is again something modern designers have to account for. Here’s a video where we discuss this.

1

This is a presentation I gave today in Barcelona, Spain on the topic of Advanced Prompt Engineering Methodology within the Gemini Studio. https://lnkd.in/g3T925tK Includes 4 main Prompting Demos. #BuildwithAI #Barcelona #GDG

15

🏮 Short-form Narrative Pipelines for Social Platforms, Part 3 🏮 To help us streamline our workflow, we worked with Chaos, Epic Games, NVIDIA, and Lenovo to push the real time rendering envelope by fully ray tracing live using Unreal Engine. For those unfamiliar with the nuances of lighting and rendering, here's a high level breakdown along with an explanation as to why FULLY ray tracing is a big deal: Games use a rendering technique called rasterization to light environments. Basically, individual pixels in a 3D mesh are shaded based on how lights in the environment hit each pixel. While computationally intensive, game engines are able to handle the workload in real time. That's why when you walk down a street in a video game it feels like you're in a 3D world, even though you're viewing that world on a 2D screen -- the horizon/environment is being rendered in real time as you walk, so it feels like you're in it. Movies and TV shows on the other hand use ray tracing to light environments. Working backwards from the POV of the viewer, ray tracing is a physics-based rendering technique that follows (traces) light paths (photons) as they bounce off objects. This technique is more computationally intensive than rasterized rendering and is done offline on servers after a scene has been filmed. Harnessing the power of modern GPUs, ray tracing produces images that are indistinguishable from reality, and that's why films look more "real" than games. The holy grail for games is to achieve film quality rendered environments, while the holy grail for 3D films is to be able to see a final frame image in real time. Certain game engines, like Unreal Engine, come equipped with a ray traced effect added on top of the rasterized image. This gives the game an incredible look right out of the box, but to get to that film quality bar, you need to go that extra little mile. You need to FULLY ray trace. That means film teams will film once in engine and then re-render everything they just filmed offline to reach that film quality bar. That means more time and more $$. Working with the team at Chaos, they live linked Chaos Vantage directly into Unreal Engine. This gave us two screens when filming. One that showed the scene in Unreal and one that showed the same scene in Vantage. Both were capturing in real time. The scene in Vantage was fully ray traced live at about 30fps (see example below). This allowed us to get really close to a final frame image in real time, which we presented at NVIDIA GTC22. Why is this a big deal? Because the director can CHOOSE what shot to finish rendering offline instead of re-rendering everything. It's a much more agile workflow that reduces the time between concept and market. If you want to learn more about what an interoperable 3D asset future looks like, check out my 'Interoperable Playbook' on my profile page or download it for free here --> https://lnkd.in/gGHDMZ4p Cheers! 🖖

1

It's already here! — AI Video EXTEND.... New updates from Luma AI's Dream Machine Extend is an advanced system that is aware of what's happening in your video and extends it in a consistent way to follow instruction. Further, coming soon to Dream Machine - powerful editability and intuitive controls! Need more help? I tested 100's of Luma AI Dream Machine video prompts and learned from the best videos —Now I’ve packaged all this into one killer GPT for you🎉 This GPT will analyze your image and provide top-tier ideas for - AI Video prompt - AI Music prompt Stop wasting time on trial and error – I’ve done the legwork for you. Let's elevate your creative game! Use this GPT to build your prompts and create stunning videos: https://lnkd.in/d4Ss_kbU Got more ideas to use AI in your creative workflow? Drop a comment or hit me up! 👇 #lumalabsai #LumaDreamMachine #aivideo

53

7 Comments

Have you ever found yourself lost in a virtual reality experience, unsure of where to go or what to do next? XR is revolutionizing user experiences, yet we often approach designing these immersive worlds as we would a typical app or website. #XR #VirtualReality #UserExperience #DesignThinking

1

very nice use of AI

53

The future of outdoor navigation is learning-based SLAM! One of the largest problems with SLAM is that it requires all keypoints to be stored in memory. For some packages, even a few seconds outside leads to the RAM getting filled, and the mapping crashes. The acezero package is interesting because it seeks to learn poses. Similar to CNNs and LLMs, minimization of computational resources is a possibility while still ingesting large amounts of data! If you wish to learn more about these kinds of topics, pre-order my robotics courses!

32

So while we were all waiting for Sora to be available, Luma just dropped. And it's really mind blowing 🤯 I made a quick comparison of Luma vs Runway. No Sora comparison since I don't have access yet. But Luma is clearly way ahead of Runway. To keep things equal, I did not provide any text prompt. I simply uploaded the same Midjourney image into both tools and let them convert that to video in the best way they thought. This approach also reveals the image assessment qualities of both video generation tools, as the animation gets decided based on their assessment of different elements and inferred motion within the source image. Runway's animations tend to be very subtle. That is probably to limit morphing. Luma on the other hand favours BIG motions. Head turns and sweeping camera motions. It's impressive that Luma kept object and landscape geometry intact during these large motions. The reflections on the muddy water in the jungle scene is also very impressive. Luma's understanding of real world 3D space is much closer to Sora, it seems, and its generations are way better than Runway. Having said that, I haven't had much luck with controlling the motion with text prompts when an image is used in input. It tends to favour its own assessment over the text prompt when it comes to motion. If you have figured out how to control Luma better, drop me a note! Would love to learn. But I know what I'm using for my next AI film project. #GenAI #Luma

11

7 Comments

I admire how Spline is so good at showing the product in action instead of geeking out over the tech and specs. #productmarketing #copywriting

5