Spectacular AI

Our latest research paper, Gaussian Splatting on the Move, has been accepted to the top-tier computer vision conference, #ECCV2024 🔥 The (updated) method enables crisp #gaussiansplatting 3D reconstructions from blurry and wobbly hand-held smartphone captures, and outperforms previous state-of-the-art #NERF-based methods (such as BAD-NeRF). Project page https://lnkd.in/dQ32TRMs #computervision #sensorfusion #ai

GPS-free drone navigation with < 1% drift This video demonstrates VIO tracking with two different camera devices: 1) Spectacular AI reference HW design (version 1) with two global shutter stereo cameras. 2) RTK-VINS prototype device (Kindhelm) with monocular fisheye rolling shutter camera setup. Both cases also fuse barometric altitude data with VIO. GPS is only shown for reference and no loop closures are used. The total accumulated drift is below 0.6% in both cases, when computed with optimal 4-DoF trjaectory alignment. #computervision #drone #sensorfusion #gnss

GPS-free drone navigation using the Spectacular AI SDK and our standalone reference hardware design. The payload on the drone is an example of a high-accuracy VIO system built using low-cost, mostly off-the-shelf, components. It can track the position and orientation of the drone in real-time using only consumer-grade cameras and IMU, running on embedded hardware, in this case, the Jetson Xavier NX ARM CPUs, without consuming any GPU resources. The SDK can also be integrated into external positioning systems such as visual positioning based on aerial or satellite image data. #sensorfusion #computervision #gnss #drone

We are releasing Gaussian Splatting on the Move, a method for creating crisp #gaussiansplatting reconstructions from blurry and wobbly smartphone captures! ⭐ Paper: https://lnkd.in/dqwPYSAS ⭐ Code: https://lnkd.in/dhFceiSQ ⭐ Website: https://lnkd.in/dTAAdJGM Authors: Otto Seiskari, Jerry Ylilammi, Valtteri Kaatrasalo, Pekka Rantalankila, Matias Turkulainen, Juho Kannala & Arno Solin #gaussiansplatting #computervision #sensorfusion #slam

Spectacular AI SDK 1.28 released with new, easy-to-use mapping and data collection tools for Orbbec, RealSense (Intel Corporation), and Luxonis OAK-D devices. See our new documentation site for more info https://lnkd.in/dQsWgGCZ #slam #computervision #sensorfusion

Spectacular AI SDK 1.27 released with out-of-the-box support for Orbbec 3D Femto Mega/Bolt, drop-in replacements for the discontinued Azure Kinect DK, using the same ToF sensor technology. It can be used to easily 3D-scan larger spaces. With our post-processing tools the scans can also be used for #GaussianSplatting In addition to Femto, we also support Orbbec Astra 2, with RGB structured light depth sensing. Link to documentation and instructions: https://lnkd.in/dGypM5Pu

🤖🕶️ My robot already waiting for spring amid all the snow. Scroll down to view it yourself 👇 Captured with the Spectacular AI SDK in 3D with my iPhone. The robot outfit: A #RealAnt body with Luxonis vision (OAK-D) and official NVIDIA sunglasses as eyewear. The Gaussian splatting model trained in #nerfstudio with the Spectacular AI plugin and data captured with our iOS app. Instructions here: https://lnkd.in/dps6YBA2 Try the 3D #gaussiansplatting model yourself: https://lnkd.in/d9Dia_SH #artificialintelligence #spatialai #immersion #metaverse

Spectacular Rec data collection application released also for Android! Our new tutorial video shows how to use it to create Gaussian Splatting models that you can view in the browser. ⭐ Android app https://lnkd.in/d-BhnHXz ⭐ iOS app https://lnkd.in/dWUDk-vm ⭐ Tutorial video: https://lnkd.in/dJNyrkH4 ⭐ Example gallery: https://lnkd.in/dpsdVQuu The 3DGS training combines our Mapping API with Nerfstudio and the viewer utilizes the new gsplat.js library. These tools can also be used to create 3DGS models from other devices supported by the Spectacular AI SDK, such as OAK-Ds. #gaussiansplatting #slam #computervision #androidapp #iosapp #nerf

We have published Spectacular Rec, an iOS app for collecting data for #nerf and #gaussiansplatting reconstructions! Step-by-step YouTube tutorial https://lnkd.in/dMnTnTrt for creating 3D reconstructions using your phone, Nerfstudio and Spectacular AI SDK (good GPU required!). Fully COLMAP-free Link to Spectacular Rec app https://lnkd.in/dWUDk-vm

Otto Seiskari's Spectacular AI is skipping COLMAP to produce near live Radiance Fields through their Mapping SDK. It is supported for NVIDIA AI's Instant-NGP and nerfstudio's nerfacto and gsplat.