Skip to main content

Niantic’s latest acquisition lets AR Pokémon hide behind the real world

It seems like a simple concept: when rendering something in augmented reality (like, say, a Pikachu in Pokémon Go) and something in actual reality (like, say, a human, or a car, or a planter) passes in front of it, make the rendered object appear to be “behind” the real one.

In practice, it’s pretty damn hard. A device would need the ability to tell which pixels are close, or far, or somewhere in between. While adding more cameras (or lasers!) to the mix can help, achieving that sense of depth from the single rear RGB camera found on most smartphones — and doing it fast — is a helluva task. That’s why objects in most augmented reality apps tend to just sort of float in front of anything that gets too close.

Niantic (the co. behind the aforementioned Pokémon Go) has just acquired Matrix Mill, a company that has been working to tackle that challenge.

Founded in 2017 and spun out of a lab at University College London, Matrix Mill has been working on a product it calls “Monodepth” — a tool that takes data from a single RGB camera, passes it through a neural network, and spits out depth data fast enough to be integrated into a real-time game.

The company demonstrated its tech to a handful of press yesterday, showing an example of a Pikachu running around in Niantic’s existing AR engine vs one integrating Matrix Mill’s tool:

Note how, in the second version (starting at 0:33), Pikachu is occluded behind those passing by, or how it can seemingly run behind a planter rather than through it. While the visuals aren’t perfect (there’s definitely a bit of stray clipping), the integrations are early — and even at this stage, it’s a pretty big step forward in realism. Alas, no word yet on when this work might actually make its way into Pokémon Go.

Terms of the deal weren’t disclosed.

Niantic also demonstrated some of the tech it’s been working on behind the scenes, but has yet to integrate into its games – specifically, low latency, shared AR experiences.

“Codename: Neon”, for example, is an experimental game that has players run around a big open space, picking up orb “ammo” and firing it at those around them. Check it out:

Note how the game recognizes different players, labeling them on screen with a marker that follows them around. Projectiles track around the room in real time, with all players (and any observers) seeing the rockets whiz around them. By using multiple devices to build a shared map of the real world room, the game is able to understand where players are in relation to each other. It’s easy to imagine this tech being adapted for wizard duels for Niantic/Portkey’s upcoming Harry Potter game.

The same shared AR concept can be adapted for other genres. Here’s “Tonehenge”, a proof of concept co-op puzzler Niantic built in a few days:

Anyone else getting Wizard’s Chess vibes?

Finally, Niantic also disclosed early details on its “Real World Platform” – a set of cross platform (iOS and Android) tools and APIs it’s been working on for third party developers to build on top of. Want to build your own game in the same vein as GO? You bring the concept and the mechanics, they’ll bring the maps, the anti-spoofing tools, their massive database of real world points of interest, etc.

Niantic says it’ll open the platform up to a “select handful” of third parties later this year.



from TechCrunch https://ift.tt/2Kq4CPl
via IFTTT

Comments

Popular posts from this blog

Apple’s AI Push: Everything We Know About Apple Intelligence So Far

Apple’s WWDC 2025 confirmed what many suspected: Apple is finally making a serious leap into artificial intelligence. Dubbed “Apple Intelligence,” the suite of AI-powered tools, enhancements, and integrations marks the company’s biggest software evolution in a decade. But unlike competitors racing to plug AI into everything, Apple is taking a slower, more deliberate approach — one rooted in privacy, on-device processing, and ecosystem synergy. If you’re wondering what Apple Intelligence actually is, how it works, and what it means for your iPhone, iPad, or Mac, you’re in the right place. This article breaks it all down.   What Is Apple Intelligence? Let’s get the terminology clear first. Apple Intelligence isn’t a product — it’s a platform. It’s not just a chatbot. It’s a system-wide integration of generative AI, machine learning, and personal context awareness, embedded across Apple’s OS platforms. Think of it as a foundational AI layer stitched into iOS 18, iPadOS 18, and m...

The Silent Revolution of On-Device AI: Why the Cloud Is No Longer King

Introduction For years, artificial intelligence has meant one thing: the cloud. Whether you’re asking ChatGPT a question, editing a photo with AI tools, or getting recommendations on Netflix — those decisions happen on distant servers, not your device. But that’s changing. Thanks to major advances in silicon, model compression, and memory architecture, AI is quietly migrating from giant data centres to the palm of your hand. Your phone, your laptop, your smartwatch — all are becoming AI engines in their own right. It’s a shift that redefines not just how AI works, but who controls it, how private it is, and what it can do for you. This article explores the rise of on-device AI — how it works, why it matters, and why the cloud’s days as the centre of the AI universe might be numbered. What Is On-Device AI? On-device AI refers to machine learning models that run locally on your smartphone, tablet, laptop, or edge device — without needing constant access to the cloud. In practi...

Max Q: Psyche(d)

In this issue: SpaceX launches NASA asteroid mission, news from Relativity Space and more. © 2023 TechCrunch. All rights reserved. For personal use only. from TechCrunch https://ift.tt/h6Kjrde via IFTTT