I have been working with Meta’s SceneAPI to create mixed reality experiences on several devices. Here are a few things I can share about this;

Some of my work was showcased in Meta Connect 2023 when releasing the first scene understanding SceneAPIs from Meta that understand your space contextually and provide data to developers to work with. My work was one testbed we had for evaluating and developing the technology.

There are additional projects i’m working now that are more related to AI, but I am unable to say more currently.

In my spare time, I also created a few visualizations to help illustrate some of the data we’re working with, since I can’t share most of my visuals:

This little contextual scene data visualizer was created in one weekend in my spare time (personal computer and device, only public APIs).

I also hope to create more video tutorials for people looking to use SceneAPI and MRUK (Mixed Reality Utility Kit) which has some really great recently added tools.

There are a lot of interesting & creative applications for Mixed-Reality Unity development that i’m excited for – in particular experiences that help support positive mental health, including people with disabilities & illnesses.