Profile avatar
volorf.bsky.social
XR Design and Engineering. Spatial Computing. Semiotics.
85 posts 356 followers 80 following
Prolific Poster
Conversation Starter

In loving memory of Moshu 🍎

Another example of using a shader for spatial mesh transformations in the context of UI Design. Plan to make a little UI library for VisionOS (RealityKit/SwiftUI) and Unity (XR Interaction Toolkit) using this approach. Stay tuned! #3dmath #unity3d #uidesign #interactiondesign #csharp #shader

Love using shaders to do mesh transformations. It's not only great in terms of performance optimization, but the main benefit is to encapsulate an art/visual design decision on a lower level of implementation with a thin but expressive API.

Made a prototype for the AR Camera Portal with a DualSense controller. For previous prototypes with custom controllers, I calculated the positioning of the portal based on hand-tracking data. So, expectably, it also worked very well with a mainstream controller. #xrdevelopment #xrdesign #3dmath

I guess, non-uniformly distributed points would better show all the benefits of this structure.

Made another visualization of Octree. Such a beautiful data structure!

Explored how to optimize some of my simulation experiments. Read about an octree data structure, which allows you to decrease time complexity to O(logn) for search (and you get nlogn for the whole iteration cycle). Made a quick visualization (Unity's gizmos) of my implementation. Looks interesting!

Recreated the Plexus Effect with RealityKit. The effect is very cool on its own, but experiencing it in the immersive mode makes it absolutely mesmerizing. #realitykit #spatialcomputing #spatialdesign #xrdevelopment #xr #visionos #applevisionpro #swiftui #mixedreality

Decided to make a home for my RealityKit experiments. Share soon!

AR Camera Portal with Gravity. #mixedreality #prototyping #spatialcomputing #3dmath #xr #xrdesign #xrdevelopment

Plexus Effect with RealityKit. #visonos #realitykit #ecs

It's always worth spending an extra few minutes to make a debug menu look nice.

🔬 Did another experiment with RealityKit to practice ECS. 🏀 1000 Bouncing Balls in a box/sphere-shaped space. Use SDF for any shape. #spatialcomputing #spatialdesign #prototyping #natureofcode #simulations #mixedreality #visionos #realitykit #applevisionpro #ecs #swiftui

1000 bouncing balls in a sphere-shaped space. #visionos #realitykit #natureofcode

1000 bouncing balls in a box-shaped space. It's fascinating that it's running in Editor Preview. #realitykit #visionos

BTS: I initially thought that I could just hook up my DJI drone to the iOS controller and use the AR drone as an overlay. Unfortunately, DJI deprecated API for that. Also, it turned out that flying in such a small room gives you a very unstable recording. Luckily, I had an IKEA stand desk!

At LIV, I work a lot on making the best camera experience for #xr: capturing exciting moments you had in #mixedreality and sharing them with the world. But recently, I thought: what if we use #mixedreality to capture the reality?

AR Portal Display Experiment. #spatialcomputing #spatialdesign #xrdevelopment #mixedreality

🎉 Found a build-in Perlin Noise for VisionOS. It's in GameplayKit. #visionos #visionpro #perlinnoise

Random Walker on Apple Vision Pro.

Added an AR Display to my phone joystick. It smoothly follows your hand's position. You can also switch to a big screen view. It will move along your sight direction and stay static.

just realized that you can use tuples as a return type. less readable, but when the context is clear, it is a nice simplification.

Playing with RealityKit. Do some exercises from The Nature Of Code. This is the best way to get familiar with a new framework.

Tweaking the AR screen transform numbers for the phone joystick.

Random Walker on VisionOS.

Made a little experiment with mixing a 3D element in a 2D panel on VisionOS. It's fascinating how such a simple thing makes the whole UI feel 3D. #swiftui #visionos #applevisionpro #realitykit #spatialcomputing #spatialdesign #xrdesign #ar #mixedreality

Holding the joystick.

Trying to figure out where to place a joystick's digital tween when you hold a real one. The current approach is to recreate a plane based on the positions of your intermediate and proximal joints.

Integrated an iOS controller I made earlier with an AR scene. Recorded on Meta Quest in the Passthrough mode. Meta Quest App: Unity + XR Integration Toolkit. iOS App: XCode + SwiftUI Communication protocol: WebSocket #ar #xr #prototyping #unity3d #swiftui #xrdevelopment #xrdesign #mixedreality

found these code riddles quite entertaining.

accelerometer test 2.

accelerometer test.