Jamie Niman

Work on the Mixed Reality Magic Leap, this real-time narrative presented many interesting tech-art challenges.

​

As seen on the video on the left:

 

• The plants needed to be dynamic, interactive, and yet allow the ants to march up and down the stem in realtime.

• I wrote a cloth solution to make the plants behave naturally as you interact with them from any place, where it naturally settles back to its rest pose.

• The magnifying glass needed to have the correct focus from both your eyes in Mixed Reality. I solved this by raycasting from the magnifier's focal point to each of your eye positions, and rendering a different lens distorted image for each eye.

• Dynamic flowing maps for the ant pheromones

• Achieved a swarm of flying ants using animated "imposters" that rotate to the direction their particles are heading. This worked really well in mixed reality, as both eyes see a different image giving the illusion these were 3D ants in real space.

• Spider hairs stand on end with a  "shell" shader that adjust based on distance to vibration ripple.

• Light shafts that come from the ceiling, using a shader on cones that takes in a render texture to modulate the light as it scatters through the leaves.

​

​