Last year we decided to launch official app of HoloKit, we realized that we should give our customer(especially developers) a glipse on what we can do with iPhone and HoloKit, so we created following scenes(realities we called) aim to utilize and demonstrate the capabilities of AR Foundation on the iPhone to create AR experiences that showcase both basic and advanced features. This project contains all typography realities released on holokit app, includes:
- TypedRealityTheFlock
- TypedRealityTheFingerRibbon
- TypedRealityTheHair
- TypedRealityTheRain
- TypedRealityTheScanner
- TypedRealityTheSculpture
- TypedRealityTheTornado
This project uses HoloKit SDK and aims to build an app runs on iOS device. I created and built this project in Unity 2022.3.8f1, I highly recommand you use this version and above to open the project. Make sure your Unity had install the iOS module:
- Some features from HoloKit SDK only works on platform of iOs. If you work on other platform, some code may fail to compile, preventing you from entering Play mode and significantly impacting your development experience.
- Build to an Xcode project needs iOS module. I built this project to iPhone with Xcode 14.2.
- Clone the project.
- Open with Unity.
- Open a scene from path: Assets->Scenes.
- Build select scene into an Xcode project.
- Build to you device, open the app and try it out.
TypedRealityTheFlock creates an Stereo-AR experience, a flock of "birds" in a style of typography fly around the player and sing at same time.
typo.bird.mp4
To create a realistic experience, this reality uses boid algorithm to drive "birds" fly around the player. It takes the head position (the position of the mobile device) as input to create circular movement.
In this scene, we used AR shadows on real-world ground to create a more realistic effect(shader included in this project).
TypedRealityTheFlock creates an Stereo-AR experience that ribbons flows along with your finger-tips.
typofinger.mp4
TypedRealityTheFingerRibbon uses Hand-Tracking feature from HoloKit SDK. Tracking the positions of all your finger-tip to create ribbons
TypedRealityTheHair creates an Stereo-AR experience that several Octopus-like long hair in a style of typography sways with your head movement.
typo.hair.mp4
In this scene, we use the player's head position as input to estimate the position of hair growth and attach physically responsive ribbons.
TypedRealityTheRain creates an Stereo-AR experience where a white cloud, styled like typography, follows the player(person in camera in Screen-AR mode), continuously dropping raindrops. These raindrops collide with the real-world ground, splitting and fading away.
typo.rain.mp4
In this reality, we use 3DBodyTracking Feature to track a person in camera in Screen-AR mode. In Stereo-AR mode, the cloud follows the player.
TypedRealityTheScanner creates and Stereo-AR experience where white rectangular ribbons in a style of typography on the surrounding floors, walls, and other environmental surfaces. These ribbons nest layer by layer, expanding over time.
scanner.mp4
In this reality, we use Meshing feature to get the mesh information of our surroundings in real-time, to change the material of mesh to render rectangular ribbons effect.
TypedRealityTheSculpture creates and Stereo-AR experience allows us to launch text particles from our fingertips, filling a human-shaped sculpture.
sculpture.mp4
In this reality, we use Hand-Tracking feature from HoloKit SDK to capture player’s hand(all joints) in real-time, creating particle from index tip joint.
This augmented reality experience creates a text storm that follows the target/player.
tornado.mp4
In this reality, we take head position as input, create a storm following the target(in Screen-AR mode)/player(in Stereo-AR mode).
This augmented reality experience creates a line segment covered with messages formed by stretching the index finger and thumb.
20230326-214328.mp4
In this reality, we utilized the gesture tracking capabilities of the SDK, recognizing the fingertips of the index finger and thumb and calculating the distance between them. A certain threshold triggers the retention of the line segment.