Spatial computing could be made of many small devices that work together and with the physical world to create augmented experiences.
Assume the following hardware is widely available:
-
Mini cameras, under $50, 1–5 cm across
-
Mini video projectors, under $150, 10–15 cm across
-
Mini speakers, under $50, 5–10 cm across
-
Controllers and gizmos we can hold and manipulate with our hands: laser pointer, wheel, joystick, keyboard, wearable motion sensors, and various physical contraptions designed for fine control or coarse gestures
-
Mobile computers such as smartphones and tablets
The mini devices can be scattered and positioned freely around the room or the house. They come with convenient supports. A manufacturer could design a wide range of such devices across different price tiers.
Think IKEA × LEGO Technic × AirTag.
Do not think Apple Vision Pro.
Scenarios
-
Pick up a projector and face it with a surface. Grab a pointer and click on the surface. Take a keyboard and type. The note appears via the projector.
Pick up the smartphone or tablet, select the setup you’ve made with the recently picked up devices, and fine-tune it: display an image or video, edit the text, run a program.
Aim a camera at the projection surface to recognize it and refine the projected image.
Repeat as often as needed, using the devices you own and the physical setups you make. -
Pick up your tablet, open an animation app, and select an animatable rig.
Position multiple mini cameras around you, or wear motion capture sensors, then control the rig with your hand or body movement.
If the rig accepts other kinds of inputs, choose from the variety of physical controllers you have around the room. -
Pick up your smartphone and open the automation app.
Type: "if a bird lands on my window sill, let me know."
Position a camera facing the window, and select its feed in the app.
Place a mini speaker near the window, then edit the automation to add: "when a bird lands, play a cat sound on the speaker next to the camera."
Links
-
Board, a game that mixes physical objects and a computing surface.