Augmented Materiality Laboratory

When the user selects an object, object-bound grids are generated based on the object’s scale, shape and orientation. 2) Users can use their non-dominant hand to invoke a 3D grid on top of an object in the scene. 3) Users can also add precision (a) and context (b) grids to the scene using natural hand gestures with their non-dominant hand.

The Context-Based 3D Haptic Grid extends the visual and haptic feedback of the real-world to help users do precise mid-air 3D manipulations. Our system creates 3D grids that surround each object (virtual and real) in the scene to help users see the object’s transformation. It also provides haptic feedback to helps users do precise manipulations without constraining their actions.


Barrera-Machuca, M. D., Cassinelli, A., & Sandor, C. (2020). Context-Based 3D Grids for Augmented Reality User Interfaces. In UIST ’20 Adjunct: Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology (pp. 73-76). (UIST – Adjunct Publication of the Annual ACM Symposium on User Interface Software and Technology). Association for Computing Machinery.