Many VR applications require picking and moving of virtual objects. Many gesture based solutions do not work reliably, whereas controller based methods are not as natural as hand pose recognition. Tethered controllers add the issue of a cable being in the user’s way. We developed
a gesture interface using a Leap Motion finger tracker attached to an Oculus Rift DK2 and implemented three ways of interacting with objects: innate pinching, magnetic force, and a physical button attached to the index finger. We built a virtual reality test scenario, in which the user needs
to move virtual objects between shelves to sort them. Initial testing shows that grabbing with the button works better than the other two more natural methods. Besides the user interaction techniques, we also report on our practical experiences using Oculus Rift, Leap Motion and the button
with the Unity 3D development platform.