摘 要

科学技术的发展日新月异，现阶段人们越来越关注自然的交互技术，作为自然交互的代表方式，体感交互非常自然的成为人们的重视对象。体感交互技术能够扩大用户的操作自由度，让用户从平面的操作空间延伸到物理的真实空间，使得用户有更为真实的应用体验，体感交互是当今以及未来人机交互的重要部分。本文所选用的Leap Motion就是一款新颖的体感设备。

论文研究的内容是基于Unity3D与Leap Motion的虚拟电子琴设计，思路是以本次开发虚拟电子琴的过程为主线，包括开发前的准备，拟采用的技术方案及措施等。本次设计的优势在于采用体感控制的方式来完成对电子琴的演奏，经过上百次的测试，准确性可高达99%以上。通过两种情况下电子琴弹奏的测试体验对比，非常明显的可以得出结论，体感控制比鼠标键盘控制更加具有吸引力，也更接近现实的演奏方式，增强了用户身临其境的沉浸感，虽然现阶段的体感交互仍然不够简单便捷，但它对人的吸引了却比传统的鼠标键盘方式更强，体感交互的未来发展也是值得期待的。

关键词：体感控制；Leap Motion；Unity3D；手势识别

Abstract

The development of science and technology is changing with each passing day. At present, people pay more and more attention to the natural interaction technology, as the representative way of natural interaction, the body sense interaction is very natural to people's attention. Somatosensory interaction technology can enlarge the user's freedom of operation, extend the user from the operating space of the plane to the real space of the physics, make the user have a more real application experience, and the physical interaction is an important part of the human-computer interaction in the present and the future. The Leap Motion used in this paper is a novel somatosensory device.

The research content of this paper is based on the virtual electronic organ design of Unity3D and Leapmotion. The idea is to develop the virtual electronic organ as the main line, including the preparation before the development, the technical scheme and measures to be adopted. The advantage of this design is the use of somatosensory control to complete the performance of the electronic organ. After hundreds of tests, the accuracy can be as high as 99%.By comparing the test experience of the electronic piano playing in two cases, it is very obvious that the body sense control is more attractive than the mouse keyboard control, and it is closer to the practical way of playing, which enhances the immersive feeling of the user. although the current sense of body interaction is still not simple and convenient, it catch People's attraction stronger than traditional mouse and keyboard, and the future development of somatosensory interaction is also worth looking forward to.

Key Words:SomatosensoryControl;Leapmotion;Unity3D;Gesture Recognition

目 录

第1章 绪论................................................................................................................1

1.1 研究意义........................................................................................................1

1.2 国内外研究现状............................................................................................2

1.3 论文内容及结构安排....................................................................................4

1.4 需求分析及系统设计....................................................................................4

1.4.1需求分析........................................................................ ………..….......4

1.4.2系统设计.............................................................................……..….......4

第2章 Leap Motion的基本介绍..............................................................................6

2.1硬件介绍.........................................................................................................6

2.2Leap Motion开发工具包................................................................................7

2.3Leap Motion技术原理 ..................................................................................8

2.3.1坐标系统............................................................................……..……....8

2.3.2手势..................................................................................………….......8

2.4 小结.................................................................................................................8

第3章 Unity中的设计..............................................................................................9

3.1 Unity3D的基本介绍......................................................................................9

3.2 场景搭建流程................................................................................................9

3.3 项目的开发与场景优化...............................................................................10

3.3.1坐标系统转换.......................................................................……..….....10

3.3.2模型导入设置.......................................................................……..….....10

3.3.3电子琴功能的实现........................................................... ………..….....11

3.4 小结…………...............................................................................................12

第4章 LeapMotion与Unity的协同开发...............................................................13

4.1LeapMotion与Unity的集成.........................................................................13

4.2 体感控制功能的实现...................................................................................13

4.2.1手部模型的制作...................................................................……...….....13

4.2.2手势控制开始...................................................................………..….....14

4.2.3手与电子琴交互功能的实现.....................................................................15

4.3 整体结果测试...............................................................................................16

4.4 小结...............................................................................................................17

第5章总结与展望.....................................................................................................18

5.1总结................................................................................................................18