Development of a 3D User Interface based on Kinect Sensor and Bend-Sensing Data Glove for Controlling Software in the Mining Industry

Heonmoo Kim; Yosoon Choi

doi:10.32390/ksmer.2019.56.1.044

All Issue

2019 Vol.56, Issue 1 Preview Page Next Page

Research Paper

Development of a 3D User Interface based on Kinect Sensor and Bend-Sensing Data Glove for Controlling Software in the Mining Industry 광업 분야 소프트웨어 제어를 위한 키넥트 센서와 굽힘 감지 데이터 글러브 기반의 3차원 사용자 인터페이스 개발

28 February 2019. pp. 44-52

PDF XML

Abstract

In this study, we developed a 3D user interface (UI) using the Microsoft’s Kinect sensor and bend-sensing data glove to control software in the mining industry. The developed UI controls the mouse cursor in Windows according to the user’s hand position tracked by the Kinect sensor. In addition, it controls the mouse click events in Windows by measuring the user’s finger flexion using the bend-sensing data glove. An open-source hardware, Arduino Lilypad Board, and National Instrument’s LabVIEW software were used to develop the UI. Applications of the 3D UI to several 3D software utilized in the mining industry revealed that it can control the 3D software in more intuitive way than traditional UIs such as mouse and keyboard.

Keywords

User interface

Kinect sensor

Data glove

3D software

Arduino

본 연구에서는 마이크로소프트 키넥트 센서와 굽힘 감지 데이터 글러브를 이용하여 광업 분야 소프트웨어를 제어할 수 있는 3차원 사용자 인터페이스를 개발하였다. 개발된 인터페이스는 키넥트 센서로 추적되는 사용자의 손 위치에 따라 윈도우즈 환경에서 마우스 커서를 제어한다. 또한 굽힘 감지 데이터 글러브로 측정한 사용자 손가락의 구부러짐 정도에 따라 윈도우즈 환경에서 마우스 클릭 이벤트를 처리한다. 인터페이스의 개발에는 오픈소스 하드웨어인 아두이노 Lilypad 보드와 National Instrument의 LabVIEW 소프트웨어가 사용되었다. 3차원 사용자 인터페이스를 광업 분야에서 사용되고 있는 몇 가지 3차원 소프트웨어에 적용해본 결과, 마우스나 키보드와 같은 전통적인 인터페이스보다 더 직관적으로 3차원 소프트웨어를 제어할 수 있음을 확인할 수 있었다.

키워드

사용자 인터페이스

키넥트 센서

데이터 글러브

3차원 소프트웨어

아두이노

References

Bednarz, T.P., Caris, C., Thompson, J., Wesner, C., and Dunn, M., 2010. Human-Computer Interaction Experiments Immersive Virtual Reality Applications for the Mining Industry. Proc. of the 24th IEEE International Conference on Advanced Information Networking and Applications, Perth, WA, Australia, p.1323-1327.

10.1109/AINA.2010.180

Boulos, M.N.K., Blanchard, B.J., Walker, C., Montero, J., Tripathy, A., and Gutierrez-Osuna, R., 2011. Web GIS in practice X: a Microsoft Kinect natural user interface for Google Earth navigation. INT. J. HEALTH GEOGRAPHICS, 10(45), 1-14.

Choi, Y., Baek, H., and Shin, S.H., 2014. Development of a GRAM model-based program for analyzing groundwater rebound in abandoned mines, J. Korean Soc. Miner. Energy Resour. Eng., 51(2), 271-284.

10.12972/ksmer.2014.51.2.271

Choi, Y., Um, J.G. and Park, M.H., 2012. Visualization of 3D geological models on google earth using COLLADA and KML, J. Korean Soc. Miner. Energy Resour. Eng., 49(4), 498-506.

Gallotti, P., Raposo, A., and Soares, L., 2011. v-Glove: A 3D Virtual Touch Interface. Proc. of the 2011 XIII Symposium on Virtual Reality, Uberlandia, Brazil, p.242-251.

10.1109/SVR.2011.21

Google, 2019.01.02., https://www.google.co.kr/intl/ko/earth.

Kim, I., 2012. Trend on non-contact 3D interface technology. Information & Communications Magazine, 29(7), 31-37.

Kim, S.M. and Choi, Y., 2018. SIMPL: A Simplified modelbased program for the analysis and visualization of groundwater rebound in abandoned mines to prevent contamination of water and soils by acid mine drainage. International J. Environmental Research and Public Health, 15(5), 1-19.

10.3390/ijerph1505095129747480PMC5981990

KORES, 2016.09.26., https://www.kores.or.kr/common/download.do?fid=bbs&bbs_cd_n=9&bbs_seq_n=14201&file_seq_n=1.

Laviola, Jr., J.J., Kruijff E., Mcmahan, R.P., Bowman D.A., and Poupyrev I., 2017. 3D User Interfaces: Theory and Practice (2nd Ed), Addison-Wesley Professional, Boston, Massachusetts, United States, p.27-35.

Lee, M. and Jeon, J., 2012. Personal computer control using kinect. J. the Korea Information Science Society, 39(1A), 343-345.

Lee, Y.S., 2017. Development of Immersive Gesture Interfaces for Navigation of Virtual 3D Map, MS Thesis, Chung-Ang University, Seoul, Korea, 54p.

Nilsson, T. and Öman, O., 2016. RC-glove: Controlling objects with finger movements, bachelor's degree Thesis, KTH Royal Institute of Technology, Stockholm, Sweden, 22p.

Noh, Y.H., Choi, Y., Um, J.G., and Hwang, S., 2013. Development of the 3-D fracture network analysis and visualization software modules. TUNNEL & UNDERGROUND SPACE, 23(4), 261-270.

10.7474/TUS.2013.23.4.261

Silva, L., Dantas, R., Pantoja, A., and Pereira, A., 2013. Development of a Low Cost Dataglove based on Arduino for Virtual Reality Applications. Proc. of the 2013 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), Milan, Italy, p.55-59.

10.1109/CIVEMSA.2013.6617395

Zhang, Z., 2012. Microsoft kinect sensor and its effect. IEEE Transactions on MultiMedia, 19(2), 4-10.

10.1109/MMUL.2012.24

Information

Publisher :The Korean Society of Mineral and Energy Resources Engineers
Publisher(Ko) :한국자원공학회
Journal Title :Journal of the Korean Society of Mineral and Energy Resources Engineers
Journal Title(Ko) :한국자원공학회지
Volume : 56
No :1
Pages :44-52
Received Date : 2019-01-02
Revised Date : 2019-02-08
Accepted Date : 2019-02-22
DOI :https://doi.org/10.32390/ksmer.2019.56.1.044

Journal of the Korean Society of Mineral and Energy Resources Engineers ISSN:2288-0291(Print) 2288-2790(Online) 한국자원공학회지

All Issue