top of page

VR Lab

The laboratory was founded by Dr. Juin-Ling Tseng in 2007 in the Department of Computer Science and Information Engineering, Minghsin University of Science and Technology, Taiwan. In 2009, with the establishment of the Department of Multimedia and Game Development by Dr. Tseng, it was moved to the Creative Base Σ of the Department of Multimedia and Game Development.

VR Headset

We achieve

Until 2024, a total of more than 50 projects have been implemented in the lab, with a planned amount of more than 10 million, and the main research areas include VR, AR, 3D model simplification, game development, etc. Our main cooperative institutions include the National Science and Technology Council, the Ministry of Education, the Ministry of Labor, National Chung Shan Institute of Science and Technology, the Industrial Technology Research Institute, Axis 3D Technology, Inc., ThinkTron Ltd., Chuan Wang Technology, Ltd., etc.

Our vision

Although we focus on VR/AR research, the research and development of this laboratory will be adjusted according to the needs of the industry. At present, we mainly use Unity as the main development platform, and integrate the Internet of Things, 360 panoramic photography, motion capture, smart phones, smart watches, location positioning and other related technologies. And we have extended to VR haptic feedback system, AR positioning system for ecological parks, intelligent system for health and fitness of the elderly, and other related fields.

Image by Ian Schneider

Main Projects

IMAG0148.webp

3D Somatosensory Game Design with Head-Mounted Display based on Arduino and Oculus Rift

With 3D virtual reality (VR) technology and wearable devices developing rapidly, it is one of the popular issues in 3d game design that develops an immersive somatosensory game. To implement that, this paper integrates Arduino, Oculus Rift and Unity3D, and then develops a vr-baseball game. This system has two parts, including transmission and reception. In transmission, the Arduino Uno with a MPU6050 sensor is used to dectect whether the baseball bat is swept or not. The HC-05 bluetooth sensors are also installed into the Arduino Uno and responsible for the transmission and reception between the two parts. A touch pad sensor on the baseball bat is used to start a game. In reception, the data received from HC-05 needs to be delivered to a Unity module. The Unity module has to display the game animaton according to the received data, such as pitching of a virtual pitcher, sweeping of the baseball bat, and so on. In 3d display, the Oculus Rift is used to display the game content stereoscopically. Experimental results show the proposed system cannot only present the whole game content stereoscopically, but also react the sweeping information from the baseball bat in real time.

A Study on 3D Interactive System combining Arduino and Markerless Facial Motion Capture

Result.webp

With 3D virtual reality technology and game design developing rapidly, a growing number of research experts are becoming involved in the study of motion sensor interactions and wearable devices. To present a 3D virtual scene and allow users to interact realistically, this paper integrates 3D stereoscopic images and hand-based wearables to raise a sense of reality. This study employs Unity3D, Arduino, and a glasses-free 3D platform to achieve the above goal. In hand-based wearables, an Arduino Uno with a six-DOF sensor and a flex sensor is developed to analyze the finger posture. The finger posture analyzer with the Arduino Uno is installed on a glove. User can put on the glove to operate a 3D hand model in a game. In 3D display, this study adopts the glasses-free 3D technology, Liquid 3D, to present the stereoscopic information of 3D virtual scenes. Finally, this paper also develops a throw game using Unity3D software. This game combines the finger posture analyzer and glasses-free 3D technology. User can use the finger posture analyzer to throw virtual ball models in the game. The game system can deliver the information from the finger posture analyzer to the glasses-free 3D display module, and present the reaction results in real time.

Heading 1

Projects

  1. Development of Health Fitness Intelligent Tracking System for Seniors based on Smart Watch, XR Sports Game and Body Pose Tracking, National Science and Technology Council, Taiwan, 2024/08/01~2025/07/31.

  2. Development of a Hand-Eye Coordination Analysis System based on MR 3D Elderly Toy Game using Meta Mixed-Reality Technology, National Science and Technology Council, Taiwan, 2023/08/01~2024/07/31.

  3. Development of a Posture-Interaction-Based AR Game using Image Tracking, Ministry of Science and Technology, Taiwan, 2021/11/01~2022/10/31.

  4. ​Development of Multi-player VR Game System with Real-Time Speech and Gesture Recognition, Ministry of Science and Technology, Taiwan, 2020/11/01~2022/01/31.

  5. Development of Intelligent AR Interaction System using Deep Learning, Ministry of Science and Technology, Taiwan, 2019/06/01~2020/05/31.

  6. Virtual Reality Practice, Ministry of Education Teaching Practice Research Program, Taiwan, 2018/08/01~2019/07/31.

  7. Development of Multiplayer Head-Mounted MR System Based On Tourism Information of Government Open Data, Ministry of Science and Technology, Taiwan, 2018/08/01~2019/07/31.

  8. Development of Intelligent AR Interaction System based on Speech Recognition, Ministry of Science and Technology, Taiwan, 2018/06/01~2019/05/31.

  9. Intuitive Digital Glove Design for Virtual Reality based on Arduino Sesors, Regional Industry-University Cooperation Center, Ministry of Education, Taiwan, 2017/07/01~2017/10/31.

  10. Development of a Novel Head-Wearing Virtual Reality System based on 3D Intuition Hand-Operating Interface, Ministry of Science and Technology, Taiwan, 2017/06/01~2018/05/31.

  11. Development and Implementation of LTE Public Security using Augmented Reality, National Chung-Shan Institute of Science and Technology, 2017/04/01~2017/11/30.

  12. Development of E-Learning Materials for OCJP Certification (Advanced), Minghsin University of Science and Technology, 2017/01/01~2017/09/30.

  13. Development of a 3D VR Game System with Finger Motion Tracking, Regional Industry-University Cooperation Center, Ministry of Education, Taiwan, 2016/04/01~2016/10/31.

  14. A Study on 3D Interactive System combining Arduino and Markerless Facial Motion Capture, Ministry of Science and Technology, Taiwan, 2016/06/01~2017/05/31.

  15. 3D Somatosensory Game Design with Head-Mounted Display based on Arduino and Oculus Rift, Ministry of Science and Technology, Taiwan, 2016/07/01~2017/02/28.

  16. Development of E-Learning Materials for OCJP Certification (Basic), Minghsin University of Science and Technology, 2016/01/01~2016/09/30.

  17. A 3D Interaction Study on Combining Mobile-Phone SBS with VR Headset and Leap Motion Recognition, Ministry of Science and Technology, Taiwan, 2015/06/01~2016/05/31.

  18. 3D Model Simplification using Variable-Scaled Shape Analysis, Minghsin University of Science and Technology, Taiwan, 2015/1/1~2015/9/30.

  19. A Real-time 3D Operation System of Pair Physical Interaction Combined by Unity3D and Kinect, Ministry of Science and Technology, Taiwan, 2013/7/1~2014/2/28.

  20. Course Project for Talent Training in Information Technology : Shiva Game Programming and Design, Information Technology Software Academy, Taiwan, 2012/1/~2012/9/30.

  21. Learning Prescription: Analyzing the Learning Modes of Students using Time-Management Tools - A Case Study of Department of Computer Science and Information Engineering, Minghsin University of Science and Technology, Ministry of Science and Technology, Taiwan, 2011/8/1~2012/7/31.

  22. The Study on Constructing Mobile 3D Digital Signboards using 3D Augmented Reality Technology, Minghsin University of Science and Technology, Ministry of Science and Technology, Taiwan, 2011/6/1~2011/5/31.

  23. The Study of Interaction System for Mobile Virtual Reality based on WiiMote Structure, Minghsin University of Science and Technology, Taiwan, 2011/1/1~2011/9/30.

  24. Constructing a Real-time System of 3D Virtual Memory Hall using Wiimote and Webcam, Ministry of Science and Technology, Taiwan, 2010/7/1~2011/2/28.

  25. Cross-Discipline Technology Talent Training: Feature Analysis of 3D Model Surface, Ministry of Education, Taiwan, 2010/1/1~2010/12/31.

  26. Shape Matching for 3D Models using Surface Variation, Minghsin University of Science and Technology, Taiwan, 2010/1/1~2010/9/30.

  27. The Study and Implementation of Wireless Interaction Kits for Low-Cost Immersion VR Systems, Ministry of Science and Technology, Taiwan, 2009/11/1~2010/10/31.

  28. 3D Animation Model Compression using Multi-scale Shape Operator Sequence, Ministry of Science and Technology, Taiwan, 2009/8/1~2010/7/31.

  29. Feature Analysis of 3D Point-Cloud Models, Minghsin University of Science and Technology, Taiwan, 2009/1/1~2009/9/30.

  30. Surface Reconstruction for Point-Simplified Models using Shape Analysis, Ministry of Science and Technology, Taiwan, 2008/8/1~2009/7/31.

  31. Geometric Compression for 3D Animation Models, Minghsin University of Science and Technology, Taiwan, 2008/1/1~2008/9/30.

flysun@must.edu.tw

No.1, Xinxing Rd., Xinfeng Township, Hsinchu County 304, Taiwan.

  • Facebook

©2017 by Juin-Ling Tseng. Proudly created with Wix.com

bottom of page