tailieunhanh - Design and development of human skill transfer system with augmented reality

This paper presents the design and development of a skill transferring system of a human’s hand trajectory. Aims of this system are capturing, encoding, and playing back of the demonstrator’s hand trajectory in both spatial and temporal data. | Journal of Automation and Control Engineering Vol. 3, No. 5, October 2015 Design and Development of Human Skill Transfer System with Augmented Reality Tarinee Tonggoed and Siam Charoenseang Institute of Field Robotics, King Mongkut’s University of Technology Thonburi, Bangkok, Thailand Email: 54501901@, siam@ Abstract—This paper presents the design and development of a skill transferring system of a human’s hand trajectory. Aims of this system are capturing, encoding, and playing back of the demonstrator’s hand trajectory in both spatial and temporal data. To capture a human’s hand movement, the Microsoft’s Kinect sensor is selected to track the human skeleton and send it to the trajectory modeler to encode the demonstrator’s movement. The Gaussian mixture model with its modification of initial parameter estimation is applied in the encoding process. In the playback phase, augmented reality is implemented to provide the learner with some guided positions and times in the form of 2D and 3D computer graphics. The result of applying the proposed algorithm in Gaussian mixture model with initial parameter estimation which is compared with the traditional k-means and incremental k-means approaches takes the least training time. In the playback process, the averaged errors of the playback graphics information for the hand movement skill transfer system are about cm. in x axis and cm. in y axis. The implementation results demonstrate that the proposed system can capture, encode, and play back the demonstrator’s hand trajectory along with augmented reality effectively. Index Terms—human skill augmented reality I. transfer, the proper force to help user to perform tasks appropriately. While T. Tonggoed and S. Charoenseang [6] contributed on a skill transferring system of human hand movement through the Novint Falcon which is a 3 DOF haptic device. The techniques of virtual reality and augmented reality have been utilized to .

• Cơ khí - Chế tạo máy
• Journal of Automation and Control Engineering
• Design and development of human skill transfer system
• Human skill transfer system with augmented reality
• Spatial and temporal data
• The demonstrator’s hand trajectory
• Increasing the productivity of automation tool by developing socket
• Automation tool by developing socket
• Auto report generated
• The automation tool
• Abnormality management in industrial automation systems
• Industrial automation systems
• Future industrial automation systems
• Abnormality management approach
• Sliding mode based relative pose synchronous control
• Space autonomous rendezvous
• Relative pose synchronous control
• The control system design
• The sliding mode control law
• Application of pressure control type quasiservo valve
• Force control system
• The quasi servo valve
• The pneumatic cylinder
• Robust vehicle suspension system
• Converting active & passive control
• A vehicle to semi active control system analytically
• Semi Active Vehicle System
• Environmental control of a greenhouse system
• NI embedded systems technology
• The soil moisture
• The Engineering School of Bahrain Polytechnic
• Design of control system for 3D printer
• DSP and FPGA
• Control system for 3D printer
• Closed loop control
• Improving performances of a cement rotary kiln
• A model predictive control solution
• Cement rotary kiln
• Advanced process control
• Model predictive control
• Active learning in motor control and matlab simulation
• Active learning in motor control
• Servo motors of the simulation of neural networks
• Motion of a robot arm
• Redundancy and operation of power control system
• A deep space small probe
• Functions of redundancy
• Power Control Unit
• Closed loop speed control of miniature brushless DC motors
• Closed loop speed control
• Miniature brushless DC motors
• Delta Connected BLDC motors
• Adaptive wavelet backstepping control
• Class of mimo underactuated systems
• Multi input multi output
• Proposed control scheme
• Adaptive backstepping controller
• Hybrid position force control for a stewart platform
• Hybrid position force control
• The work surface
• The stewart platform
• Robust control of double inverted pendulum system
• Double inverted pendulum system
• Reference trajectory control
• The dynamic modeling
• Speech recognition in human computer interactive control
• Computer interactive control
• HTK and Sphinx
• Vietnamese speech recognition
• Human computer interaction
• Command shaped robust control of a flexible spacecraft
• Command shaped robust control
• Strong cross couplings
• Loop shaping design
• Optimal control of vehicle active suspension system
• Vehicle active suspension system
• The active suspension system
• LQR control technique
• Mimo fuzzy control for autonomous mobile robot
• Mimo fuzzy control
• Autonomous mobile robot
• Implementation of multi input multi output
• Reach defined target
• Asynthesis method of robust cascade control system
• Robust cascade control system
• Imposes robust conditions
• Soft oscillation index
• Efficient adaptive fuzzy control scheme for industrial manipulators
• Degree of freedom
• Fuzzy control scheme
• IMO nonlinear second order systems
• Multilevel inverter topology and control techniques
• Reduce electromagnetic interference
• Control strategies employed
• Linear quadratic optimal control problem of stochastic switching systems
• Linear quadratic optimal control problem
• Stochastic switching systems
• Non invariant linear systems
• Investigation of hybrid adaptive control schemes
• Needle free jet injection system
• Hybrid adaptive control schemes
• Needle free jet injection
• Modelling and simulations
• Development of a new algorithm
• Control excitation of particular mode of a building
• Particular mode of a building
• Sliding mode control
• Control of electric motor machine tools
• Self organizing fuzzy logic controller
• Modify the control rule
• The self organizing fuzzy logic controller