Fig. 4: Close-loop control of robotic hand and interactive Super Mario game assisted with the multifunction tactile system. | npj Flexible Electronics

Fig. 4: Close-loop control of robotic hand and interactive Super Mario game assisted with the multifunction tactile system.

From: Multifunctional biomimetic tactile system via a stick-slip sensing strategy for human–machine interactions

Fig. 4

a Schematic illustrations for the robotic hand assisted with the multifunction tactile system, containing analog signal acquisition, processing, machine-learning recognition, feedback control of robotic hand through Arduino. b Flow chart for the grasp operation of robotic hands. c Photographs of actual online feedback control in response to the slippage and touch of a cup. (i) initial state, (ii) grasp once the slippage occur, (iii) keep still when only measured light or heavy touch. d Schematic illustrations for the interactive Super Mario game assisted with the multifunction tactile system, showing the human finger equipped with the bioinspired sensor, analog signal acquisition, processing, machine-learning recognition, interactive events in Super Mario through pygame. e Flow chart for the operation of Super Mario game. f Screenshots of actual online interactive Super Mario game in response to the light touch, heavy touch and slippage by index finger, (i) go forward if light touch occur, (ii) go backward once heavy touch occur, (iii) jump if sliding happen.

Back to article page