Of course, this technology is also very difficult. And this is not just a technology, it involves many fields, from information control systems, to hardware systems, to the entire telex control system, which is very complex.
The most rare or core one is the telex control system, and the other is the information control system.
To put it simply, it is to synchronously transmit the data of human arm movement to the robotic arm, so that people can flexibly control the robotic arm just like using an arm.
The principle is simple, but the actual technology is very complex. The first is the technology for collecting human arm movement information. This technology requires sensors worn on the body to accurately capture the movement signals of the arm.
In this regard, there are currently three mainstream solutions.
The first is to use a brain wave control scheme, which is the brain-computer control technology that has become popular recently. In fact, it uses brain waves generated by thinking and imagination to control the movement of related manipulators.
When we imagine a thing, a picture or an object, the brain waves released are different. Brain-computer control technology uses our different brain waves to control devices.
For example, after your brain imagines an idea of moving forward, your brain will release such a brain wave. The brain-computer system will recognize this brain wave and convert it into corresponding electrical signal instructions to control the device to move forward.
At present, this technology has been applied in some fields, including this kind of brain-computer controlled wheelchair for patients with high paraplegia. Patients can control the wheelchair through their brain to stop movement and so on.
There is also the use of this brain-computer control technology to perform text-related input. It is said that the input speed can reach 70 words per minute, which can be said to be very fast.
At present, some technology companies want to use this brain-computer control technology to develop related bionic mechanical arms (prostheses), so that people with disabilities can also use this bionic mechanical prostheses to gain corresponding movement capabilities.
Although progress in this area is relatively slow, many companies have developed prototypes of related bionic mechanical prostheses. Although this is still a long way from practicality, the most important step has been taken. In the future, it only requires continuous development and progress.
The second solution is to use sensors to record limb movement trajectories for operational control.
Each of our limbs, such as the movement of arms and fingers, has trajectory displacement in the three-dimensional space. This solution uses related sensors worn on the hand to record these trajectory movements, and then synchronizes them to the robotic arm to achieve synchronous movement of the robotic arm and the human arm.
The third technology is a bionic control technology that uses myoelectric signals to control the movement of the manipulator in real time.
Collect muscle electromyographic signals and joint angle signals when the human upper limbs perform flexion and extension movements on the vertical plane, and input the processed electromyographic signals and time signals into a neural network predictor to predict joint angles.
The predicted joint angles are used as control signals for the virtual manipulator to control the manipulator to make the same movements as a human.
The test results show that the maximum mean square error between the movement trajectory of the manipulator and the elbow joint angle trajectory of the human upper limb is less than 2°, and there is a strong correlation. The movement of the manipulator is controlled by myoelectric signals.
However, this technology is still not mature enough. The main problem is that the capture of these electromechanical signals is not accurate enough, and it is easily interfered by human body bioelectricity and surface static electricity.
Therefore, the second solution is currently the most used and the best solution. In fact, research on the related technologies mentioned in this set of solutions has always been a key scientific research project of Haoyu Technology.
Because this technology is not only related to the development progress of their related bionic synchronized robotic arms, but also related to the sale of their upcoming VR glasses. Therefore, research and development on this technology started very early, and good results have been achieved so far.
Earlier we mentioned several ways of human-computer interaction with VR glasses. In addition to the control handles currently used by everyone, wearable gloves with sensors all over them have also become a focus area of research for many VR manufacturers.
With this wearable control glove, VR glasses users can control many functions. You can even experience grabbing the objects in front of you with your hands, or touching the objects in front of you, etc., and experience the functional feelings that some previous interactive devices could not experience.
The team of the Automated Machinery Technology Research Laboratory wants to use this set of technical results that have been initially successfully developed to control the robotic arm.
In fact, the principles of the two are basically the same, except that the wearable gloves used on the VR eye device control the virtual limbs in the VR virtual world. At the Automated Mechanical Technology Research Laboratory, this kind of wearable glove is used to control real robot hands.
However, the technical difficulty of controlling a manipulator in reality is much higher than that of controlling a virtual manipulator in the virtual world.
Problems related to controlling virtual devices can be corrected and compensated by the program. But controlling a real robot requires the cooperation of hardware and software.
Not to mention other things, let’s just talk about the complex parts on this manipulator, the many sensors, and some related instruction set program groups, etc., as well as the coordination and unification between these complex devices. This cannot be developed casually. from.
Furthermore, this is a complex systematic engineering project involving a wide range of disciplines. Although Wu Hao and his colleagues are constantly strengthening their scientific research capabilities, their advantage is still in information technology, and they are still relatively weak in hardware technology, especially basic technology.
This has brought many unexpected difficulties to the entire R&D team. Some of them can be solved with money, but some cannot even be solved with money.
Therefore, Wu Hao has been paying close attention to the entire project research and development process, and has personally invested in related research and development, helping the R&D team solve many difficult problems.
There are also some issues that we can only work with the R&D team members to figure out, such as some issues with materials and parts. They can only find a way on their own on the one hand, and on the other hand they can ask for help from some other related equipment and parts suppliers.
Even in terms of some materials and important load-bearing and pressure-bearing parts, he also asked relevant military industrial companies for help, hoping that they could manufacture customized parts for him.
Fortunately, he is here as a non-staff expert, so there is no big problem. Moreover, the price of such customized parts is relatively high, and these companies are also willing to accept private orders for these.
