Controllable robots hold a promising future for us, but today’s current models can be tricky to control for untrained users. They often involve complex electronics to manipulate, but that is about to change with the system started by a group of researchers at Carnegie Mellon University – robotic telekinesis.

Besides the ability to control the robot remotely, another exciting news about this robotic telekinesis system is its ability to translate the user’s action via an RGB camera . The robotic hand and arm will replicate the action by simply demonstrating a specific action. This makes it different from the previous inventions that commonly utilize complicated systems to control robots, like remote controllers and other devices.

“Prior works in this area rely either on gloves, motion markers or a calibrated multi-camera setup,” Deepak Pathak, one of the researchers of the team told TechXplore. “Instead, our system works using a single uncalibrated camera. Since no calibration is needed, the user can be standing anywhere and still successfully teleoperate the robot.”

According to Pathak, what even makes the robot’s system remarkable is the fact that it was entirely trained with just a series of YouTube videos showing individuals performing arm actions. Pathak said it can analyze simple two-dimensional images, making it an incredibly straightforward tech for anyone – even an unpracticed person. He said that the team had to focus on computer vision and 3D human pose estimation.

“The diversity of huge passive video data helps it work across untrained users, tasks, and objects,” Pathak stated. “Our system offers a low-cost and natural way to teach robots via demonstrations, as opposed to kinesthetically holding the robot or wearing a glove or motion capture suit… Hopefully, our recent work is just one of many future directions in which internet videos act as a rich source of supervision for robotic control, in addition to robotic vision.”

With all of these things, the researchers believe that the tech can be useful in everyday situations, especially to tasks that can be dangerous for a human’s presence. 

“Robotic telekinesis and similar technologies will enable robot teaching in a larger variety of settings, including in households, where they will be expected to perform everyday tasks.” Pathak said, “Using only a single uncalibrated camera, our system can in theory be controlled from anywhere in the world, thus it makes robot teaching more accessible to anyone. We are now collecting large-scale data using our robotic telekinesis system to teach the robot to act and adapt autonomously in the real world.”

by Sharron Bennet on February 14, 2022

Samsung 85″ Class Q70A Series QLED 4K UHD Smart Tizen TV has a huge screen for outstanding visual performance and a perfectly engineered sound system for rich audio. If those things ar...

Yoga 7i is one of the most coveted laptops from Lenovo. It offers an excellent display, long battery life, and robust components. But here is the most giant magnet of this model: an incredib...

Samsung is one of the most trusted brands when it comes to televisions. The brand offers incredible features that set its TV models apart from others. One of them is the Samsung QN85A, an 85...

Finding the perfect television can be challenging as high specs mean a seriously eye-watering price tag. This is why all of us wait for Black Friday or scour stores to get the best deals for...

Truckers, event organizers, and managers will love the discounted deal of BlueParrott B550-XT on Amazon. It will enable professionals to focus their attention on work at a lower price while ...

Garmin Venu sports all the smart features available in other luxurious brands, and it can last up to 120 hours on a single charge. All these incredible things are sealed in a sophisticatedly...

Always wanted to have an LG TV with superior technology, unbelievable visuals, and one of a kind audio system? Here is the good news you would like to hear: you can save $200 on LG C1 Series...

With the diminishing line between life and work at present, a laptop that could easily switch from being a working partner to a relaxation buddy with such ease would be a sweet deal. In this...

Watching movies on television is convenient. Cinemas are fun. You can have all those experiences with a mini projector. So, here is Bomaker WiFi mini projector with an enormous 59% discount ...

MSI Sword 15 gaming laptop has all the charms to attract gamers of any kind: Intel Core i7 processor, 8GB of RAM power, and NVIDIA GeForce RTX 3050ti graphics card. The most exciting part ab...