This System Teaches Robots to Do Household Chores in a Virtual World

This System Teaches Robots to Do Household Chores in a Virtual World

A new system called VirtualHome has the potential to teach robots how to execute household tasks in a 3D simulation.


This System Teaches Robots to Do Household Chores in a Virtual World

The Massachusetts Institute of Technology (MIT) Computer Science and Artificial Intelligence Laboratory (CSAIL) and the University of Toronto have released a paper demonstrating a new system called VirtualHome that has the potential to teach robots to execute household chores. The system features a 3D virtual world where artificial agents undertake up to 1,000 tasks assigned to them.

3,000 activities incorporated 

To create VirtualHome, the researchers incorporated in the system nearly 3,000 programs of activities, complete with their corresponding broken down subtasks. The team then devised a way to illustrate the system through a 3D Sims-like world where artificial agents can be seen executing these activities in eight different rooms of a house.
The premise behind the project is the fact that robots require explicit instructions to complete even the most simple of tasks. For instance, an instruction of “turn off the light” would require additional inputs or subtasks such as “spot the light switch,” “walk to the light switch” and “press the light switch.”
“Describing actions as computer programs has the advantage of providing clear and unambiguous descriptions of all the steps needed to complete a task,” explained MIT PhD student Xavier Puig and lead author on the paper. “These programs can instruct a robot or a virtual character, and can also be used as a representation for complex tasks with simpler actions.”

Instructions turned to codes

The researchers created these robot-suitable instructions by turning verbal descriptions of household chores into codes. These codes were combined into programs, each representing a more complex action, and fed into the VirtualHome 3D simulator.
The video's virtual agents could then be seen on screen undertaking the given program tasks. This new database of robot instructions could one day be incorporated into Alexa-like robotic systems to improve the machines' abilities to incorporate and execute new tasks.
“This line of work could facilitate true robotic personal assistants in the future,” said Qiao Wang, a research assistant in arts, media, and engineering at Arizona State University. “Instead of each task programmed by the manufacturer, the robot can learn tasks just by listening to or watching the specific person it accompanies. This allows the robot to do tasks in a personalized way, or even some day invoke an emotional connection as a result of this personalized learning process.”
INNOVATION

This New Robotics System Can Easily Learn a New Task

This isn't the first time researchers have successfully trained robots at performing human-like tasks. In 2015, UC Berkeley developed algorithms that gave robots the ability to learn motor tasks.
Their work, a form of reinforcement learning, was welcomed as a major milestone in the field of artificial intelligence. The team named their experiment BRETT, Berkeley Robot for the Elimination of Tedious Tasks, and had him complete a variety of chores.
Currently, the Allen Institute for Artificial Intelligence is also working on a robot-teaching virtual environment called Thor. This system defines objects, their corresponding uses and the actions robot can undertake with them so that the machines learn to complete tasks through trial and error.

Comments

Post a Comment

Popular posts from this blog

New Biohybrid Robot Uses Living Muscle Tissue to Move a Finger

Image
New Biohybrid Robot Uses Living Muscle Tissue to Move a Finger Researchers continue to push the limits of robotics with their new biohybrid robot which uses living muscle tissue to move its robotic fingers. In a  paper  recently published in the journal  Science Robotics , the University of Tokyo researchers presented their new  "biohybrid" robot.  The robot is a crossover between living tissue and robotics, integrating biohybrid robotics with living muscle tissue grown from the cells of a rat. The biohybrid robot could perhaps be used to replace missing appendages on humans - should the technology be repeated and replicated with human tissue. But the University of Tokyo suggests their research is laying the foundation for building far more advanced and lifelike robots. Building a Biohybrid Robot which Uses Living Tissue Fortunately, the research did not involve the direct harm of a rodent. The muscle was instead grown from myoblasts - muscle ...
Read more

Russian Search Engine Yandex Launches Its Own Smart Speaker

Russian Search Engine Yandex Launches Its Own Smart Speaker Russia's Yandex debuted its first foray into hardware with the Yandex Station, a smart speaker featuring the company's assistant named Alice. Alexa and Google Home  are getting some stiff international competition. Russian search engine Yandex recently launched its own version of a smart speaker called the  Yandex Station .  The Yandex Station is the company's first foray into hardware elements, and yes, the Yandex speakers have an assistant. While  Amazon  has Alexa, Yandex has Alice -- a Russian-speaking assistant developed by the company's in-house engineers. Alice has been available on mobile devices since she launched in October 2017.  Tens of millions of Russians use Alice for a variety of purposes, Yandex noted in a press statement. Alice will also see an expansion when Yandex debuts its connected car platform later this year after the program merged with Uber.  "With the i...
Read more

How Bill Gates aims to clean up the planet

Image
How Bill Gates aims to clean up the planet It’s a simple idea: strip CO2 from the air and use it to produce carbon-neutral fuel. But can it work on an industrial scale? I t’s nothing much to look at, but the tangle of pipes, pumps, tanks, reactors, chimneys and ducts on a messy industrial estate outside the logging town of Squamish in western Canada could just provide the fix to stop the world tipping into runaway climate change and substitute dwindling supplies of conventional fuel. It could also make Harvard superstar  physicist David Keith , Microsoft co-founder Bill Gates and oil sands magnate  Norman Murray Edwards  more money than they could ever dream of. The idea is grandiose yet simple: decarbonise the global economy by extracting global-warming carbon dioxide (CO 2)  straight from the air, using arrays of giant fans and patented chemical whizzery; and then use the gas to make clean, carbon-neutral synthetic diesel and petrol...
Read more