‘Self-aware’ robots can learn complex tasks by watching humans. Is that a good thing?

Imagine a robot that could do your laundry, make your bed, cook your dinner, or stock the dairy section at your local grocery store. Humans have long been able to teach robots how to do individual tasks, but instructing them on these more sophisticated jobs has been an elusive goal, despite billions of dollars invested into robotics.

Now, a team of scientists in Switzerland has made progress in the quest to invent helpful robots that can act on complex instruction from humans. The development raises questions about whether this kind of technology could someday learn not only to help humans, but to also become capable of harming them.

Inventing the personal barista 

For years, robotics scientist Sthithpragya Gupta has been dreaming about the things his robot might do. “I personally want the robot to make me a coffee,” says Gupta. He and his colleagues at École Polytechnique Fédérale de Lausanne — an engineering school in Switzerland — keep late hours at their lab in the Swiss Alps. “There’s a lot of coffee consumption,” says Gupta.

“If I could just say ‘a little bit of sugar, a bit more creamer,’ stuff like that,” he says. “That would be a dream come true.”

A problem that robotics scientists and engineers like Gupta have long battled is that robots cannot do tasks beyond those they are specifically programmed for. Gupta uses a tennis example to explain the issue. Robots may be able to learn how to hit a backhand shot, he explains. They can backhand that ball perfectly again, and again, and again. But if conditions change — say, their opponent moves, or the light changes — it all falls apart. Humans have no problem adjusting to these kinds of changes. Teaching a robot how to adapt, though, is much more difficult.

“It’s very difficult to transfer this behavior from humans to robots,” says Gupta.

Until now, he hopes. Gupta and his colleagues have published a paper in the journal Science Robotics demonstrating a new way of teaching robots using machine learning, a type of artificial intelligence. The approach relies on kinematic intelligence — a robot’s built-in awareness of how its own body can move safely through space.

In a video demonstrating their technology, robots with a single arm attached to a base watch as a human instructor tosses a ball into a small container. The robots then pick up the ball and copy the instructor’s behavior, adjusting for their own position and accommodating their non-human bodies. Robots are then capable of transferring these skills and knowledge to other robots.

“It could be a turning point,” says Robert Platt, who studies engineering and robotics at Northeastern University. Platt, who called the work a “breakthrough,” noted that the field of robotics is not in widespread agreement about the path forward to creating effective robots through machine learning — but that most agree the problem these researchers are tackling is a critical one. “More people may do this in the future,” he said.

Platt was hesitant to forecast any particular timeline for robots becoming widespread household accessories. “We’re at a point of very fast change,” he notes. “ Part of the reason why I hesitate to make predictions — look what happened with large language models,” he says, referring to generative AI chatbots such as ChatGPT or Claude that have been widely adopted. “We were a long way away and then all of a sudden — we weren’t.”

A fine line between self-awareness and consciousness 

If a robot can self-correct and teach others, does that make it self-aware?

“ It looks like this robot is capable of doing some very impressive feats of learning,” says Susan Schneider, who studies artificial intelligence at Florida Atlantic University. “But that doesn’t mean something has full-blown consciousness or inner awareness in the sense that biological beings have it.”

Schneider points out that a critical distinction between robots and humans is feeling. “Consciousness is the felt quality of experience,” she says. “When you sip your morning espresso shot, when you see the richness of the sunset, when you have a headache, it feels like something from the inside to be you.”

But this lack of consciousness poses new questions about ethics. “It immediately raises alarm bells in any AI safety researcher’s mind,” says Schneider. Later versions of this kind of technology, she says, could potentially be weaponized against humans.

Researchers have taken care to include safety protocols to ensure that robots aren’t able to hurt people. Even they acknowledge, however, that future development of this technology will need guardrails. “ I think really soon we should have regulatory frameworks on who operates a robot and how,” says Gupta.

Humans are at an inflection point with robotics, says Susan Schneider. “It’s a very exciting time,” she says, “and we just don’t know where it’s headed.”