University of Illinois Urbana-Champaign researchers have developed a method for training multiple robots or drones to work together using multi-agent reinforcement learning, a type of artificial intelligence.
Robots or drones can work together to collaborate and complete a task, when communication lines are open. But what if they aren’t equipped with the right hardware or the signals are blocked, making communication impossible?
“It’s easier when agents can talk to each other,” said Huy Tran, an aerospace engineer at Illinois. “But we wanted to do this in a way that’s decentralised, meaning that they don’t talk to each other. We also focused on situations where it’s not obvious what the different roles or jobs for the agents should be.”
Tran said this scenario is much more complex and a harder problem because it’s not clear what one agent should do versus another agent.
“The interesting question is how do we learn to accomplish a task together over time,” Tran said.
The researchers used machine learning to solve this problem by creating a utility function that tells the agent when it is doing something useful or good for the team.
“With team goals, it’s hard to know who contributed to the win,” he said. “We developed a machine learning technique that allows us to identify when an individual agent contributes to the global team objective. If you look at it in terms of sports, one football player may score, but we also want to know about actions by other teammates that led to the goal, like assists. It’s hard to understand these delayed effects.”
The machine learning algorithms can also identify when an agent or robot is doing something that doesn’t contribute to the goal. “It’s not so much the robot chose to do something wrong, just something that isn’t useful to the end goal.”
The researchers tested their algorithms using simulated games like Capture the Flag and StarCraft, a popular computer game.
“StarCraft can be a little bit more unpredictable – we were excited to see our method work well in this environment too.”
Tran said this type of algorithm is applicable to many real-life situations, such as military surveillance, robots working together in a warehouse, traffic signal control, autonomous vehicles coordinating deliveries, or controlling an electric power grid.
Tran said Seung Hyun Kim did most of the theory behind the idea when he was an undergraduate student studying mechanical engineering, with Neale Van Stralen, an aerospace student, helping with the implementation. Tran and Girish Chowdhary advised both students. The work was recently presented to the AI community at the Autonomous Agents and Multi-Agent Systems peer-reviewed conference.
Check out more robotics and innovation stories at our Communications and Industrial page. You can also comment below or feel free to chat via our LinkedIn page.
Plus, IoT Insider’s sister publication Electronic Specifier has more at its Robotics industries page.
