Researchers hope the OpenAI bot’s ability to solve video-gaming issues proves its aptitude in taking on more difficult, nongaming challenges.
OpenAI made headlines last year when it proved a bot could beat a professional gamer head-to-head at one of the world’s most complex video games. But it had one more gaming goal to conquer — to beat a professional team of five.
Now, after proving the bot can beat teams that rank in the top 1 percent of amateur players for its game of choice, OpenAI will get its chance to shine at the International, one of the world’s most established video-game tournaments.
The August tournament — with teams playing “Dota 2,” developed by Bellevue-based Valve — is where the researchers hope to showcase how far their bot has come in terms of its ability to control its own team of five characters as well as any team of five humans can.
The International traditionally has been held at Seattle’s KeyArena. But it will relocate to Rogers Arena in Vancouver, B.C. this year, a move Valve has attributed to upcoming construction at KeyArena.
Most Read Business Stories
- King County property tax bills are coming, and the housing market slowdown won't lower your bill
- We were mall rats once, and young: The death of an American dream | Jon Talton
- Seattle still has the most cranes in America, and construction isn't losing much steam
- Furloughed federal workers offered 90-day, interest-free loans by Washington Federal
- Alaska Airlines flight diversion leads to a 30-hour nightmare for passengers WATCH
While machines have beaten humans at games — from IBM computer Deep Blue’s chess victory in 1997 to Google’s bot toppling Go champion Lee Sedol in 2016 — each game has offered a new challenge for artificial intelligence to solve.
With Dota 2, two teams of five players can battle each other for control of a map. There are complex issues that OpenAI will have to solve. For example, the bot can’t see the whole board at the same time and it must come up with a strategy as it encounters enemies. In other words, the bot has to show intuition. Researchers hope its ability to solve these issues proves its aptitude in taking on more difficult, nongaming challenges.
“This technology can apply to a huge range of problems,” OpenAI chief technology officer Greg Brockman said. “My hope is this is the last game milestone.”
The intuition OpenAI’s bot has developed is what’s exciting, Brockman said. On Tuesday he told the House Science Committee that developing that kind of instinct could help AI excel at starting companies, making business deals or writing books.
The hope is that the game bot will draw more attention to the real-world applications of what OpenAI’s work can accomplish, such as managing resources in health care or keeping an eye on problems that crop up in a city’s transportation system.
OpenAI, which was co-founded by Elon Musk, trained its bot for the equivalent of 180 years per day to reach this point, pitting it against itself and the occasional human. Scaling the program up from solo-playing started in August, with OpenAI’s human team kicking the bot’s butt within 10 or 15 minutes at the start.
Then the matches started taking 20 minutes. Then 45 minutes. Within a few weeks, OpenAI’s team had to call for reinforcements, because the bot had outstripped the playing talent of the people on the team.
“At some point, we couldn’t tell if it was making good decisions,” said Brooke Chan, software engineer on the project. The difficulty of opponents ramped up quickly from there. The bot played a professional game-caster, then some amateur and semipro teams — holding its own for longer and longer matches before eventually beating the humans.
There are some limits to the bot. As with the one-on-one play, programmers have taken out some of the more complicated aspects of the game. It uses just five of the 115 characters available in the game, and human players have to use the same characters.
Still it quickly became a sophisticated player, and with very little strategic direction from its programmers. Developers told the bot only when it had done something good. They didn’t make gameplay suggestions or set priorities.
Yet as the bot learned, it started using techniques that professional players had adopted. That included some — such as making big sacrifices at the start of the game — that seemed counterintuitive. Chan said that while the team at OpenAI hadn’t heard of some of these strategies, it turned out the bot had independently hit on a strategy growing in popularity on the professional circuit.
Professional gamers have also learned from the bot. After OpenAI’s bot last year beat a solo player, Brockman said, some players have adopted its more aggressive style. That thought — that the bot can change the way people look at problems — encourages OpenAI when it thinks about how humans and these bots interact.