2021-07-10
Novelty and MCTS
Publication
Publication
Novelty search has become a popular technique in different fields such as evolutionary computing, classical AI planning, and deep reinforcement learning. Searching for novelty instead of, or in addition to, directly maximizing the search objective, aims at avoiding dead ends and local minima, and overall improving exploration. We propose and test the integration of novelty into Monte Carlo Tree Search (MCTS), a state-of-the-art framework for online RL planning, by linearly combining value estimates with novelty scores during the selection phase of MCTS. Three different novelty measures are adapted from the literature, integrated into MCTS, and tested in four different board games. The initial results are promising and point towards potential for novelty as "online generalization for uncertainty"in more challenging search settings.
| Additional Metadata | |
|---|---|
| , , , | |
| doi.org/10.1145/3449726.3463217 | |
| EVORL @ GECCO 2021 | |
| Organisation | Intelligent and autonomous systems |
|
Baier, H., & Kaisers, M. (2021). Novelty and MCTS. In Proceedings of the 1st Evolutionary Reinforcement Learning Workshop at GECCO 2021 (pp. 1483–1487). doi:10.1145/3449726.3463217 |
|
