Updated publications

This commit is contained in:
Brandon Rozek 2025-03-08 14:45:45 -05:00
parent f9a2efa399
commit c6d5197753
No known key found for this signature in database
GPG key ID: DFB0E78F805F4567
3 changed files with 48 additions and 4 deletions

21
content/paper/2406.01.md Normal file
View file

@ -0,0 +1,21 @@
---
draft: false
title: "Guiding Hiearchical Reinforcement Learning in Partially Observable Environments with AI Planning"
authors: [
"Brandon Rozek",
"Junkyu Lee",
"Harsha Kokel",
"Michael Katz",
"Shirin Sohrabi"
]
date: 2024-06-02
publish_date: "2024/06/02"
conference: "International Workshop on Bridging the Gap Between AI Planning and Reinforcement Learning (PRL)"
isbn: ""
doi: ""
language: "English"
pdf_url: "https://prl-theworkshop.github.io/prl2024-icaps/papers/12.pdf"
abstract: "Partially observable Markov decision processes challenge reinforcement learning agents since observations provide an limited view of the environment. This often requires an agent to explore collecting observations to form the necessary state information to complete the task. Even assuming knowledge is monotonic, it is difficult to know when to stop exploration. We integrate AI planning within hierarchical reinforcement learning to aide in the exploration of partially observable environments. Given a set of unknown state variables, their potential valuations, along with which abstract operators may discover them, we create an abstract fully-observable non-deterministic planning problem which captures the agents abstract belief state. This decomposes the POMDP into a tree of semi-POMDPs based on sensing outcomes. We evaluate our agents performance on a MiniGrid domain and show how guided exploration may improve agent performance."
---