CCN Seminar with Memming Park & Josue Nassar


Description:Hi there,

You are invited to our CCN Seminar on September 29th at 12:30PM which will be held in the 3rd Floor classroom at the Flatiron. Please welcome our guest speakers, Memming Park, Associate Professor, Department of Neurobiology and Behavior, Stony Brook University and Josue Nassar., Ph.D. candidate, Stony Brook University. 

Title: Maximizing Exploration in Unknown Dynamical Environments with (Potential) Attractors

Abstract: Exploration of an unknown system is a fundamental problem in many fields of science and engineering, such as neuroscience, system identification, and reinforcement learning (RL). To tackle this problem, a variety of approximate solutions—primarily originating from RL—have been proposed. While these methods have found empirical success, the problem of exploration has been traditionally formulated as an episodic and offline problem. This is not the case in neuroscience where exploration must be done online in a non-episodic manner. Moreover, the environments in RL are primarily input-driven while the intrinsic dynamics of neural systems are strong and the strength and frequency of the actions the agent can take are limited. Surprisingly, the problem of online exploration has been relatively unexplored by the RL community. To tackle this, we introduce Escape-the-Maze (EtM), a model-based RL algorithm that combines a simple exploration bonus with an uncertainty-aware dynamics model. We prove that this combination leads to a synergistic relationship between the agent minimizing its uncertainty over the dynamics model while simultaneously attempting to explore the state-space. We empirically validate the proposed approach against previously proposed exploration-based deep RL methods and find that not only is the proposed approach superior but many of the previously proposed approaches are not well-suited for this problem.

This seminar will be in place of the LCV Group meeting. 

If you wish to tune in remotely, please use the Zoom credentials provided below.


Join from PC, Mac, Linux, iOS or Android:
    Passcode: 946697

Or Telephone:
    Dial(for higher quality, dial a number based on your current location):
        US: +1 646 558 8656 or +1 312 626 6799 or +1 301 715 8592 or +1 253 215 8782 or +1 346 248 7799 or +1 669 900 6833
    Meeting ID: 936 0049 4967
    Passcode: 946697
    International numbers available:

Or an H.323 room system: (US East)
    Meeting ID: 936 0049 4967
    Passcode: 946697