wardellinthehouse t1_j6zrsvp wrote
I asked this same question: https://www.reddit.com/r/reinforcementlearning/comments/zqfw7r/why_cant_we_do_supervised_learning_in_step_3_of/?utm_source=share&utm_medium=android_app&utm_name=androidcss&utm_term=1&utm_content=share_button
I believe the answer is due to the fact that sampling from the policy network is a non-differentiable operation.
Viewing a single comment thread. View all comments