By Yinggan XU Dibbla The notebook basically is a summary for what is mentioned in Hung-Yi Lee’s ML course 2022. Sometimes people have contradictive ideas like whether PPO is an off-policy algorithm (or my grammar mistakes in the notebook) , but in this notebook, I’m going to make things aligned with Hung-Yi Lee’s idea. Lecture 1 - Intro & Basic Idea of ML The basic idea of ML, according to Lee, is to find a function....