ZhiZhi Gewu

The author of Reinforcement Learning: An Introduction gives an example of a state-value function using a grid (Example 3.5). Readers like me may be confused about how the values of each cell are calculated. The author provided codes to compute the state value. The codes are written in LISP.

Reading is a beacon of knowledge in the lifelong learning journey, offering pathways to myriad destinations. Yet, as I reflect on my reading habits, I've come to recognise the existence of distinct reading methodologies, each serving a unique purpose in the quest for understanding. 1. The Quest for

Recently, I have been reading Reinforcement Learning: An Introduction by Sutton and Barto. In Chapter 3, Session 5, I found the derivation of the Bellman Equation hard to follow. I hope this supplementary note can provide information to the coming students. The section contains all the necessary information to understand

The example presented in Reinforcement Learning: An Introduction by Sutton and Barto. A possible value added by this article is to provide a more detailed explanation and code snippets to replicate the example. The 10-armed Bandit Example For readers not familiar with the k-armed bandit problem, you are repeatedly faced

TLDR For two groups with a two-sided alternative, normal distribution with homogeneous variances ( \(\sigma_0^2 = \sigma_1 ^2 = \sigma ^2)\) and equal sample sizes (\(n_0 = n_1 = n\)), \[n = \frac{16}{\Delta^2}\] where \[\Delta = \frac{\mu_0 - \mu_1}{\sigma} = \frac{\delta}{\sigma}\] Examples: What sample

Hello Brilliant Minds and Passionate Creators, Welcome to this week’s edition of our journey together in the fascinating world of "Building in Public." Each step we take is a story of discovery, learning, and sharing, aimed at not just building projects but fostering a vibrant community of