The author of Reinforcement Learning: An Introduction gives an example of a state-value function using a grid (Example 3.5).
Supplementary Note to the Gridworld Exmaple…
The author of Reinforcement Learning: An Introduction gives an example of a state-value function using a grid (Example 3.5).