In the study of dynamical processes on networks, there has been intense focus on network structure-i.e., the arrangement of edges and their associated weights-but the effects of the temporal patterns of edges remains poorly understood. In this chapter, we develop a mathematical framework for random walks on temporal networks using an approach that provides a compromise between abstract but unrealistic models and data-driven but non-mathematical approaches. To do this, we introduce a stochasti...