We introduce a simple iterative technique for bounding derivatives of solutions of Stein equations Lf=h-Eh(Z) where L is a linear differential operator and Z is the limit random variable. Given bounds on just the solutions or certain lower order derivatives of the solution, the technique allows one to deduce bounds for derivatives of any order, in terms of supremum norms of derivatives of the test function h. This approach can be readily applied to many Stein equations from the literature....