This paper proposes a method to decompose any n-state stochastic system into m r-state component stochastic systems. The basic tool in our method is a partition with substitution property which exists on the set of states of the interconnected stochastic system. Using our method it is mainly shown that there exists a relationship among n, m and r, and for one outer input, some specific number of transition matrices are assigned to each component.