Which algorithm is used for solving temporal probabilistic reasoning?

To solve temporal probabilistic reasoning, i suggest to use HMM (Hidden Markov Model), independent of transition and sensor model.