This page demonstrate a parallel computing tool implemented in R. You have to have a MPI environment and a Rmpi package to run this example. It also show the comparison with other methods. In general, not all computing problem can be easily parallelized such as MCMC, and not all parallel computing is more efficient than series computing. Parallel computing is also highly dependent on programing and algorithm.