Not if your visa is still valid; however, in practice most visas have a limited period of validity. Once the visa is no longer valid, you don't need to carry the old passport. .Not to be confused with Extension of Stay stamps (not visas) which can and need to be transferred by Immigration to the new passport.