Ministers are urged the tackle the “crisis of economic inactivity”, in a letter from Labour MPs.