Carbs is one issue.
But whole wheat has other things that harm health besides carbs, as far as I know.
For instance, it may inhibit absorbtion of nutrients, it may be GMO.
But you may find mixed opinions and some nutritionists actually saying it's healthy.
Maybe flip a coin to decide.