I wouldn't listen much to a nutritionist, they just go by BS daily value standards for skinny, weak, unlifting people.
Milk is fine, as long as you don't go full retard and do GOMAD. Just watch your calories, as milk is packed with them. Honestly, dieticians and nutritionists are retarded for the most part, and they try and oversimplify things. While I wouldn't recommend it, there was a training log on bodybuilding.com Misc where some guys got to under 10% bodyfat by consuming ONLY ice cream and pizza, and their lifts actually increased. As I said, I wouldn't recommend it, but basically, everything dieticians and nutritionists say, you should take with a grain of salt. Weight gain/loss is simply calories consumed versus calories burned. You can get fat as fuck on salad and fruits, and lean as fuck on ice cream and pizza.
I know I kinda rambled off, but my point is, milk isn't bad, don't listen to that "nutritionist".
Me personally, while I don't do GOMAD, I have 1-2 protein shakes a day with milk (usually 1 as a meal replacement, as with the protein scoops, the shake and milk is like 700 calories), and have had no problems.