I'd imagine Milner was quite popular in the villa dressing room and I'd imagine that the likes of young, downing, gabby, dunne, delph etc.. Wouldn't want to play for a club that forces not only their mate out but also one of the teams best players.
It would be a ridiculous move from the club to try and force him out. If true I'm sure we'll see some angry comments from other players soon.