The Aston Villa manager was angry during his full time comments