Sam Eggington 'irritated' by retirement talk as defiant star insists he's going nowhere