Not he is chaste in whom shameful thoughts stop in time of struggle, work and endeavor, but he who by the trueness of his heart makes chaste the vision of his mind not letting it stretch out towards unseemly thoughts.
We ought not to grieve or become irritated at anything because, by frequent vexation and irritability, we form the morally and physically very injurious habit of irritability, whilst by bearing opposition with equanimity we form the good and useful habit of enduring everything calmly and patiently.
You ask for some way of completely eradicating irritability. The inclination to irritability is given us to use against sin, and we were never meant to use it against our fellow men. When we do, we act contrary to our true nature.