Not one of us can boast of having acquired humility: our actions, the whole of our life, prove the contrary. And where there is a lack of humility, pride is always present. Where light is wanting, darkness reigns.
Peter was first given the keys, but then he was allowed to fall into the sin of denying Christ; and so his pride was humbled by his fall. Do not be surprised, then, if after receiving the keys of spiritual knowledge you fall into various evil thoughts. Glorify our Lord, for He alone is wise: through setbacks of this kind He restrains the presumption that we tend to feel because of our advance in the knowledge of God. Trials and temptations are the reins whereby God in His providence restrains our human arrogance.
I think that for those living in community obedience is a greater virtue than chastity, however perfect. Chastity carries within it the danger of pride, but obedience has within it the promise of humility.
A great effort and much toil are needed in prayer before we can reach a state in which our mind is no longer troubled, and so attain the inward heaven of the heart where Christ dwells. As St. Paul says, 'Do you not realize that Christ dwells within you, unless you are worthless?' (cf. 2 Cor. 13:5).
A treasure that is known is quickly spent: and even so any virtue that is commented on and made a public show of is destroyed. Even as wax is melted before the face of fire, so is the soul enfeebled by praise, and loses the toughness of its virtue.
You describe how bitterly you regret the inefficacy of your prayers. Beware: to wish for consolation or revelation in prayer is a sure sign of pride. Pray humbly, in perfect simplicity, seeking salvation only through forgiveness, & having faith that God will extend to you His mercy - as He did to the publican.
'Then the devil left Him, and angels came and ministered to Him' (Matthew 4:11). It does not say that the angels were with our Lord during the actual time when He was being tempted. In the same way, when we are being tempted, God's angels for a time withdraw a little. Then, after the departure of those tempting us, they come and minister to us with divine intellections, giving us support, illumination, compunction, encouragement, patient endurance, joyfulness, and everything that saves and strengthens and renews our exhausted soul. As Nathaniel was told, 'You will see the angels ascending and descending upon the Son of man' (John 1:51); in other words, the ministry and assistance of the angels will be given generously to mankind.
In the eyes of God, it is always preeminently right that a man should spend himself in devising new means for spreading consolation to his subordinates, who are his charges.
The enemy constantly endeavors to awaken in the abyss of the human heart a great turmoil about trifles. This is one of his tricks to blind our soul to the sun of truth, Christ our Lord, hidden in the heart's core of every one of our neighbors.
Pray that you may be granted the grace to read the Fathers with the right understanding, the grace to live up to the standards they put before you, and the grace clearly to see your own frailty. You will not long be left wanting and waiting. God will give you help.
Do not think that even here any one of us constantly enjoys consolation. No: here, as everywhere, flesh and mind are at war; here as everywhere, there is falling into pride and purification through humbling: here, as everywhere, we long for consolations but must learn to carry a weighty cross. This cross tests our love. Can we, do we love God even under the weight of the most bitter adversities?
Remember always that, once we have decided consciously to strive after righteousness, we cannot escape catastrophes and sorrows, no matter where we are.
Do not attempt to assess the quality of your prayer. God alone can judge its value. To us, our own prayer must always appear so poor an effort, so inadequate an achievement, that the cry of the publican spontaneously rises from our lips.
When we are incapable of scaling the peaks of virtue, all we have to do is to descend into the ravine of humility. Our humility is our surest intercessor before the face of the Lord.
In answer to your question as to what constitutes a happy life, whether splendor, fame and wealth, or a quiet, peaceful, family life, I will say that I agree with the latter, but will add the following: A life lived in humility and with an irreproachable conscience brings peace, tranquility, and true happiness. But wealth, honor, glory and exalted position often serve as the cause of a multitude of sins, and such happiness is not one on which to rely.