Answer
False ego becomes weak when you stop feeding it.
Just as the physical body becomes weak when it is starved, false ego also becomes weak when it is denied the nourishment it seeks. Every false ego has its own food. For example, a man's false ego may seek association with women, appreciation, friendship, recognition, and various forms of material enjoyment. It is not merely about sexual attraction.
The relationship between man and woman should not be reduced to sex. From the Vedic perspective, it represents the relationship between puruṣa and prakṛti, an imitation of the supreme relationship between Radha and Krishna. This is the deeper understanding of married and conjugal life.
There are many kinds of false egos. One may possess the mentality of an animal, a human being, or even a demigod. Finer false egos seek subtler forms of enjoyment. The solution is not to feed any of them. Instead, whatever tendencies exist should be dovetailed in Krishna's service and used only for His pleasure.