Hi Nova.
The thing is...
You take anti-androgens and oestrogen and you are going to "de-masculinise". Testosterone and male virility go hand in hand, and the physical requirements for enjoying sex as a man will inevitably become impaired on female hormones. How soon and how much this happens can vary greatly between individuals, and will depend on your particular hormone regime as well as your physiological make-up.
After 10 months on the hormones you have been taking your testosterone count will be negligible, practically zero. This will affect erectile function, sperm count, semen will virtually disappear if indeed you are able to produce it. It's not so much about libido, it's a physical thing. The drugs are turning your body into that of a woman, and you are trying to perform as a man. Something's got to give, and the first thing is usually sexual function. Although all may not be lost...
I was 3 years pre-op on hormones and was still able to enjoy sex, though I never went with a woman in that time so never needed to "penetrate". I suspect it may have been a problem had the situation, um, come up. Let's just say I had gotten much smaller and less... rigid, but I could still orgasm.
The older you get the less you need anti-androgens in my opinion. Furthermore, oestrogen alone will hugely affect your testosterone count; mine was reduced to zero without the use of anti-androgens and even on a small dose of oestrogen. I had just passed 40 when I started. Cyproterone acetate is a powerful anti-androgen and you probably don't need it for good feminisation past your mid-twenties, or thereabouts.
You are right to stop the cyproterone, it's a risky drug and not something you should be taking long term. But I wouldn't particularly recommend bicalutamide either, it's very dangerous in high doses.
Any change in hormone regime will cause ups and downs, so always wait for things to settle before making any decisions. What is your dosage of estradiol? If it's bio-identical it's pretty safe, even long term, and is the one sure-fire thing that will feminise your body. A sensible dose of estradiol alone, in my opinion is a far wiser option than a low dose combined with a dangerous anti-androgen. With all AA's it's absolutely essential to have regular liver function and other tests. 
I'm now 10 years on estradiol, 7 years post op. Sex is amazing, but obviously I do it differently now
xx