I respectfully disagree with my colleagues. You're in uncharted territory with such high estradiol. Nobody can give you complete assurance that this is going to be benign in the long run, particularly when estradiol is also relatively high as a fraction of testosterone.
Here's one potential negative:
A paradoxical decline in semen parameters in men treated with clomiphene citrate
...
Elevated estradiol levels result in vacuolization and increased glycoprotein production impairing Sertoli cell function. It also disturbs communication with germ cells, increases collagen synthesis and fatty degeneration in the testicular connective tissue. All these actions collectively result in the induction of germ cell death (Leavy et al., 2017). Oestradiol also plays a critical role in round spermatid chromatin reorganization during spermiogenesis through its action on Estrogen Receptor Alpha (ERα) present on Sertoli cells (Cacciola et al., 2013). Overexposure to estrogens reduces the expression of ERα on Sertoli cells, impacting this critical action. Moreover, it has been recognized that supraphysiological concentrations of estrogen act as powerful apoptotic triggers that induce germ cell apoptosis (Correia et al., 2015).
This isn't to say that forcing estradiol lower with aromatase inhibitors is necessarily any better. There are plenty of unknowns here as well.
If you have access to a testosterone nasal gel, such as Natesto, then it's worth looking into as an alternative to traditional TRT. This form of treatment keeps your hormones in a more natural state, and preserves fertility. I suspect this short-acting testosterone would not give you nearly as much trouble with elevated estrogen.