IMHO, you really can't manage your E2 very effectively on that assay platform. E2 sensitive or Ultra Sensitive is the standard needed for men. Everything else is just guess work. I would anticipate you would also be a bit high with the Sensitive, but it's speculation without the correct assays.
Agree, maybe serum is a little bit up there, maybe it can come down a bit. What is your free/bio test look like, and/or SHBG? Depending on where the E2 sits with a Sensitive Assay, possibly a small amount of AI could/might be implemented for a short period of time to get estrogen stabilized.
I personally like what you're doing with the drisdol script (Vitamin D2). You should only need it for about 4 to 6 weeks, then you can just move over to daily D3 supplements. 6,000iu to 8,000iu/day seems to do good with me, but check with your doctor to see what works for you!