I suspect you are still in perimenopause as same happened to me during peri years though I wasn't on BCP/HRT so a bit easier for me to work out what was going on. During long anovulatory stretches of unopposed oestrogen when I went many weeks & later months between periods, I would retain lots of fluid, feeling uncomfortable, bloated & sluggish. Then in the 10-14 days before a period however long the cycle had been, I'd suddenly start passing huge volumes of water, feel way too hot & hyper, exhausted, with insomnia ramping up off the scale. In those 2 weeks I'd lose 7-8lbs, which was alarming as already underweight. Unlike you I didn't feel better then & came to dread that phase of my cycles.
It's documented that progesterone has diuretic effects, so I think prog kicking in at ovulation was the cause of those symptoms for me & wonder whether you could be feeling the combined effects of some residual ovarian function & those of your Cerazette POP? Decades since I took the pill & I had to Google Cerazette which I see is atypical for a POP, so please don't take this interpretation as any more than suggestion. Hopefully someone with greater knowledge about Cerazette will be along soon.
Certainly for me, oestrogen causes fluid retention & progesterone counters that - I'm on cyclical HRT so it's easy for me to see that in action. I would talk to your menopause specialist about your concerns so that together you can come up with an appropriate plan of action.