Any security or privacy risk if I replace xfce with i3?

I’m thinking about replacing xfce with i3 window manager in my Whonix VM. First of all, I imagine it to be as easy as purging xfce packages and installing i3 with apt. Correct me if that’s wrong.

But are there any security or privacy risk if I do this? One thing I can think of is that if a workstation VM is compromised, the user’s anonymity can be affected. Because there are less people who customize Whonix workstation and use i3.

What are some other risks?