Is it necessary to keep KDE in Whonix-Gateway

In all honesty, I’ve never used the GUI in Whonix-Gateway. Not once. Unless, of course, you count the initial boot. I have always just turned the RAM down to 128 and done what little I do there in the cli. But, of course, the KDE base remains. My question is this: doesn’t retaining KDE increase the ways an attacker can penetrate the system? And if so, can I just delete all that? Or will I, you know, break something?

Whonix Debian Packages, which ones are safe to remove?