Do you use KVM or VirtualBox? On KVM increasing CPU cores may cause the VM to slow down/freeze:
Have you tried with the default settings?