Ето к'во намерих в една тема:
I've had my suspicions it might be the graphics card so I took it out so I can check the port so i knew what to get.

I rebooted the computer without the gpu. So the drivers for the native graphical environment got installed.

I then removed all nvidia drivers, and installed the gpu again.

The problem just dissappeared.