The heat first comes off the CPU and GPU, which sit below a metal plate and a layer of TIM (aka Thermal Interface Material).
Now is not the time to buy a new PC, so take good care of the one you already have ...