A GPU is a graphics processing unit, also known as a graphics card or gfx card. It's a device inside your computer which generates the graphics you see on the screen, a more powerful GPU will lead to better graphics generated. Normally the ones provided with prebuilt PC's are weak, and in many cases some do not have a separate GPU, but rather a unit which is integrated into the motherboard or CPU.