The only trouble I have is that if I leave a usb stick in and then turn the PC on, it hangs and does not boot up if there is no USB stick in it always boots fine.
At a guess, your BIOS is set to boot from USB then HDD and there is a boot partition on your USB stick so it tries to boot from that. Disable the USB boot in the BIOS and it is probably ok
