When using the GPIO I would recommend getting a breadboard and an Adafruit Pi Cobbler Breakout Kit. This will allow you to easily connect the Raspberry Pi to a breadboard so you can quickly and easily build circuits.
So you want to start using the GPIO and connecting your Raspberry Pi to a breadboard to turn on some LEDs or power some motors etc. But what exactly is a breadboard and how does it work?