It's not like your looking back in time, your looking at real time, but it took a while to travel. An example of this is sports broadcasting. If you've ever been in a box seat at a hockey game for example, you'll notice theres a 4-6 second delay on what happens in the game and when it is broad casted on live TV. This doesn't mean we are looking back in time, it means it takes a small amount of time to be processed. The same thing goes for the time it takes light to travel throughout space to reach the point you are looking at. When you are looking at the computer screen in front of you, there is a very small amount of time it takes the light to go from your monitor to your eye. Does this mean that you are looking back into time when you do everything in life? No it simply means that light is limited in speed. Sure, it's not something you can notice, but it is there.
A lot of people don't realize the time is only relative, and is not a constant. Now that probably doesn't make much sense to you, so I'll attempt to explain as best I can. Basically the faster you are moving the slower time appears to be moving because of the curvature of space and time. An example of this, would be someone that was on an airplane their whole lives, would live two whole seconds longer because they are affected differently by time. Now, that really isn't much of a difference because you'd spend your whole life on an airplane (not possible) to add an extra 2 seconds to your life span, but it is important for physics, because if we somehow do find a way to travel at the speed of light, during that time the people traveling at the speed of light (or close to it) could have years of earth time pass, thousands, and it would only feel like a short time to them.