You have to remember that time and space/location are constructs of the physical world.  Probably the best way to imagine it is to think of a computer game.  You, as a gameplayer exist outside and apart from the game except while playing the game.  The time spent inside the game has little or no direct impact on your existence outside the game.   

The game has a beginning and an end.  It has its own rules of time and space, so that when the game is completed or when you exit the game to take a break, time has been temporarily suspended until your return.

I'm not saying that the physical world is a computer game or that we live in a Matrix-like universe.  The comparison can aid one in almost understanding how the spirit world compares to the physical world.