I've found that when working in a place for a long time--especially if you have a dedicated temple--a very personal kind of energy/aura/whatever you want to call it gets built up. I'd say do whatever you need to do to get rid of that feeling. In other words, make it not your space anymore, but just some empty apartment.
Taking some time before the banishing ritual to visualize re-absorbing that energy or perhaps just scattering into the universe might be a nice way to do it (you could even work out a ritual to do this). I tend to experience moving as a sad and slightly traumatic event, so that type of thing has the added benefit of helping me feel a sense of closure in leaving an apartment. Now that I think about it, this feeling may having something to do with a sense that a place you live in becomes part of you, and to leave that place behind is to leave part of yourself behind. Now add magick into the mix and it's pretty clear, I think, why that feeling should be mitigated as much as possible.
I'd probably use a Star Ruby as my final banishing. I find it the most effective in completely clearing out a space (which is why I rarely use it, actually, since almost all of my work is done in a dedicated temple). Your mileage may vary.