Is it possible for us to build a space colony the size of a small city that orbits the earth?

Or is it just not possible and will never happen? I can imagine this place becoming a new congregation for scientists of leading nations conducting highly classified research, other military experiments, and eventually open to the public as means of tourism to help sustain it. Is this simply a pie-in-the-sky fantasy or will it be a possibility in the near or distant future?