Can I have multiple browser windows use different session IDs?

No. Sessions are referenced using cookies, and cookies are set per-client, not per-window.

However, there's nothing keeping you from writing your own state management code, using URL rewriting, hidden fields, or the like, for use in parallel windows on the same machine.