That's strange that it is just in one browser.
A couple of questions/things to try:
1) If you clear your cache completely does it go faster?
2) If you go to this page is it fast?
This bypasses SSL (not generally recommended), but could isolate the issue to that.