It's not you, I've noticed the same thing. After midnight things slow down, and between 2 to 4 am (EST), it's excruciating for most sites, especially the Cellar.
This is with Comcast cable, Verizon FIOS, IE-7, IE-8, and Firefox.
Maybe because all the decent upstanding citizens are in bed at that hour, it's punishment for the rest of us.
