are you cabled or running on wifi? wifi interferance can be a factor.
do you have wifi security enabled? WPA2 encryption, SSID suppression and MAC filtering? I had a co-worker complaining about performance issues... until we discovered he had no wifi security and providing free adult content to all his apartment neighbors 24x7.
are you the ONLY one on the network? Could another family member be watching/streaming videos or making a large download on another device?