Problems downloading large files
Moderator: Moderators
-
geoffhocking
- Getting the hang of things now
- Posts: 48
- Joined: Wed May 15, 2002 12:00 am
Problems downloading large files
I do all my downloading at work with upto 400-500 kb/sec.
I have now noticed it takes a long time for the download dialog box to appear for large files (it takes less time to downlaod say a 6Mb file than it does waiting for the dialog box). When it gets to filesize of approx above 10Mb my computer times out before the dialog box apperars, making it impossible to download these large files. This never used to happen in the past, is there any reason why wry it is happening now.
I am not apble to change timeout peroid as we have no access the system changes.
I have now noticed it takes a long time for the download dialog box to appear for large files (it takes less time to downlaod say a 6Mb file than it does waiting for the dialog box). When it gets to filesize of approx above 10Mb my computer times out before the dialog box apperars, making it impossible to download these large files. This never used to happen in the past, is there any reason why wry it is happening now.
I am not apble to change timeout peroid as we have no access the system changes.
-
BobLatimer
- Very Active Forum Member
- Posts: 2765
- Joined: Mon Jan 07, 2002 12:00 am
- Location: Auckland, New Zealand
-
NeutronIC
- Atomic Systems Team

- Posts: 11085
- Joined: Fri Oct 05, 2001 12:00 am
- Location: E11, London, England
- Contact:
Hmm, just had a quick test myself - selected a 17 meg file and timed how long before it started to download - 3 seconds. Tried again on a 12 meg file and it was 3 seconds also, finally a 50 meg file, 3 seconds.
A thought...
Can you measure the exact number of seconds that it takes before you start to see a file come in and then post in this thread with the size of the file and how many seconds? I wonder if some proxy servers are downloading the entire file themselves before they start issuing it to the end user? i.e. if a 10 meg file would normally take 10 minutes to download, and it doesn't open the download box for 10 minutes before it starts to download - that would indicate that as a problem?
Don't worry about solutions or what it means yet - let's see if i'm on the right track first, there might be things I can do in the headers of the response to 'encourage' a more helpful treatment from the proxy server.
Matt.
A thought...
Can you measure the exact number of seconds that it takes before you start to see a file come in and then post in this thread with the size of the file and how many seconds? I wonder if some proxy servers are downloading the entire file themselves before they start issuing it to the end user? i.e. if a 10 meg file would normally take 10 minutes to download, and it doesn't open the download box for 10 minutes before it starts to download - that would indicate that as a problem?
Don't worry about solutions or what it means yet - let's see if i'm on the right track first, there might be things I can do in the headers of the response to 'encourage' a more helpful treatment from the proxy server.
Matt.
-
BobLatimer
- Very Active Forum Member
- Posts: 2765
- Joined: Mon Jan 07, 2002 12:00 am
- Location: Auckland, New Zealand
Hi Matt. Thanks for the reply.
I'll do some timing at work on Monday. We're enjoying a long weeked at the moment - Anzac Day (equivalent to your Remembrance Day).
From memory the timing is nowhere near as long as 10 min for a 10 meg file. I think a 7 or 8 meg file took something like 2 minutes from clicking the download arrow to getting the next window. I'll get some more accurate readings and report back.
Regards,
Bob,
I'll do some timing at work on Monday. We're enjoying a long weeked at the moment - Anzac Day (equivalent to your Remembrance Day).
From memory the timing is nowhere near as long as 10 min for a 10 meg file. I think a 7 or 8 meg file took something like 2 minutes from clicking the download arrow to getting the next window. I'll get some more accurate readings and report back.
Regards,
Bob,
-
NeutronIC
- Atomic Systems Team

- Posts: 11085
- Joined: Fri Oct 05, 2001 12:00 am
- Location: E11, London, England
- Contact:
Ok, if you can do a few timings, i.e. a 10 meg file, a 20 meg file, 5 meg file - a selection of different sizes. If it turns out to be predictable (i.e. roughly the same number of minutes per megabyte delay) then that proves the proxy is acting a bit bizarre - if it isn't, well, it doesn't conclusively prove it isn't (could be network load) but leaves us with more questions than it solves really. Also, is it consistently the same amount of delay per file size? i.e. is a 10 meg file always roughly the same x minute(s) delay before it starts, and a 20 meg file always roughly the same y minute(s) delay etc.
I'm working on an FTP server for the library which might solve some of these problems, will keep you posted.
Matt.
I'm working on an FTP server for the library which might solve some of these problems, will keep you posted.
Matt.
-
BobLatimer
- Very Active Forum Member
- Posts: 2765
- Joined: Mon Jan 07, 2002 12:00 am
- Location: Auckland, New Zealand
Confused of Cannock
Come on Matt. What have you changed. Everything now working fine. Even large downloads start straight away and all the files i was having problems with last week are now downloading.
Andy, now happily downloading !
Come on Matt. What have you changed. Everything now working fine. Even large downloads start straight away and all the files i was having problems with last week are now downloading.
Andy, now happily downloading !

Last edited by astatham on Mon Apr 28, 2003 4:17 pm, edited 1 time in total.
-
NeutronIC
- Atomic Systems Team

- Posts: 11085
- Joined: Fri Oct 05, 2001 12:00 am
- Location: E11, London, England
- Contact:
Ok i'm going to pessimistically place a small bet that they will stop downloading again just as randomly at some point 
Seriously, Steve has put a couple of belt-and-braces in to see if it helps but the nature of the problem is that the database seemingly randomly bombs out on the web server (or vice versa) and then you get your lost connection error.
After a reboot, long connections work, but after a while they stop working.
I hate PHP with a passion, the new FTP server is done using .NET and my new data interface - so that's the first major chunk booted off of the PHP and Java system we currently have, and then I can get to work on the web server since the data interface seems to be doing a wonderful job of making the FTP server easy
Matt.
Seriously, Steve has put a couple of belt-and-braces in to see if it helps but the nature of the problem is that the database seemingly randomly bombs out on the web server (or vice versa) and then you get your lost connection error.
After a reboot, long connections work, but after a while they stop working.
I hate PHP with a passion, the new FTP server is done using .NET and my new data interface - so that's the first major chunk booted off of the PHP and Java system we currently have, and then I can get to work on the web server since the data interface seems to be doing a wonderful job of making the FTP server easy
Matt.
Thanks for the answer Matt. Still working at the moment, as i just downloaded the 7 Fife route files with no problems whatsover.
One thing i did notice though. I download my files using Getright. The strange thing is that the bigger files (> 12 mb ???) are marked as resume no whereas the smaller files are marked as resume yes.
Don't know if that means anything but thought you might want??? to know !!!!
Roll on the FTP server
Thanks again
Andy
One thing i did notice though. I download my files using Getright. The strange thing is that the bigger files (> 12 mb ???) are marked as resume no whereas the smaller files are marked as resume yes.
Don't know if that means anything but thought you might want??? to know !!!!
Roll on the FTP server
Thanks again
Andy