Thread 'Too many download errors'

Message boards : Number crunching : Too many download errors
Message board moderation

To post messages, you must log in.

AuthorMessage
ProfileJStateson
Avatar

Send message
Joined: 13 Feb 18
Posts: 2
Credit: 1,960,698
RAC: 0
Message 190 - Posted: 21 Feb 2018, 16:08:34 UTC
Last modified: 21 Feb 2018, 16:10:13 UTC

I am getting a huge number of download errors, more than 1 out of every 10 task errors out with "could not get input files".

Is there a time delay that can be increased to allow more time or a retry?

    <core_client_version>7.8.3</core_client_version>
    <![CDATA[
    <message>
    WU download error: couldn't get input files:
    <file_xfer_error>
    <file_name>input_odlkmax_61_0115903_00000.txt</file_name>
    <error_code>-224 (permanent HTTP error)</error_code>
    <error_message>permanent HTTP error</error_message>
    </file_xfer_error>
    </message>
    ]]>



Possible for the project to zip or 7z the txt files up and bundle a group all at once?
Maybe another problem?

The program that could not find the txt file should have been bundled with its data for download but I am just guessing as to the cause.

Anyway, out of 1500 tasks purl=https://boinc.multi-pool.info/latinsquares/results.php?hostid=9409]here[/url] thre were 153 errors the majority of which were during download. 36 out of 269 on another system - almost %20

ID: 190 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ice00
Project administrator
Project developer

Send message
Joined: 28 Oct 17
Posts: 220
Credit: 59,056
RAC: 12
Message 192 - Posted: 21 Feb 2018, 19:25:55 UTC - in response to Message 190.  

hi,

workunit are very tiny (less that 500 bytes), so maybe the problem could be something different.

I will try to look if there are some log message in server regarding the download of your workunit.
ID: 192 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
klepel

Send message
Joined: 11 Jan 18
Posts: 2
Credit: 19,432,928
RAC: 29,623
Message 193 - Posted: 21 Feb 2018, 19:59:58 UTC

Same here, I have a lot of download errors since Sunday!

As well as finished tasks are not reported, although the results have been uploaded! Might it be that the server cannot cope with connection? I am asking as the tasks are so small, at it seems to me that this generates a lot of traffic.
ID: 193 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileJStateson
Avatar

Send message
Joined: 13 Feb 18
Posts: 2
Credit: 1,960,698
RAC: 0
Message 194 - Posted: 21 Feb 2018, 23:53:08 UTC

Just guessing as to the problem, but if you are unpacking that "input.txt" file from a download package then immediately try to open it, you might need a delay for the file system to properly prepare it else it might not be "there" and the open will fail.

I have "been there" and "done that"
ID: 194 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ice00
Project administrator
Project developer

Send message
Joined: 28 Oct 17
Posts: 220
Credit: 59,056
RAC: 12
Message 197 - Posted: 22 Feb 2018, 17:35:50 UTC - in response to Message 194.  

hi,

after looking from many logs into server, it could be probably related to a file name collision in Odlkmax job generation.

The generator try to generate two different input file but with the same name (the file uses a sort of time-stamp so this should not happen! ), so there is a different dimension in the generated file respect to the DB expected.
When you download the file, the client reject the file as it not match the expected dimension (even if the file is all downloaded).

Thanks for report, maybe we can catch the bug into the job generation program.
ID: 197 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
klepel

Send message
Joined: 11 Jan 18
Posts: 2
Credit: 19,432,928
RAC: 29,623
Message 198 - Posted: 22 Feb 2018, 18:17:22 UTC

Please inform, when you solved the problem. I had to open an other project to keep my computer busy.
ID: 198 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan

Send message
Joined: 10 Nov 17
Posts: 8
Credit: 195,670
RAC: 54
Message 203 - Posted: 26 Feb 2018, 21:32:09 UTC

Looking over my task list I have seen many download error over last 2 weels and GHOST TASKS also.
Web pages also were unavailable or timed out earier today.
ID: 203 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan

Send message
Joined: 10 Nov 17
Posts: 8
Credit: 195,670
RAC: 54
Message 205 - Posted: 2 Mar 2018, 4:11:53 UTC - in response to Message 203.  

DOWNLOAD ERRORS STILL EXIST!
FIX IT OR SUSPEND SENDING OUT WORK -YOU ARE WASTING YOUR & MY INTERNET BANDWIDTH

ID: 205 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 206 - Posted: 2 Mar 2018, 4:30:21 UTC - in response to Message 205.  
Last modified: 2 Mar 2018, 4:32:27 UTC

DOWNLOAD ERRORS STILL EXIST!
FIX IT OR SUSPEND SENDING OUT WORK -YOU ARE WASTING YOUR & MY INTERNET BANDWIDTH

Please wait!

Progger is working on a problem.
Jobs generation in Application odlkmax@home is temporarily suspended, see the message
https://boinc.multi-pool.info/latinsquares/forum_thread.php?id=15&postid=201#201
Soon the generation of jobs will be resumed without errors.
https://yadi.sk/i/S1HhJBwp3Pr9jX
ID: 206 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
idahofisherman

Send message
Joined: 8 Dec 17
Posts: 1
Credit: 91,247
RAC: 0
Message 312 - Posted: 17 Sep 2018, 3:33:18 UTC

to many download errors below is the message file have to abort these to get rid of them



DESKTOP-3D27Q41

7316 9/15/2018 2:52:06 PM [error] Can't create HTTP response output file projects/boinc.multi-pool.info_latinsquares/odlk3_1.0_windows_x86_64.exe
7317 latinsquares 9/15/2018 2:52:06 PM Backing off 03:53:19 on download of odlk3_1.0_windows_x86_64.exe
7318 9/15/2018 2:52:13 PM [error] Can't create HTTP response output file projects/boinc.multi-pool.info_latinsquares/input_odlk3_57_0080579_00077.txt
7319 latinsquares 9/15/2018 2:52:13 PM Backing off 00:33:45 on download of input_odlk3_57_0080579_00077.txt
7320 9/15/2018 2:52:18 PM [error] Can't create HTTP response output file projects/boinc.multi-pool.info_latinsquares/input_odlk3_61_0121519_00006.txt
ID: 312 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ice00
Project administrator
Project developer

Send message
Joined: 28 Oct 17
Posts: 220
Credit: 59,056
RAC: 12
Message 313 - Posted: 22 Sep 2018, 18:33:25 UTC - in response to Message 312.  

to many download errors below is the message file have to abort these to get rid of them



DESKTOP-3D27Q41

7316 9/15/2018 2:52:06 PM [error] Can't create HTTP response output file projects/boinc.multi-pool.info_latinsquares/odlk3_1.0_windows_x86_64.exe
7317 latinsquares 9/15/2018 2:52:06 PM Backing off 03:53:19 on download of odlk3_1.0_windows_x86_64.exe
7318 9/15/2018 2:52:13 PM [error] Can't create HTTP response output file projects/boinc.multi-pool.info_latinsquares/input_odlk3_57_0080579_00077.txt
7319 latinsquares 9/15/2018 2:52:13 PM Backing off 00:33:45 on download of input_odlk3_57_0080579_00077.txt
7320 9/15/2018 2:52:18 PM [error] Can't create HTTP response output file projects/boinc.multi-pool.info_latinsquares/input_odlk3_61_0121519_00006.txt


Are you still having the errors?
Could you look at your antivirus if it is blocking for some reason the download?

Thanks
ID: 313 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : Number crunching : Too many download errors

©2024 ©2024 Progger & Stefano Tognon (ice00) & Reese