Download errors since database problems


advanced search

Message boards : Number crunching : Download errors since database problems

Reply to this thread
Subscribe to this thread
Sort
AuthorMessage
Path7
private message
Joined: Sep 30, 2010
Posts: 8
ID: 27125
Credit: 15,037
RAC: 36
Message 2769 - Posted 23 Oct 2011 15:22:27 UTC
Last modified: 23 Oct 2011 15:24:06 UTC

Hello M. Somers and all,

First: Thanks for restoring the Leiden Classical servers during the weekend.

Unfortunately I see download errors on my BOINC messages:

23-10-2011 11:30:33|Leiden Classical|Fetching scheduler list
23-10-2011 11:30:38|Leiden Classical|Master file download succeeded
23-10-2011 11:30:43|Leiden Classical|Sending scheduler request: Requested by user. Requesting 652 seconds of work, reporting 2 completed tasks
23-10-2011 11:30:48|Leiden Classical|Scheduler request succeeded: got 1 new tasks
23-10-2011 11:30:50|Leiden Classical|Started download of classical.hydrogen_gas_BIG_78596477_1318733110_7253
23-10-2011 11:30:51|Leiden Classical|Giving up on download of classical.hydrogen_gas_BIG_78596477_1318733110_7253: file not found

Result link: http://boinc.gorlaeus.net/result.php?resultid=32621972

23-10-2011 16:56:57|Leiden Classical|Sending scheduler request: To fetch work. Requesting
3745 seconds of work, reporting 0 completed tasks
23-10-2011 16:57:03|Leiden Classical|Scheduler request succeeded: got 1 new tasks
23-10-2011 16:57:05|Leiden Classical|Started download of
cu111leps_trajtou.inp_BIG_80398718_1317696602_29684
23-10-2011 16:57:06|Leiden Classical|Giving up on download of
cu111leps_trajtou.inp_BIG_80398718_1317696602_29684: file not found

Result link: http://boinc.gorlaeus.net/workunit.php?wuid=14326621

And some more;
Link to computer results: http://boinc.gorlaeus.net/results.php?hostid=80696


Anyone else seeing these errors?

Path7.

S@NL - John van Gorsel
private message
Joined: May 7, 2007
Posts: 26
ID: 6250
Credit: 7,253,294
RAC: 52
Message 2770 - Posted 23 Oct 2011 15:50:39 UTC

Same problems here. An extract from the log file:


23-Oct-11 5:09:44 PM Leiden Classical Started download of classical.water_molecules_BIG_64_898976128_1318431001_10026
23-Oct-11 5:09:45 PM Leiden Classical Giving up on download of classical.water_molecules_BIG_64_898976128_1318431001_10026: file not found
23-Oct-11 5:12:48 PM Leiden Classical Started download of classical.butane_molecule_BIG_164284800_1318733109_2934
23-Oct-11 5:12:49 PM Leiden Classical Giving up on download of classical.butane_molecule_BIG_164284800_1318733109_2934: file not found
23-Oct-11 5:15:51 PM Leiden Classical Started download of cu111leps_trajtou.inp_BIG_80398718_1317696602_24828
23-Oct-11 5:15:53 PM Leiden Classical Giving up on download of cu111leps_trajtou.inp_BIG_80398718_1317696602_24828: file not found
23-Oct-11 5:18:56 PM Leiden Classical Started download of classical.hydrogen_gas_BIG_78596477_1318733110_1366
23-Oct-11 5:18:58 PM Leiden Classical Giving up on download of classical.hydrogen_gas_BIG_78596477_1318733110_1366: file not found
23-Oct-11 5:22:00 PM Leiden Classical Started download of classical.water_molecules_BIG_64_898976128_1318431001_8604
23-Oct-11 5:22:01 PM Leiden Classical Giving up on download of classical.water_molecules_BIG_64_898976128_1318431001_8604: file not found
23-Oct-11 5:25:04 PM Leiden Classical Started download of cu111leps_trajtou.inp_BIG_80398718_1317696602_24896
23-Oct-11 5:25:05 PM Leiden Classical Giving up on download of cu111leps_trajtou.inp_BIG_80398718_1317696602_24896: file not found
23-Oct-11 5:28:08 PM Leiden Classical Started download of classical.butane_molecule_BIG_164284800_1318431001_2716
23-Oct-11 5:28:09 PM Leiden Classical Giving up on download of classical.butane_molecule_BIG_164284800_1318431001_2716: file not found
23-Oct-11 5:31:12 PM Leiden Classical Started download of cu111leps_trajtou.inp_BIG_80398718_1317696602_24940
23-Oct-11 5:31:13 PM Leiden Classical Giving up on download of cu111leps_trajtou.inp_BIG_80398718_1317696602_24940: file not found
23-Oct-11 5:34:16 PM Leiden Classical Started download of classical.water_molecules_BIG_64_898976128_1318431001_8955
23-Oct-11 5:34:17 PM Leiden Classical Giving up on download of classical.water_molecules_BIG_64_898976128_1318431001_8955: file not found
23-Oct-11 5:37:20 PM Leiden Classical Started download of classical.hydrogen_gas_BIG_78596477_1318733110_2893
23-Oct-11 5:37:21 PM Leiden Classical Giving up on download of classical.hydrogen_gas_BIG_78596477_1318733110_2893: file not found
23-Oct-11 5:40:24 PM Leiden Classical Started download of pd110paw_traj.inp_BIG_649415041_1318733402_2956
23-Oct-11 5:40:26 PM Leiden Classical Giving up on download of pd110paw_traj.inp_BIG_649415041_1318733402_2956: file not found
23-Oct-11 5:43:28 PM Leiden Classical Started download of classical.hydrogen_gas_BIG_78596477_1317423002_24663
23-Oct-11 5:43:29 PM Leiden Classical Giving up on download of classical.hydrogen_gas_BIG_78596477_1317423002_24663: file not found

____________

m.somers User profile image
Forum moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar
private message
Joined: Nov 14, 2005
Posts: 662
ID: 1
Credit: 1,417,572
RAC: 2
Message 2771 - Posted 23 Oct 2011 16:12:28 UTC

Thanx, I already was busy fixing it; it should be solved now...

m.
____________
M.F. Somers

S@NL - John van Gorsel
private message
Joined: May 7, 2007
Posts: 26
ID: 6250
Credit: 7,253,294
RAC: 52
Message 2772 - Posted 23 Oct 2011 16:33:27 UTC

It changed, but it's not quite solved...


23-Oct-11 6:31:38 PM Leiden Classical Requesting new tasks
23-Oct-11 6:31:40 PM Leiden Classical Scheduler request completed: got 1 new tasks
23-Oct-11 6:31:42 PM Leiden Classical Started download of classical.water_molecules_BIG_64_898976128_1318431001_10444
23-Oct-11 6:31:43 PM Leiden Classical Finished download of classical.water_molecules_BIG_64_898976128_1318431001_10444
23-Oct-11 6:31:43 PM Leiden Classical [error] File classical.water_molecules_BIG_64_898976128_1318431001_10444 has wrong size: expected 59517, got 6764
23-Oct-11 6:31:43 PM Leiden Classical [error] Checksum or signature error for classical.water_molecules_BIG_64_898976128_1318431001_10444

S@NL - John van Gorsel
private message
Joined: May 7, 2007
Posts: 26
ID: 6250
Credit: 7,253,294
RAC: 52
Message 2773 - Posted 23 Oct 2011 16:36:10 UTC

I now received a task in good order

Path7
private message
Joined: Sep 30, 2010
Posts: 8
ID: 27125
Credit: 15,037
RAC: 36
Message 2774 - Posted 23 Oct 2011 17:18:05 UTC - in response to Message ID 2771.

Thanx, I already was busy fixing it; it should be solved now...

m.

Hello M. Somers,

BOINC downloaded a few new Work-units fine. The download problem seems to be solved.
Thanks for the quick reply.

Path7.

Maurice Goulois User profile image
private message
Joined: Aug 11, 2007
Posts: 2
ID: 8486
Credit: 126,498
RAC: 999
Message 2775 - Posted 23 Oct 2011 23:35:09 UTC
Last modified: 23 Oct 2011 23:36:19 UTC

Hello

same here

24/10/2011 01:31:40 | Leiden Classical | Started download of classical_5.56_windows_intelx86.exe
24/10/2011 01:31:40 | Leiden Classical | Started download of classical.water_molecules_BIG_64_898976128_1318431001_13959
24/10/2011 01:31:41 | Leiden Classical | Giving up on download of classical_5.56_windows_intelx86.exe: file not found
24/10/2011 01:31:41 | Leiden Classical | Finished download of classical.water_molecules_BIG_64_898976128_1318431001_13959
24/10/2011 01:31:41 | Leiden Classical | [error] File classical.water_molecules_BIG_64_898976128_1318431001_13959 has wrong size: expected 59517, got 6764
24/10/2011 01:31:41 | Leiden Classical | [error] Checksum or signature error for classical.water_molecules_BIG_64_898976128_1318431001_13959


tried a few project resets but still same errors
____________

m.somers User profile image
Forum moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar
private message
Joined: Nov 14, 2005
Posts: 662
ID: 1
Credit: 1,417,572
RAC: 2
Message 2776 - Posted 24 Oct 2011 5:40:42 UTC

Hi, I made a mistake with one of the inputs; it should be fixed now...

m.


____________
M.F. Somers

Maurice Goulois User profile image
private message
Joined: Aug 11, 2007
Posts: 2
ID: 8486
Credit: 126,498
RAC: 999
Message 2777 - Posted 24 Oct 2011 8:09:40 UTC - in response to Message ID 2776.

Hi, I made a mistake with one of the inputs; it should be fixed now...

m.



Seems ok now, thanks
____________

Aurimas
private message
Joined: Apr 13, 2010
Posts: 1
ID: 26117
Credit: 392,929
RAC: 24
Message 2778 - Posted 24 Oct 2011 22:11:28 UTC

25/10/2011 01:08:08 | Leiden Classical | Started upload of wu_898976128_1318431001_15443_1_1
25/10/2011 01:08:09 | Leiden Classical | [error] Error reported by file upload server: length of file /home/boinc/Classical/upload/1a0/wu_898976128_1318431001_15443_1_1 3442 bytes != offset 0 bytes
25/10/2011 01:08:09 | Leiden Classical | Temporarily failed upload of wu_898976128_1318431001_15443_1_1: transient upload error
25/10/2011 01:08:09 | Leiden Classical | Backing off 3 hr 11 min 5 sec on upload of wu_898976128_1318431001_15443_1_1

jayBee666
private message
Joined: Mar 15, 2008
Posts: 4
ID: 13479
Credit: 81,269,477
RAC: 9,287
Message 2779 - Posted 25 Oct 2011 14:35:54 UTC
Last modified: 25 Oct 2011 14:37:32 UTC

I get a huge amount of upload errors (after the workunits have finished).
BOINC manager tries to upload more bytes than the size of the file

20111025 16:07:33 | Leiden Classical | Started upload of wu_898976128_1318431001_14377_1_1
20111025 16:07:35 | Leiden Classical | [error] Error reported by file upload server: length of file /home/boinc/Classical/upload/23c/wu_898976128_1318431001_14377_1_1 3442 bytes != offset 0 bytes
20111025 16:07:35 | Leiden Classical | Temporarily failed upload of wu_898976128_1318431001_14377_1_1: transient upload error
20111025 16:09:28 | Leiden Classical | Started upload of wu_649415041_1318733402_9648_0_1
20111025 16:09:29 | Leiden Classical | [error] Error reported by file upload server: length of file /home/boinc/Classical/upload/33/wu_649415041_1318733402_9648_0_1 143 bytes != offset 0 bytes
20111025 16:09:29 | Leiden Classical | Temporarily failed upload of wu_649415041_1318733402_9648_0_1: transient upload error
20111025 16:09:50 | Leiden Classical | [error] Error reported by file upload server: length of file /home/boinc/Classical/upload/3cc/wu_649415041_1318733402_9648_0_0 674 bytes != offset 0 bytes
20111025 16:09:50 | Leiden Classical | Temporarily failed upload of wu_649415041_1318733402_9648_0_0: transient upload error

____________

m.somers User profile image
Forum moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar
private message
Joined: Nov 14, 2005
Posts: 662
ID: 1
Credit: 1,417,572
RAC: 2
Message 2780 - Posted 25 Oct 2011 15:26:01 UTC - in response to Message ID 2779.

H'mmm that's strange I do not see any results returned with upload errors here.

Although I see your uploads in the log here... it seems like a client issue?

2011-10-25 15:16:24.1850 [PID=32479] [debug ] handle_request: <data_server_request>
2011-10-25 15:16:24.1852 [PID=32479] [debug ] handle_request: <core_client_major_version>6</core_client_major_version>
2011-10-25 15:16:24.1852 [PID=32479] [debug ] handle_request: <core_client_minor_version>12</core_client_minor_version>
2011-10-25 15:16:24.1852 [PID=32479] [debug ] handle_request: <core_client_release>34</core_client_release>
2011-10-25 15:16:24.1852 [PID=32479] [debug ] handle_request: <file_upload>
2011-10-25 15:16:24.1853 [PID=32479] [CRITICAL] unrecognized: <md5_cksum>d00ed870958e059ddca8ae90caf717bf</md5_cksum>
2011-10-25 15:16:24.1854 [PID=32479] [normal ] Starting upload of wu_898976128_1318431001_14377_1_1 from 84.193.42.154 [offset=0, nbytes=3442]
2011-10-25 15:16:24.1856 [PID=32479] [normal ] Returning error to client 84.193.42.154: length of file /home/boinc/Classical/upload/23c/wu_898976128_1318431001_14377_1_1 3442 bytes != offset 0 bytes (transient)
2011-10-25 15:16:24.1856 [PID=32479] [normal ] Ended upload of wu_898976128_1318431001_14377_1_1 from 84.193.42.154; retval 1
2011-10-25 15:16:24.1856 [PID=32479] [debug ] run time 0.010449 seconds


m.


____________
M.F. Somers

Ageless User profile image
Forum moderator
Avatar
private message
Joined: Feb 15, 2006
Posts: 88
ID: 183
Credit: 27,416
RAC: 79
Message 2781 - Posted 26 Oct 2011 4:46:50 UTC - in response to Message ID 2780.

it seems like a client issue?

Transient upload errors are always a server error. It means as much as: "The file you are trying to upload is locked on the server. The file_upload_handler put an advisory lock on the file, to prevent other file upload handlers to write to the file."

So do check your file upload handlers.
Check the upload certificates as well (just in case).
____________
Jord

m.somers User profile image
Forum moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar
private message
Joined: Nov 14, 2005
Posts: 662
ID: 1
Credit: 1,417,572
RAC: 2
Message 2782 - Posted 26 Oct 2011 6:05:40 UTC - in response to Message ID 2781.

The certificates are not used anymore(some changes in the client required this recently; as was posted on the dev mailing list).

I'll look into the locks.

m.
____________
M.F. Somers

jayBee666
private message
Joined: Mar 15, 2008
Posts: 4
ID: 13479
Credit: 81,269,477
RAC: 9,287
Message 2783 - Posted 26 Oct 2011 19:48:15 UTC - in response to Message ID 2780.
Last modified: 26 Oct 2011 19:58:01 UTC

H'mmm that's strange I do not see any results returned with upload errors here.

Although I see your uploads in the log here... it seems like a client issue?


Hi. The problem seems to be solved with a reboot.
The results with errors still could not be uploaded (I aborted the uploads), but I didn't get any new errors after the reboot.
I think this must be a bug in BOINC manager. When it is unable to contact the project server (like last weekend) but Internet access is OK, some of the result files after that point in time get corrupted. In the Transfers tab the uploaded size was larger than the file size. It said something like 5.48/5.29KB (sizes were different for each result).
It is curious though that I haven't seen this type of error in any other project before.
Hope this helps.

by the way: resetting the project did not solve the problem
The problem did not just occur on one computer, but on at least four. I rebooted them all, just in case...

Reply to this thread

Message boards : Number crunching : Download errors since database problems



Return to Leiden Classical main page


Copyright © 2017 Leiden University - Leiden Institute of Chemistry - Theoretical Chemistry Department