Download errors


advanced search

Message boards : Number crunching : Download errors

Reply to this thread
Subscribe to this thread
Sort
AuthorMessage
Jesse Viviano
private message
Joined: Feb 17, 2015
Posts: 1
ID: 1361530
Credit: 258,549
RAC: 977
Message 3009 - Posted 29 Nov 2016 19:33:55 UTC

I just rejoined this project, and I suddenly got loads of work units that resulted in download errors. I have taken a look at some of the download errors, and each of the work units that caused my computer to have a download error are causing other computers to have download errors. Could an administrator please investigate and fix this?

m.somers User profile image
Forum moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar
private message
Joined: Nov 14, 2005
Posts: 662
ID: 1
Credit: 1,417,572
RAC: 2
Message 3010 - Posted 30 Nov 2016 6:31:54 UTC - in response to Message ID 3009.

This is probaly beeing caused by the restore of the DB. In the restore of the DB references to work being done already (and thus files being removed) might be present. This should only take a day or so to clear by itself. Also I have no other means at my disposal faster to figure out what work units are not out standing on hosts yet any more. The alternative I had yesterday was to completely purge and rebuilt the DB from scratch. Even worse.


m.



____________
M.F. Somers

aad
private message
Joined: Feb 14, 2006
Posts: 35
ID: 134
Credit: 23,075,135
RAC: 36,808
Message 3011 - Posted 30 Nov 2016 19:12:30 UTC - in response to Message ID 3010.

This is probaly beeing caused by the restore of the DB. In the restore of the DB references to work being done already (and thus files being removed) might be present. This should only take a day or so to clear by itself. Also I have no other means at my disposal faster to figure out what work units are not out standing on hosts yet any more. The alternative I had yesterday was to completely purge and rebuilt the DB from scratch. Even worse.


m.




Anyway, thanks for looking into this.

Aad
____________

aad
private message
Joined: Feb 14, 2006
Posts: 35
ID: 134
Credit: 23,075,135
RAC: 36,808
Message 3012 - Posted 2 Dec 2016 17:13:15 UTC - in response to Message ID 3010.
Last modified: 2 Dec 2016 17:18:38 UTC

This is probaly beeing caused by the restore of the DB. In the restore of the DB references to work being done already (and thus files being removed) might be present. This should only take a day or so to clear by itself. Also I have no other means at my disposal faster to figure out what work units are not out standing on hosts yet any more.

m.



Maybe you could lower the quorum for the maximum number of errors....

"For this project we have a minimal quorum of 2, an initial replication of 2 and a maximum number of errors of 16"

The workunits you refering to, will download 16 times to different computers before they will be removed. I had to babysit my computers to manualy refresh because it will wait 1hour before it will try again to download some good wu's.
But it won't, because it downloads 16 erroneous wu's and pause again for an hour

vr 02 dec 2016 18:15:39 CET | Leiden Classical | Requesting new tasks for CPU
vr 02 dec 2016 18:15:40 CET | Leiden Classical | Scheduler request completed: got 16 new tasks
vr 02 dec 2016 18:15:42 CET | Leiden Classical | Started download of classical.water_molecules_BIG_64_898976128_1466960043_946632
vr 02 dec 2016 18:15:42 CET | Leiden Classical | Started download of classical.hydrogen_gas_BIG_78596477_1466960043_893999
vr 02 dec 2016 18:15:43 CET | Leiden Classical | Giving up on download of classical.water_molecules_BIG_64_898976128_1466960043_946632: permanent HTTP error
vr 02 dec 2016 18:15:43 CET | Leiden Classical | Giving up on download of classical.hydrogen_gas_BIG_78596477_1466960043_893999: permanent HTTP error
vr 02 dec 2016 18:15:43 CET | Leiden Classical | Started download of classical.butane_molecule_BIG_164284800_1466960043_896045
vr 02 dec 2016 18:15:43 CET | Leiden Classical | Started download of classical.hydrogen_gas_BIG_78596477_1466960043_894272
vr 02 dec 2016 18:15:44 CET | Leiden Classical | Giving up on download of classical.butane_molecule_BIG_164284800_1466960043_896045: permanent HTTP error
vr 02 dec 2016 18:15:44 CET | Leiden Classical | Giving up on download of classical.hydrogen_gas_BIG_78596477_1466960043_894272: permanent HTTP error
vr 02 dec 2016 18:15:44 CET | Leiden Classical | Started download of classical.hydrogen_gas_BIG_78596477_1466960043_894156
vr 02 dec 2016 18:15:44 CET | Leiden Classical | Started download of classical.hydrogen_gas_BIG_78596477_1466960043_894169
vr 02 dec 2016 18:15:45 CET | Leiden Classical | Giving up on download of classical.hydrogen_gas_BIG_78596477_1466960043_894156: permanent HTTP error
vr 02 dec 2016 18:15:45 CET | Leiden Classical | Giving up on download of classical.hydrogen_gas_BIG_78596477_1466960043_894169: permanent HTTP error
vr 02 dec 2016 18:15:45 CET | Leiden Classical | Started download of classical.butane_molecule_BIG_164284800_1466960043_896058
vr 02 dec 2016 18:15:45 CET | Leiden Classical | Started download of classical.butane_molecule_BIG_164284800_1466960043_894578
vr 02 dec 2016 18:15:46 CET | Leiden Classical | Giving up on download of classical.butane_molecule_BIG_164284800_1466960043_896058: permanent HTTP error
vr 02 dec 2016 18:15:46 CET | Leiden Classical | Giving up on download of classical.butane_molecule_BIG_164284800_1466960043_894578: permanent HTTP error
vr 02 dec 2016 18:15:46 CET | Leiden Classical | Started download of classical.hydrogen_gas_BIG_78596477_1466960043_893080
vr 02 dec 2016 18:15:46 CET | Leiden Classical | Started download of classical.water_molecules_BIG_64_898976128_1466960043_945749
vr 02 dec 2016 18:15:47 CET | Leiden Classical | Giving up on download of classical.hydrogen_gas_BIG_78596477_1466960043_893080: permanent HTTP error
vr 02 dec 2016 18:15:47 CET | Leiden Classical | Giving up on download of classical.water_molecules_BIG_64_898976128_1466960043_945749: permanent HTTP error
vr 02 dec 2016 18:15:47 CET | Leiden Classical | Started download of classical.hydrogen_gas_BIG_78596477_1466960043_893176
vr 02 dec 2016 18:15:47 CET | Leiden Classical | Started download of classical.butane_molecule_BIG_164284800_1466960043_894694
vr 02 dec 2016 18:15:49 CET | Leiden Classical | Giving up on download of classical.hydrogen_gas_BIG_78596477_1466960043_893176: permanent HTTP error
vr 02 dec 2016 18:15:49 CET | Leiden Classical | Giving up on download of classical.butane_molecule_BIG_164284800_1466960043_894694: permanent HTTP error
vr 02 dec 2016 18:15:49 CET | Leiden Classical | Started download of classical.hydrogen_gas_BIG_78596477_1466960043_894386
vr 02 dec 2016 18:15:49 CET | Leiden Classical | Started download of classical.butane_molecule_BIG_164284800_1466960043_896209
vr 02 dec 2016 18:15:50 CET | Leiden Classical | Giving up on download of classical.hydrogen_gas_BIG_78596477_1466960043_894386: permanent HTTP error
vr 02 dec 2016 18:15:50 CET | Leiden Classical | Giving up on download of classical.butane_molecule_BIG_164284800_1466960043_896209: permanent HTTP error
vr 02 dec 2016 18:15:50 CET | Leiden Classical | Started download of classical.water_molecules_BIG_64_898976128_1466960043_947739
vr 02 dec 2016 18:15:50 CET | Leiden Classical | Started download of classical.water_molecules_BIG_64_898976128_1466960043_945545
vr 02 dec 2016 18:15:51 CET | Leiden Classical | Giving up on download of classical.water_molecules_BIG_64_898976128_1466960043_947739: permanent HTTP error
vr 02 dec 2016 18:15:51 CET | Leiden Classical | Giving up on download of classical.water_molecules_BIG_64_898976128_1466960043_945545: permanent HTTP error

____________

m.somers User profile image
Forum moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar
private message
Joined: Nov 14, 2005
Posts: 662
ID: 1
Credit: 1,417,572
RAC: 2
Message 3013 - Posted 5 Dec 2016 21:32:24 UTC - in response to Message ID 3012.


"Maybe you could lower the quorum for the maximum number of errors...."

Nope ; only work units that are created new will have the new settings and also all files needed. work units that are still in the DB cannot be changed (it would also ruin the digitally signed xml describing the workunit).

m.




____________
M.F. Somers

Reply to this thread

Message boards : Number crunching : Download errors



Return to Leiden Classical main page


Copyright © 2017 Leiden University - Leiden Institute of Chemistry - Theoretical Chemistry Department