Validate error

Message boards : Number crunching : Validate error
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Aurimas

Send message
Joined: 13 Jan 19
Posts: 5
Credit: 7,384
RAC: 182
Message 388 - Posted: 18 Aug 2019, 4:00:14 UTC

Hello,

about 90% of my tasks are with "Validate error" mark and only few are validated as correct.

Where is the problem?

https://boinc.nanohub.org/nanoHUB_at_home/results.php?userid=50955
ID: 388 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
gemini8

Send message
Joined: 25 Dec 18
Posts: 6
Credit: 58,963
RAC: 69
Message 389 - Posted: 18 Aug 2019, 12:04:45 UTC

On this machine I have the same kind of problem.
Just aborted a bunch of tasks after seeing that not even a single one was successfully validated.
Please have a look into this.
Thanks a lot!
- - - - - - - - - -
Greetings, Jens
ID: 389 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mmonnin

Send message
Joined: 16 Jan 18
Posts: 22
Credit: 187,645
RAC: 87
Message 390 - Posted: 18 Aug 2019, 12:22:13 UTC - in response to Message 388.  

Hello,

about 90% of my tasks are with "Validate error" mark and only few are validated as correct.

Where is the problem?

https://boinc.nanohub.org/nanoHUB_at_home/results.php?userid=50955


1 - That is a private link only you can see.
2 - You're nowhere close to 90%. 754/1286 is 58%. Still pretty bad.
3 - 3 of my 4 hosts have zero invalids. The 4th has 18% invalid rate.

All of mine are on Linux. 2x AMD Zen PCs, a 3570k and the 2P 2670v1 with Invalids. The 2P is the only one on Mint 17 while the others are on Ubuntu 18. It also has the most memory at 128GB so it won't ever run out.

You're on Win10 and gemini is on some Linux version. I don't really see a connection between OS/hardware. Your VBox version is 5.2.8, gemini8's is 5.1.12r112440 and my good ones are 5.2.26 or 6.0. The bad one is 5.0.2.
ID: 390 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Aurimas

Send message
Joined: 13 Jan 19
Posts: 5
Credit: 7,384
RAC: 182
Message 391 - Posted: 19 Aug 2019, 4:52:13 UTC - in response to Message 390.  


2 - You're nowhere close to 90%. 754/1286 is 58%. Still pretty bad.


I think rate is more as 90% in last days: :)

ID: 391 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Hal Bregg

Send message
Joined: 24 Apr 19
Posts: 51
Credit: 112,139
RAC: 33
Message 392 - Posted: 19 Aug 2019, 6:36:09 UTC

Try to stick to VBox version supplied with Boinc installation file and limit amount of tasks running consecutively.
nanoHUB is real memory hogger.
ID: 392 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mmonnin

Send message
Joined: 16 Jan 18
Posts: 22
Credit: 187,645
RAC: 87
Message 393 - Posted: 19 Aug 2019, 10:26:49 UTC - in response to Message 392.  

Try to stick to VBox version supplied with Boinc installation file and limit amount of tasks running consecutively.
nanoHUB is real memory hogger.


Running out of memory would cause errors, not invalids.
ID: 393 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 11 Jan 17
Posts: 65
Credit: 194,081
RAC: 209
Message 394 - Posted: 19 Aug 2019, 12:11:40 UTC - in response to Message 388.  

Are you overclocking (either the CPU or memory)?
That could cause invalids.

Also, the anti-virus might be interfering with the process.
ID: 394 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Aurimas

Send message
Joined: 13 Jan 19
Posts: 5
Credit: 7,384
RAC: 182
Message 395 - Posted: 19 Aug 2019, 19:00:21 UTC - in response to Message 394.  

Also, the anti-virus might be interfering with the process.


It is possible because of slow my internet connection?
ID: 395 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 11 Jan 17
Posts: 65
Credit: 194,081
RAC: 209
Message 396 - Posted: 19 Aug 2019, 19:10:57 UTC - in response to Message 395.  

Also, the anti-virus might be interfering with the process.


It is possible because of slow my internet connection?

I don't think the speed of the internet connection matters. But be sure to exclude the BOINC data folder from your AV. Even that does not always work, since the AV monitors real-time processes, such as internet communications. Any disruptions might affect the validation process.

I would try a different AV, or temporarily disable it.
ID: 396 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Avatar

Send message
Joined: 30 Jun 19
Posts: 6
Credit: 259
RAC: 0
Message 397 - Posted: 20 Aug 2019, 6:10:17 UTC

So far Invalid (54) in last number of hours and growing on host 2368.

Current running task nanoHUB_at_home 1.12 boinc2docker (vbox64_mt) is hammering the hard disk and swap file very hard. It also has consumed just about all the free RAM.
BOINC claims task is "only" using 99.68 MB of SWAP and 1843.20 MB of PHYSICAL RAM. Obviously, that does NOT INCLUDE the VBOX WRAPPER RAM & SWAP usage/overhead which appear to consume about another 1 to 1.5 GB of RAM.

ID: 397 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 11 Jan 17
Posts: 65
Credit: 194,081
RAC: 209
Message 399 - Posted: 20 Aug 2019, 9:57:02 UTC - in response to Message 397.  
Last modified: 20 Aug 2019, 10:07:08 UTC

Current running task nanoHUB_at_home 1.12 boinc2docker (vbox64_mt) is hammering the hard disk and swap file very hard.

Yes, I have noticed that. I always use a write cache here, on either Linux or Windows.
https://boinc.nanohub.org/nanoHUB_at_home/forum_thread.php?id=46&postid=158#158

And you will need even more memory for it. I would devote about 1 GB per work unit, with a latency (write delay) of maybe 10 minutes or so. On my 8-core machines, I usually use about 8 GB, though half that would help protect the SSD a lot.

But the work units here are short, which makes it a bit easier to deal with.
ID: 399 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mmonnin

Send message
Joined: 16 Jan 18
Posts: 22
Credit: 187,645
RAC: 87
Message 401 - Posted: 20 Aug 2019, 20:21:57 UTC

Tasks use 1.8GB each. At a min we need 2GB per task or limit the # of tasks
ID: 401 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Avatar

Send message
Joined: 30 Jun 19
Posts: 6
Credit: 259
RAC: 0
Message 402 - Posted: 20 Aug 2019, 20:36:43 UTC

And the Validate Errors CONTINUE...

Seeing "vminfo Error: Unable to connect to system D-Bus (2/3): D-Bus not installed" in just about all my invalids.

Apparently the tasks are broken when they are sent out.

ID: 402 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 11 Jan 17
Posts: 65
Credit: 194,081
RAC: 209
Message 403 - Posted: 20 Aug 2019, 22:35:57 UTC - in response to Message 402.  

Seeing "vminfo Error: Unable to connect to system D-Bus (2/3): D-Bus not installed" in just about all my invalids.

I think that is in all of them, even the good ones. It does not indicate an error.
ID: 403 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Avatar

Send message
Joined: 30 Jun 19
Posts: 6
Credit: 259
RAC: 0
Message 404 - Posted: 21 Aug 2019, 13:42:34 UTC

Something has to be done about the high number of invalids at this project!

Final damage count after about 24 hours of running most recent tasks: Valid (0) . Invalid (73) ยท Error (4).

I have no problems at any other projects with invalids.

ID: 404 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 11 Jan 17
Posts: 65
Credit: 194,081
RAC: 209
Message 405 - Posted: 21 Aug 2019, 14:05:12 UTC - in response to Message 404.  
Last modified: 21 Aug 2019, 14:58:18 UTC

Something has to be done about the high number of invalids at this project!

You have only 3.89 GB of memory. That isn't enough to run even one work unit here (except the small ones).
You should start out with 6 GB for the first one, and then add at least 4 GB more for each additional one.
ID: 405 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 11 Jan 17
Posts: 65
Credit: 194,081
RAC: 209
Message 406 - Posted: 21 Aug 2019, 15:41:35 UTC - in response to Message 405.  

Though I have noticed that my current work units are taking about 2 GB, so maybe you can get away with less.
They vary a bit in size.
ID: 406 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Aurimas

Send message
Joined: 13 Jan 19
Posts: 5
Credit: 7,384
RAC: 182
Message 407 - Posted: 21 Aug 2019, 16:23:48 UTC - in response to Message 405.  

You have only 3.89 GB of memory. That isn't enough to run even one work unit here (except the small ones).
You should start out with 6 GB for the first one, and then add at least 4 GB more for each additional one.


For example, I have 16 GB RAM, also limited tasks to run only 3 together. Result - same as before. Looks like all are with Validate error...
ID: 407 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 11 Jan 17
Posts: 65
Credit: 194,081
RAC: 209
Message 410 - Posted: 21 Aug 2019, 16:57:31 UTC - in response to Message 407.  
Last modified: 21 Aug 2019, 17:27:42 UTC

I haven't used it that much with Windows, but I think it is more sensitive to which version of VirtualBox you are using.
Either 5.1.38 or 6.0.10 might work better.

I usually have few problems with Linux (Ubuntu 16.04) with VB 5.1.38.
EDIT: The error rate is maybe 10% or less, and is going down as they fix their apps.
https://boinc.nanohub.org/nanoHUB_at_home/results.php?hostid=3192

And on Windows, you always have to worry about the anti-virus interfering with it. Be sure to exclude the BOINC Data folder.
Also, you could try disabling the AV for a while.
ID: 410 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mmonnin

Send message
Joined: 16 Jan 18
Posts: 22
Credit: 187,645
RAC: 87
Message 412 - Posted: 23 Aug 2019, 0:37:04 UTC

My PCs have several versions of vbox. Only one has validate errors but not every single task. At 2gb per task that's only enough to run maybe 1 depending on other uses.
ID: 412 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Validate error


©2020 COPYRIGHT 2017-2018 NCN