Thread 'Configuration continue'

Author	Message
Natalia Makarova Project scientist Send message Joined: 22 Oct 17 Posts: 3087 Credit: 0 RAC: 0	Message 3856 - Posted: 1 Dec 2024, 8:29:42 UTC Hello everyone! Ice00 I am very happy that the new server setup is progressing. Thanks to everyone who stays with the project. ID: 3856 · Rating: 0 · rate: / Reply Quote

Natalia Makarova Project scientist Send message Joined: 22 Oct 17 Posts: 3087 Credit: 0 RAC: 0	Message 3859 - Posted: 2 Dec 2024, 6:48:05 UTC Hello everyone! Please see the thread https://boinc.multi-pool.info/latinsquares/forum_thread.php?id=219 Sorry for offtopic. ID: 3859 · Rating: 0 · rate: / Reply Quote

pututu Send message Joined: 7 Jun 18 Posts: 5 Credit: 6,218,024 RAC: 72,408	Message 3873 - Posted: 25 Dec 2024, 15:40:47 UTC - in response to Message 3852. In reply to CallMeFoxie's message of 25 Nov 2024: I have further increased the max buffer size from 20MB to 40MB, try now :) when BOINC uploads all 1086 tasks at once it runs out of buffers on the reverse proxy, if it keeps persisting, I will either increase even further or it is better to set maximum upload batch to something like 500 tasks <max_tasks_reported>500</max_tasks_reported> Can possible to increase the buffer size or the max file upload to a higher number? I"m getting this in the scheduler file: <html> <head><title>413 Request Entity Too Large</title></head> <body> <center><h1>413 Request Entity Too Large</h1></center> <hr><center>nginx</center> </body> </html> I use a modified boinc client to increase the max file downloaded files and my wireless wifi had intermittent problem last night. Anyway if it is easy to adjust your configuration file, it will be great as not to waste the already finished task otherwise I'll to abort them. The high core count machine chews these tasks really fast. Not sure if it is possible to increase the task size and reduce load on your network server by doing this. To put things in perspective if someone has a 256 thread machine and each task finishes in 20-30 mins, it will take less than 2 hours (that's less than 0.1 days of work cache size) just to crunch 1000 tasks, so having large work cache helps in case of network issues. Thanks. Wed 25 Dec 2024 07:01:07 AM PST \| latinsquares \| Sending scheduler request: Requested by user. Wed 25 Dec 2024 07:01:07 AM PST \| latinsquares \| Reporting 1728 completed tasks Wed 25 Dec 2024 07:01:07 AM PST \| latinsquares \| Not requesting tasks: "no new tasks" requested via Manager Wed 25 Dec 2024 07:01:08 AM PST \| latinsquares \| Scheduler request to http://boinc.multi-pool.info/latinsquares_cgi/cgi failed: Error 413 ID: 3873 · Rating: 0 · rate: / Reply Quote

CallMeFoxie Send message Joined: 20 Oct 24 Posts: 13 Credit: 893,796 RAC: 11,140	Message 3875 - Posted: 28 Dec 2024, 18:11:06 UTC - in response to Message 3873. There is setting max_results_accepted to 120 on the server side but it doesn't seem to be doing what it should? Anyways I upped it again to 80MB, Not many people have this many cores :) I am myself at 56 threads max in one server :D ID: 3875 · Rating: 0 · rate: / Reply Quote

pututu Send message Joined: 7 Jun 18 Posts: 5 Credit: 6,218,024 RAC: 72,408	Message 3877 - Posted: 29 Dec 2024, 5:24:17 UTC - in response to Message 3875. Last modified: 29 Dec 2024, 5:26:57 UTC In reply to CallMeFoxie's message of 28 Dec 2024: There is setting max_results_accepted to 120 on the server side but it doesn't seem to be doing what it should? Anyways I upped it again to 80MB, Not many people have this many cores :) I am myself at 56 threads max in one server :D Still unable to report the already uploaded 1728 tasks to the server even after restarting the boinc client. Shouldn't the max_results_accepted be set higher than 120, say 1800 for my case since I have 1728 tasks to be reported or perhaps this only applies to tasks not yet uploaded and reported? Anyway, thanks for looking into it but I learnt that it is best not to have over 1000 tasks in the work cache in case of any network interruption. Talking about that, yesterday your server was down for a few hours but I set my work cache small (<500 tasks) this time around, so no issue in reporting the completed tasks. I have backup project, so no big deal but I wanted to focus on latinsquare after a long pause. ID: 3877 · Rating: 0 · rate: / Reply Quote

CallMeFoxie Send message Joined: 20 Oct 24 Posts: 13 Credit: 893,796 RAC: 11,140	Message 3879 - Posted: 29 Dec 2024, 21:34:54 UTC - in response to Message 3877. Yes, sorry about yesterday - while the server was doing a live backup it ran out of disk space on the backup drive which paused the VM for a few hours while I was asleep! You can set the limit of how many tasks get uploaded at once locally though, somebody posted earlier the config option. ID: 3879 · Rating: 0 · rate: / Reply Quote

pututu Send message Joined: 7 Jun 18 Posts: 5 Credit: 6,218,024 RAC: 72,408	Message 3880 - Posted: 30 Dec 2024, 4:36:24 UTC - in response to Message 3879. Last modified: 30 Dec 2024, 4:46:38 UTC In reply to CallMeFoxie's message of 29 Dec 2024: Yes, sorry about yesterday - while the server was doing a live backup it ran out of disk space on the backup drive which paused the VM for a few hours while I was asleep! You can set the limit of how many tasks get uploaded at once locally though, somebody posted earlier the config option. No worries. Thanks for the suggestion. The solution is to add <max_tasks_reported>300</max_tasks_reported> into my local cc_config.xml file. I arbitrarily chose 300 tasks. There is no issue in uploading 1000+ tasks but you already did point out to the solution of using <max_tasks_reported> tag in this thread where you suggested 500 tasks. Somehow I think we didn't connect these two posts, lol. Anyway, I followed the suggestion from rakesearch: https://rake.boincfast.ru/rakesearch/forum_thread.php?id=103 and it works. Sun 29 Dec 2024 08:18:59 PM PST \| latinsquares \| Sending scheduler request: To report completed tasks. Sun 29 Dec 2024 08:18:59 PM PST \| latinsquares \| Reporting 300 completed tasks Sun 29 Dec 2024 08:18:59 PM PST \| latinsquares \| Not requesting tasks: "no new tasks" requested via Manager Sun 29 Dec 2024 08:19:02 PM PST \| latinsquares \| Scheduler request completed Sun 29 Dec 2024 08:19:02 PM PST \| latinsquares \| Project requested delay of 7 seconds Sun 29 Dec 2024 08:19:13 PM PST \| latinsquares \| Sending scheduler request: To report completed tasks. Sun 29 Dec 2024 08:19:13 PM PST \| latinsquares \| Reporting 300 completed tasks Sun 29 Dec 2024 08:19:13 PM PST \| latinsquares \| Not requesting tasks: "no new tasks" requested via Manager Sun 29 Dec 2024 08:19:16 PM PST \| latinsquares \| Scheduler request completed Sun 29 Dec 2024 08:19:16 PM PST \| latinsquares \| Project requested delay of 7 seconds Sun 29 Dec 2024 08:19:26 PM PST \| latinsquares \| Sending scheduler request: To report completed tasks. Sun 29 Dec 2024 08:19:26 PM PST \| latinsquares \| Reporting 300 completed tasks Sun 29 Dec 2024 08:19:26 PM PST \| latinsquares \| Not requesting tasks: "no new tasks" requested via Manager Sun 29 Dec 2024 08:19:29 PM PST \| latinsquares \| Scheduler request completed Sun 29 Dec 2024 08:19:29 PM PST \| latinsquares \| Project requested delay of 7 seconds Sun 29 Dec 2024 08:19:39 PM PST \| latinsquares \| Sending scheduler request: To report completed tasks. Sun 29 Dec 2024 08:19:39 PM PST \| latinsquares \| Reporting 300 completed tasks Sun 29 Dec 2024 08:19:39 PM PST \| latinsquares \| Not requesting tasks: "no new tasks" requested via Manager Sun 29 Dec 2024 08:19:42 PM PST \| latinsquares \| Scheduler request completed Sun 29 Dec 2024 08:19:42 PM PST \| latinsquares \| Project requested delay of 7 seconds Sun 29 Dec 2024 08:19:52 PM PST \| latinsquares \| Sending scheduler request: To report completed tasks. Sun 29 Dec 2024 08:19:52 PM PST \| latinsquares \| Reporting 288 completed tasks Sun 29 Dec 2024 08:19:52 PM PST \| latinsquares \| Not requesting tasks: "no new tasks" requested via Manager Sun 29 Dec 2024 08:19:56 PM PST \| latinsquares \| Scheduler request completed Sun 29 Dec 2024 08:19:56 PM PST \| latinsquares \| Project requested delay of 7 seconds Sun 29 Dec 2024 08:20:06 PM PST \| latinsquares \| Sending scheduler request: To report completed tasks. Sun 29 Dec 2024 08:20:06 PM PST \| latinsquares \| Reporting 168 completed tasks Sun 29 Dec 2024 08:20:06 PM PST \| latinsquares \| Not requesting tasks: "no new tasks" requested via Manager Sun 29 Dec 2024 08:20:09 PM PST \| latinsquares \| Scheduler request completed Sun 29 Dec 2024 08:20:09 PM PST \| latinsquares \| Project requested delay of 7 seconds ID: 3880 · Rating: 0 · rate: / Reply Quote