Message boards : Number crunching : The processing of results
Message board moderation
Author | Message |
---|---|
Send message Joined: 22 Oct 17 Posts: 3083 Credit: 0 RAC: 0 |
I return to the issue of processing the results of ODLK and ODLK1 projects. I have repeatedly raised this issue. I raised this question in personal correspondence and on the forum. The problem is still not solved. ODLK project launched May 19, 2017. ODLK1 project launched November 5, 2017. All this time I have been processing the results of both projects manually. This is very bad! The procedure for processing the results must be automated! I processed the results of the ODLK project for September. There are few results in this project and less time is required for processing than for results from the ODLK1 project. I will no longer manually process the results. This is nonsense! We have two operational BOINC projects and have not automated the processing of results. Now about the primary results in projects. As I noted earlier, the results in the ODLK project are open and accessible to all. In the project ODLK1 results are closed. If the administrators of the project ODLK1 Progger and ice00 do not want to automate the processing of results, let them open the results. Then the primary results will be available to everyone. Anyone can handle them yourself. But opening the results, remember the story https://boinc.progger.info/odlk/forum_thread.php?id=69 Recently, Belyshev made a wonderful script for primary and secondary processing of results. I can tell about this script, if administrators are interested. If they are still not interested in automatic processing of the results, then you do not need to talk about the script. So, I wait for the answer of administrators. |
Send message Joined: 28 Oct 17 Posts: 220 Credit: 59,101 RAC: 13 |
If you have the algorithm or script for processing the result, then I'm interested for making the automation. |
Send message Joined: 22 Oct 17 Posts: 3083 Credit: 0 RAC: 0 |
If you have the algorithm or script for processing the result, then I'm interested for making the automation. Good. Tomorrow I will talk in detail about the script by Belyshev. |
Send message Joined: 22 Oct 17 Posts: 3083 Credit: 0 RAC: 0 |
Progger, ice00 I start the story about the script by Belyshev. whitefox;91190 wrote: Ð”Ð»Ñ Ð°Ð²Ñ‚Ð¾Ð¼Ð°Ñ‚Ð¸Ð·Ð°Ñ†Ð¸Ð¸ Ð²Ñ‹Ð¿Ð¾Ð»Ð½ÐµÐ½Ð¸Ñ Ð·Ð°Ð¼Ñ‹ÐºÐ°Ð½Ð¸Ñ, в архив программы Канонизатор_ЛК_по_ДЛК помещён Ñкрипт zamyk.bat. See http://forum.boinc.ru/default.aspx?g=posts&m=91190#post91190 Download link archive https://yadi.sk/d/jga_oPqjuhuYC Now you have to write the results to the file input.txt and run the zamyk.bat script. All CF ODLS will be written to the file out_klpmd.txt. You can process the results every day. Or you can process the results for the month. The software made for Windows. We already have a large database CF ODLS. Some CF ODLS from the out_klpmd.txt file may be contained in an existing database. Therefore, CF ODLS needs to be checked for uniqueness. For this, I use the utility by a colleague V. Chirkov. This is a simple utility. A similar utility is available by Belyshev. You can write this utility yourself. Good luck! |
Send message Joined: 22 Oct 17 Posts: 3083 Credit: 0 RAC: 0 |
Hello, ice00! Did you process the results from the ODLK1 project for September? Or do you have a problem? I am showing an example. I took the results for October 1, 2018 from the project ODLK1 (Application odlk3). There are 3940 CF ODLS. I write these solutions to the file input.txt and run the zamyk.bat script. Script work protocol ПоиÑк вÑех КФ марьÑжных ДЛК Ð´Ð»Ñ Ð›Ðš Введено ЛК: 3940 Проверено ЛК: 82 ÑкороÑÑ‚ÑŒ 4644 ДЛК в Ñек Проверено ЛК: 163 ÑкороÑÑ‚ÑŒ 4738 ДЛК в Ñек Проверено ЛК: 244 ÑкороÑÑ‚ÑŒ 4698 ДЛК в Ñек Проверено ЛК: 324 ÑкороÑÑ‚ÑŒ 4707 ДЛК в Ñек Проверено ЛК: 405 ÑкороÑÑ‚ÑŒ 4746 ДЛК в Ñек . . . . . Проверено ЛК: 3673 ÑкороÑÑ‚ÑŒ 4715 ДЛК в Ñек Проверено ЛК: 3754 ÑкороÑÑ‚ÑŒ 4705 ДЛК в Ñек Проверено ЛК: 3834 ÑкороÑÑ‚ÑŒ 4701 ДЛК в Ñек Проверено ЛК: 3914 ÑкороÑÑ‚ÑŒ 4710 ДЛК в Ñек Проверено ДЛК : 1156893 Ðайдено КФ марьÑжных ДЛК: 4179 Ð’Ñ€ÐµÐ¼Ñ Ñ€Ð°Ð±Ð¾Ñ‚Ñ‹ в Ñек : 248.249 ************************************************* ПоиÑк вÑех КФ марьÑжных ДЛК Ð´Ð»Ñ Ð›Ðš Введено ЛК: 4186 Проверено ЛК: 82 ÑкороÑÑ‚ÑŒ 4674 ДЛК в Ñек Проверено ЛК: 162 ÑкороÑÑ‚ÑŒ 4699 ДЛК в Ñек . . . . Проверено ЛК: 3856 ÑкороÑÑ‚ÑŒ 4091 ДЛК в Ñек Проверено ЛК: 3937 ÑкороÑÑ‚ÑŒ 4715 ДЛК в Ñек Проверено ЛК: 4005 ÑкороÑÑ‚ÑŒ 3998 ДЛК в Ñек Проверено ЛК: 4072 ÑкороÑÑ‚ÑŒ 3920 ДЛК в Ñек Проверено ЛК: 4142 ÑкороÑÑ‚ÑŒ 4079 ДЛК в Ñек Проверено ДЛК : 1225324 Ðайдено КФ марьÑжных ДЛК: 4193 Ð’Ñ€ÐµÐ¼Ñ Ñ€Ð°Ð±Ð¾Ñ‚Ñ‹ в Ñек : 285.403 . . . . ПоиÑк вÑех КФ марьÑжных ДЛК Ð´Ð»Ñ Ð›Ðš Введено ЛК: 8148 Проверено ЛК: 59 ÑкороÑÑ‚ÑŒ 3380 ДЛК в Ñек Проверено ЛК: 123 ÑкороÑÑ‚ÑŒ 3620 ДЛК в Ñек Проверено ЛК: 192 ÑкороÑÑ‚ÑŒ 3978 ДЛК в Ñек Проверено ЛК: 244 ÑкороÑÑ‚ÑŒ 3055 ДЛК в Ñек Проверено ЛК: 309 ÑкороÑÑ‚ÑŒ 3804 ДЛК в Ñек . . . . . Проверено ЛК: 7906 ÑкороÑÑ‚ÑŒ 4673 ДЛК в Ñек Проверено ЛК: 7987 ÑкороÑÑ‚ÑŒ 4694 ДЛК в Ñек Проверено ЛК: 8067 ÑкороÑÑ‚ÑŒ 4689 ДЛК в Ñек Проверено ЛК: 8148 ÑкороÑÑ‚ÑŒ 4680 ДЛК в Ñек Проверено ДЛК : 2388615 Ðайдено КФ марьÑжных ДЛК: 8396 Ð’Ñ€ÐµÐ¼Ñ Ñ€Ð°Ð±Ð¾Ñ‚Ñ‹ в Ñек : 579.438 Ðайдено марьÑжных КФ: count[1] = 8376 count[2] = 20 Ð’Ñего: 8396 Ðайдено Ñоквадратов: 8416 КФ Ñоквадратов: 8396 Ð”Ð»Ñ Ð¿Ñ€Ð¾Ð´Ð¾Ð»Ð¶ÐµÐ½Ð¸Ñ Ð½Ð°Ð¶Ð¼Ð¸Ñ‚Ðµ любую клавишу . . . Found 8396 CF ODLS. They are written to the out_klpmd.txt file. Please note: CF ODLS is written to the out_klpmd.txt file in format 2. Our database CF ODLS is in format 1. To check the CF ODLS for uniqueness, you must first convert them to format 1. But you can continue the CF ODLS database in format 2. This is an example of processing the results for the day. The processing of results for the month lasts a very long time. Therefore, it is necessary to automate this processing. But as I see it has not been done yet (?) |
Send message Joined: 22 Oct 17 Posts: 3083 Credit: 0 RAC: 0 |
Now I am setting an example for everyone. I took the results for October 1, 2018 from the ODLK project at the following link https://boinc.progger.info/odlk_results/odlk3/2018-10-01.txt This is 950 CF ODLS. I wrote these CF ODLS in the input.txt file and ran the zamyk.txt script. Script work protocol ПоиÑк вÑех КФ марьÑжных ДЛК Ð´Ð»Ñ Ð›Ðš Введено ЛК: 950 Проверено ЛК: 78 ÑкороÑÑ‚ÑŒ 4606 ДЛК в Ñек Проверено ЛК: 158 ÑкороÑÑ‚ÑŒ 4619 ДЛК в Ñек Проверено ЛК: 239 ÑкороÑÑ‚ÑŒ 4692 ДЛК в Ñек Проверено ЛК: 319 ÑкороÑÑ‚ÑŒ 4685 ДЛК в Ñек Проверено ЛК: 400 ÑкороÑÑ‚ÑŒ 4707 ДЛК в Ñек Проверено ЛК: 479 ÑкороÑÑ‚ÑŒ 4700 ДЛК в Ñек Проверено ЛК: 560 ÑкороÑÑ‚ÑŒ 4702 ДЛК в Ñек Проверено ЛК: 640 ÑкороÑÑ‚ÑŒ 4649 ДЛК в Ñек Проверено ЛК: 721 ÑкороÑÑ‚ÑŒ 4658 ДЛК в Ñек Проверено ЛК: 801 ÑкороÑÑ‚ÑŒ 4682 ДЛК в Ñек Проверено ЛК: 815 ÑкороÑÑ‚ÑŒ 801 ДЛК в Ñек Проверено ЛК: 896 ÑкороÑÑ‚ÑŒ 4690 ДЛК в Ñек Проверено ДЛК : 278285 Ðайдено КФ марьÑжных ДЛК: 950 Ð’Ñ€ÐµÐ¼Ñ Ñ€Ð°Ð±Ð¾Ñ‚Ñ‹ в Ñек : 63.742 ************************************************* ПоиÑк вÑех КФ марьÑжных ДЛК Ð´Ð»Ñ Ð›Ðš Введено ЛК: 950 Проверено ЛК: 77 ÑкороÑÑ‚ÑŒ 4543 ДЛК в Ñек Проверено ЛК: 156 ÑкороÑÑ‚ÑŒ 4667 ДЛК в Ñек Проверено ЛК: 237 ÑкороÑÑ‚ÑŒ 4760 ДЛК в Ñек Проверено ЛК: 318 ÑкороÑÑ‚ÑŒ 4698 ДЛК в Ñек Проверено ЛК: 399 ÑкороÑÑ‚ÑŒ 4686 ДЛК в Ñек . . . . . Проверено ЛК: 633 ÑкороÑÑ‚ÑŒ 4217 ДЛК в Ñек Проверено ЛК: 711 ÑкороÑÑ‚ÑŒ 4678 ДЛК в Ñек Проверено ЛК: 793 ÑкороÑÑ‚ÑŒ 4720 ДЛК в Ñек Проверено ЛК: 875 ÑкороÑÑ‚ÑŒ 4717 ДЛК в Ñек Проверено ДЛК : 279372 Ðайдено КФ марьÑжных ДЛК: 953 Ð’Ñ€ÐµÐ¼Ñ Ñ€Ð°Ð±Ð¾Ñ‚Ñ‹ в Ñек : 60.138 ************************************************* ПоиÑк вÑех КФ марьÑжных ДЛК Ð´Ð»Ñ Ð›Ðš Введено ЛК: 7 Проверено ДЛК : 2095 Ðайдено КФ марьÑжных ДЛК: 7 Ð’Ñ€ÐµÐ¼Ñ Ñ€Ð°Ð±Ð¾Ñ‚Ñ‹ в Ñек : 0.468 ************************************************* ╚чтыхўхÑшх шÑЇюÐьрЎшш ================================================= Канонизатор ЛК10 Введено ЛК : 1910 Ðайдено КФ ЛК: 1907 Ð’Ñ€ÐµÐ¼Ñ Ñ€Ð°Ð±Ð¾Ñ‚Ñ‹ : 0.124 Ñек ПоиÑк вÑех КФ марьÑжных ДЛК Ð´Ð»Ñ Ð›Ðš Введено ЛК: 1907 Проверено ЛК: 76 ÑкороÑÑ‚ÑŒ 4471 ДЛК в Ñек Проверено ЛК: 155 ÑкороÑÑ‚ÑŒ 4673 ДЛК в Ñек Проверено ЛК: 202 ÑкороÑÑ‚ÑŒ 2740 ДЛК в Ñек Проверено ЛК: 277 ÑкороÑÑ‚ÑŒ 4468 ДЛК в Ñек . . . . . Проверено ЛК: 1552 ÑкороÑÑ‚ÑŒ 4712 ДЛК в Ñек Проверено ЛК: 1632 ÑкороÑÑ‚ÑŒ 4700 ДЛК в Ñек Проверено ЛК: 1714 ÑкороÑÑ‚ÑŒ 4756 ДЛК в Ñек Проверено ЛК: 1796 ÑкороÑÑ‚ÑŒ 4723 ДЛК в Ñек Проверено ЛК: 1876 ÑкороÑÑ‚ÑŒ 4722 ДЛК в Ñек Проверено ДЛК : 559752 Ðайдено КФ марьÑжных ДЛК: 1910 Ð’Ñ€ÐµÐ¼Ñ Ñ€Ð°Ð±Ð¾Ñ‚Ñ‹ в Ñек : 122.725 Ðайдено марьÑжных КФ: count[1] = 1898 count[2] = 12 Ð’Ñего: 1910 Ðайдено Ñоквадратов: 1922 КФ Ñоквадратов: 1910 Ð”Ð»Ñ Ð¿Ñ€Ð¾Ð´Ð¾Ð»Ð¶ÐµÐ½Ð¸Ñ Ð½Ð°Ð¶Ð¼Ð¸Ñ‚Ðµ любую клавишу . . . Found 1910 CF ODLS. They are written to the out_klpmd.txt file in format 2. What is not clear in this example? |
Send message Joined: 28 Oct 17 Posts: 220 Credit: 59,101 RAC: 13 |
Hi, having problem in translate Russian text in source not coded in UTF-8 (so Google translate did not process it) into English. |
Send message Joined: 22 Oct 17 Posts: 3083 Credit: 0 RAC: 0 |
Unfortunately, I can not help you with this. Ask for help to the software developer Belyshev. You can also ask for help from Progger. https://yadi.sk/i/S1HhJBwp3Pr9jX |
Send message Joined: 28 Oct 17 Posts: 220 Credit: 59,101 RAC: 13 |
Get the translation in English. Source code did not provide all programs that the bat script are calling (like IZVL, SORT_COUNT and TYPE_COUNT). Are this available or should be created from scratch? Thanks |
Send message Joined: 22 Oct 17 Posts: 3083 Credit: 0 RAC: 0 |
The fact is that I use script executables in the Windows system. I am not compiling anything again. So I don't need the source codes. The script developer Belyshev can answer on this question. https://yadi.sk/i/S1HhJBwp3Pr9jX |
Send message Joined: 22 Oct 17 Posts: 3083 Credit: 0 RAC: 0 |
ice00 You did not solve the issue of processing the results? Results in the ODLK1 project are not processed since September 1, 2018. The situation is critical. Results in the project are closed. Project participants do not see results. This is an abnormal situation. If you are not able to process the results, you must open them. Progger ignores my calls altogether. Results must be made available to participants. Do you understand this ??? Please indicate what you intend to do in this situation. |
Send message Joined: 22 Oct 17 Posts: 3083 Credit: 0 RAC: 0 |
ice00 I am waiting for an answer to my question. What did you do to process the results? What do you intend to do? Three months results in the ODLK1 project are not processed and not published. In such a situation the results may be lost. I suggest you publish unprocessed results for each month if you are not able to do automatic processing of the results. |
Send message Joined: 28 Oct 17 Posts: 220 Credit: 59,101 RAC: 13 |
ice00 hi, I had the complete sources and I'm still creating and testing the scripts needed to automate the process (that involve two servers). Do not expect (automatic processed) result published until Christmas due to my working deadlines and two intensive courses I'm making every days (70+ hours of courses to make in two months, to be followed not during working time). I can instead publish unprocessed data tomorrow. |
Send message Joined: 22 Oct 17 Posts: 3083 Credit: 0 RAC: 0 |
I can instead publish unprocessed data tomorrow. OK. Publishe unprocessed results tomorrow. Merry Christmas! I hope that by Christmas 2019 you will do automatic processing of the results :) |
Send message Joined: 28 Oct 17 Posts: 220 Credit: 59,101 RAC: 13 |
Unprocessed result should appears onto those link (It is not necessary to have a Google account to download it) https://drive.google.com/open?id=1wIf97_bLDvnb1WalOsjU9vODZqRZ_WNw |
Send message Joined: 22 Oct 17 Posts: 3083 Credit: 0 RAC: 0 |
ice00 Thanks. I downloaded unprocessed results for October and November. However, you forgot to publish the results for September. The last processed results for August posted here https://boinc.multi-pool.info/latinsquares/forum_thread.php?id=46&postid=287#287 Please publish the results for September. Then I will publish a short report. |
Send message Joined: 28 Oct 17 Posts: 220 Credit: 59,101 RAC: 13 |
September added. Thanks |
Send message Joined: 22 Oct 17 Posts: 3083 Credit: 0 RAC: 0 |
I previewed the results, only the initial processing. Unique ODLS pair groups were found that are published in the following topics https://boinc.progger.info/odlk/forum_thread.php?id=42 https://boinc.progger.info/odlk/forum_thread.php?id=40 Full processing of the results requires a lot of time and computational resources. I hope that ice00 will finish the work on preparing the automatic processing of the results. Dear participants! Now you can complete processing of the results yourself. The above is how to do this. I hope that soon ice00 will automatically process the results. |
Send message Joined: 22 Oct 17 Posts: 3083 Credit: 0 RAC: 0 |
ice00 please publish the results from the ODLK1 project for December. |
Send message Joined: 28 Oct 17 Posts: 220 Credit: 59,101 RAC: 13 |
ice00 Hi, already published on 1/1/2019. The files are all in the folder for ODLK1 result: https://drive.google.com/drive/u/0/folders/1wIf97_bLDvnb1WalOsjU9vODZqRZ_WNw (it should be open to everyone) |
©2024 ©2024 Progger & Stefano Tognon (ice00) & Reese