Thread 'Autonomous Subproject'

Message boards : News : Autonomous Subproject
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 10 · 11 · 12 · 13 · 14 · 15 · Next

AuthorMessage
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 635 - Posted: 18 Jan 2019, 7:39:55 UTC - in response to Message 630.  

I will try to process the results.

Tomas Brada

I ask you to make a software for processing results for the Linux system.

This is a problem for ice00, which he still has not solved.
ID: 635 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Tomas Brada

Send message
Joined: 22 Jan 18
Posts: 63
Credit: 373,915
RAC: 0
Message 636 - Posted: 18 Jan 2019, 18:18:11 UTC - in response to Message 635.  

Natalia Makarova
I made a very good progress on the result processing. But I need help. What outputs are desired? And in what format?
You want the CF ODL squares, that is for sure.
Then cf odl squares grouped by number of co-squares of each.
And then number of squares in each group ( count[1] = 1898 count[2] = 12 ... ).
I can give file with CF ODLSs together with their KF co-squares (like in your diagram).
I can make the output whatever you want!
Or should I replicate exact format as Belyshev's programs?

Second: in family_mar program, there is condition:
if(!is_simm(kf, lin))
, so the program will not produce symmetric(?) solutions. However the program klpmd does not have such condition. Is that correct? Which should be used for the PADLS experiment?
ID: 636 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Tomas Brada

Send message
Joined: 22 Jan 18
Posts: 63
Credit: 373,915
RAC: 0
Message 640 - Posted: 18 Jan 2019, 21:48:51 UTC - in response to Message 636.  
Last modified: 18 Jan 2019, 22:44:53 UTC

(me) I can give file with CF ODLSs together with their KF co-squares (like in your diagram).

Ignore this. This does not make sense to do and is different than diagram.
ID: 640 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 641 - Posted: 19 Jan 2019, 0:22:40 UTC - in response to Message 636.  
Last modified: 19 Jan 2019, 0:24:17 UTC

I made a very good progress on the result processing. But I need help. What outputs are desired? And in what format?

When processing the results, I need an out_klpmd.txt file, as well as files with groups of pairs of ODLS (three or more)

out_kf_3.txt
out_kf_4.txt
etc.
ID: 641 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 642 - Posted: 19 Jan 2019, 0:27:44 UTC - in response to Message 636.  
Last modified: 19 Jan 2019, 0:28:49 UTC

Second: in family_mar program, there is condition:
if(!is_simm(kf, lin))
, so the program will not produce symmetric(?) solutions. However the program klpmd does not have such condition. Is that correct? Which should be used for the PADLS experiment?

The PADLS experiment uses the family_mar program.

Since all symmetric solutions were found in another experiment, it is not necessary to look for them again.
ID: 642 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 643 - Posted: 19 Jan 2019, 1:21:22 UTC

XAVER
I received and processed your results for rows 61-80 in the PADLS experiment.
Found 151 unique CFs ODLS.

All is well.
Thanks.
ID: 643 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 644 - Posted: 19 Jan 2019, 1:28:26 UTC

XAVER
I received the processed results for October 2018.
All is well.
I will publish these results, as will be ready results for September.

Thank you very much.
ID: 644 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 646 - Posted: 19 Jan 2019, 6:06:32 UTC
Last modified: 19 Jan 2019, 6:07:29 UTC

XAVER
I received processed results for September.
All is well.
Thanks.

I will publish the results for September - October 2018 in the near future.
ID: 646 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 648 - Posted: 19 Jan 2019, 7:52:46 UTC

ID: 648 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 651 - Posted: 19 Jan 2019, 15:33:03 UTC
Last modified: 19 Jan 2019, 15:34:45 UTC

XAVER
I received processed results for November.
All is well.
Thanks.

I will publish the results when the results for December are ready.
ID: 651 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 653 - Posted: 19 Jan 2019, 15:54:31 UTC

XAVER
I received processed results for December.
I will check these results tomorrow and publish the results for November - December 2018.

Thank you very much!
ID: 653 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Tomas Brada

Send message
Joined: 22 Jan 18
Posts: 63
Credit: 373,915
RAC: 0
Message 655 - Posted: 19 Jan 2019, 19:21:18 UTC

I published compatible programs for processing results to my repository.
They are two programs: postprocess and ortogoncnt. Both are multithreaded programs and work on linux system. They should work on windows too, if compiled.
Postprocess program reads the results from boinc project, finds additional CF ODLSs (like in zamyk.bat) and adds them to database file.
Ortogencnt program removes duplicate squares from database, computes statistics and outputs out_ortogon.txt, out_kf_X.txt, and out_kf_mates.txt files, like zamyk.bat.
More information in the Readme file.

The first program (postprocess) should have been part of the boinc application, it would save a lot of time in result processing. I think it should be added to new PADLS boinc application.

I am currently processing results from September and I will compare them to XAVER's result to validate. Hopefully I have not included error.
ID: 655 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 656 - Posted: 20 Jan 2019, 4:28:45 UTC - in response to Message 655.  
Last modified: 20 Jan 2019, 4:45:07 UTC

I published compatible programs for processing results to my repository.

Tomas Brada
thank you very much for your work.

Notice the readme.txt file
© 2019 Progger & Stefano Tognon (ice00)

ODLK1 project results for September 2018

407995 unique CFs ODLS.

Results processed by XAVER.
The uniqueness of the results is checked by Natalia Makarova in the framework of the ODLK1 project, without taking into account the results of the ODLK project.

Created on January 19, 2019

First you will receive other CFs ODLS data:

The Application odlk3 is 226322 CFs.
The Application odlkmax is 184328 CFs.

These results received XAVER.

So we have
226322 +184328 = 410650 CFs.

Now pay attention to this
The uniqueness of the results is checked by Natalia Makarova in the framework of the ODLK1 project, without taking into account the results of the ODLK project.

The database currently contains more than 5,000,000 unique CFs.
I took now only part of the database - from the project ODLK1.
I perform a check for uniqueness in stages, it is very inconvenient.
It is necessary to automate this process.
I will write about it in detail in the subject
https://boinc.multi-pool.info/latinsquares/forum_thread.php?id=54
ID: 656 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 657 - Posted: 20 Jan 2019, 4:40:14 UTC
Last modified: 20 Jan 2019, 4:41:20 UTC

Yes, I have long been asking ODLK and ODLK1 project administrators to automate the processing of results.
But this is still not done.
I processed the results a year by manual. Now I do not do it.

ice00 deals with this problem, but the problem is not solved.

I offered to publish the raw results from ODLK1 project.
Results in the ODLK project are available to everyone.
ID: 657 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 660 - Posted: 20 Jan 2019, 8:17:41 UTC

ID: 660 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 671 - Posted: 20 Jan 2019, 17:57:56 UTC
Last modified: 20 Jan 2019, 18:01:57 UTC

XAVER
I received and processed your results for rows 81-100 in the PADLS experiment.
Found 184 unique CFs ODLS.
Fine!
Thanks.

I sent you a new 50 rows.
ID: 671 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 688 - Posted: 22 Jan 2019, 4:06:03 UTC

XAVER
I received and processed your results for rows 101-120 in the PADLS experiment.
Found 145 unique CFs ODLS.

All is well.
Thanks.
ID: 688 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 689 - Posted: 22 Jan 2019, 4:15:51 UTC
Last modified: 22 Jan 2019, 4:22:12 UTC

Tomas Brada
currently, the family_mar program works in one thread. It is very slow.

Is it possible to make this program multi-threaded?

PS. I saw multi-threaded programs when I participated in a contest for programmers.
My teammate wrote such programs.
These are good programs!
The user sets the number of threads.
ID: 689 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Project scientist
Avatar

Send message
Joined: 22 Oct 17
Posts: 3083
Credit: 0
RAC: 0
Message 690 - Posted: 22 Jan 2019, 4:29:04 UTC
Last modified: 22 Jan 2019, 4:32:38 UTC

To each!
Of course, you can make an artificial parallelization.

For example, run several programs in different folders.
It works well.

Or run several programs on different computers.
ID: 690 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Tomas Brada

Send message
Joined: 22 Jan 18
Posts: 63
Credit: 373,915
RAC: 0
Message 692 - Posted: 22 Jan 2019, 10:06:08 UTC - in response to Message 689.  

The version of family_mar in my repository is multi-threaded. It just needs to be compiled for your system. For example on my system:
git clone --recurse-submodules https://github.com/gridcoin-community/odlk-progs.git
cd odlk-progs
cmake -DCMAKE_BUILD_TYPE=Release .
make

For windows system example: https://github.com/tudelft3d/masbcpp/wiki/Building-on-Windows-with-CMake-and-MinGW
ID: 692 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 . . . 10 · 11 · 12 · 13 · 14 · 15 · Next

Message boards : News : Autonomous Subproject

©2024 ©2024 Progger & Stefano Tognon (ice00) & Reese