Square Root Problem about karoo_gp HOT 7 OPEN

from karoo_gp.

Thank you Aymen. I was not aware of this problem. Much appreciated. By "2000 iterations" do you mean generations? kai
…
On 6/20/21 11:26 PM, asksak wrote: Hello, As I was working on Karoo, and when testing I observed this: SQUARE ROOT causes the runs to become very slow, and the more iterations are run the slower Karoo became until I got memory error. I googled the issue and it seems its a sympy issue with sqrt. I used 50 as population and (as I modified the code) I used 2000 as iterations. the program ran very fast and completed without sqrt. However with sqrt, it was slow, then became unresponsive then gave a memory error. FYI, Aymen

Yes iterations is generations, I modified the code to accept 10K generations.

from karoo_gp.

from karoo_gp.

I'll try to make a function to write generation vs fitness. we'll find out.

from karoo_gp.

Wow. I have never needed to go beyond 50 generations. I am very curious as to the kind of data you are processing, and how your outcome varies after 50, 100, 1000, etc. Have you plotted the fitness function vs the generations? Are you overfitting?
…

Hello Kai,

I tried 50, 100, 200 and the results were:

for 50 gens: best Classification fitness score: 264
for 100 gens: best Classification fitness score: 284.0
for 200 gens: best Classification fitness score: 379.0

To verify I tested other sets( 4 sets ) of data than the one used for the run, I used excel and inserted the equations there:

for 50 gens: prediction accuracy: >50% and less than 60%
for 100 gens: Classification fitness score: >50% and less than 65%
for 200 gens: Classification fitness score: >70% and less than 80%

I understand the possibility of overfitting, however, GP depends on RANDOM mutations, and I modified the the probability of mutation in the code to also be random within a certain range for each generation. This dynamic mutation method is much more effective than static mutation values.

But YES, when listing the best trees from each run, they must be all taken into consideration as some freak (high fitness) trees just classify everything as 1 or 0 when tested with other sets in excel (that confused me as I am sure I ported the tree equations correctly to excel).

Best Regards,

Aymen

from karoo_gp.

from karoo_gp.

@asksak Have you tried sqrt in the newest release? Let me know if it's working, and I'll close this issue.

from karoo_gp.