Two questions about ai-toolbox HOT 6 CLOSED

1. I'm trying to templatize as much of the code as possible (maybe one day to avoid building the library altogether, and just #including files), mostly to avoid inheritance. This is both for performance reasons, and also because it allows people to use their own classes for models instead of using the ones provided. Say you have a particular MDP/POMDP which you can implement very efficiently in some way; if I was using inheritance integrating it with the library would be very hard. With templates however it's easy.
2. I've removed the link for the same reason. If you have an MDP model which is implemented in some weird way, you can use my POMDP model with it instantly, without having to write any code. This also allows for using a POMDP::Model with both an MDP::Model and MDP::RLModel, for example. All in all, the less links between each part, the easier to use.

At the moment policies are instead still linked with inheritance. This is mostly because each policy class is very similar to the other ones and they reuse lots of functionality, so there's little reason not to do that. However I'm not a true C++ expert myself so maybe one day that will also change.

There isn't all that much Boost, is there? What are the parts that trouble you most? If you have any problems contributing just send me an email or write something here, I can help, or maybe write more docs where they are needed =)

Thanks for the comments!

from ai-toolbox.

Thanks for the clarification. It makes sens.

Actually you're right, it's not Boost but stuffs like std::is_same<decltype(test<M>(0)),std::true_type>::value && is_generative_model<M>::value that frightens me, there is too much template and namespace I can handle for now :). However, i'll need one day to dive into it to use the new version of the lib (I think this version is not compatible anymore with the one I use).

from ai-toolbox.

Yes, unfortunately I do tend to break things, but I'm not that experienced so I'm learning things as I go, and I hope that each change makes the whole better for it.

Those parts are in general to simplify compiler errors for users (look up SFINAE), it's not really meant to be touched all that much! It's so that you can have template requirements specified in a simple way (so I can say, for example, that in an algorithm that uses an MDP that the MDP class will allow for certain methods - kind of an abstract class). But sure, take your time, there's still much that I have to do anyway =)

from ai-toolbox.

I agree that hard inheritance can be restraining, i.e. if POMDP > MDP, it will be hard to add a class inbetween. However, if for some reasons I want to solve an MDP with POMCP, I cannot (due to the sampleSOR in simulate that doesn't exists in MDP). In either case, there is downside. I don't know if some kind of Java Interfaces, like partially observable, completely observable, mixed-observable etc., would work in order to specify more like an authorized behaviour than a strict model.

from ai-toolbox.

if for some reasons I want to solve an MDP with POMCP, I cannot

Except by transforming the MDP to a POMDP of course.

from ai-toolbox.

Well POMCP is an algorithm to apply Monte Carlo Tree Search to POMDPs, so it makes little sense to apply it to MDPs. If you need Monte Carlo for MDPs, might as well use MCTS (coming soon btw).
Edit: MCTS is now online for you to try out =)

from ai-toolbox.