janhuenermann / neurojs Goto Github PK

I am trying to run the cars example. I ran npm install and then npm start. But when I go into the console of the page it says neurojs is not defined. It is trying to find a file called build/neurojs-v2.js and that just doesn't exist. Not quite sure why...

I made a library like this with more features and faster.
https://github.com/TrevorBlythe/MentisJS

in and instanceof expressions in JS

a in obj;
a instanceof C;

can be negated by grouping them and applying the ! operator, i.e.

!(a in obj);
!(a instanceof C);

Applying the ! operator incorrectly (on the LHS operand) leads to bugs:

!a in obj; // will evaluate to false, unless obj has a "true" or "false" key
!a instanceof C; // will evaluate to false, unless C overrides instanceof with a @@hasInstance method

For more information, please see these MDN docs and the no-unsafe-negation recommended Eslint rule.

I have found a potentially problematic instance of the above bugs in your codebase:

Hi,
How can we debug the learning process and metrics of the RL Network to get the understand about the process.

Thanks
Vijay

Hello! I'm trying to do reinforcement learning using NeuroJS. Looking at the code, it appears that the Agent class is the backbone for the reinforcement learning in NeuroJS. I'm having trouble understanding it.

Are these the only steps required to use this library for reinforcement learning:

1. Create Agent object (only feeding in number of states and actions)
2. Call Agent.policy() for some time (do I call act()? simulate()? evaluate()?)
3. Call Agent.learn()`

Is there anything else needed? Also, is there a .reset() "function" that lets me remove the history of the Agent, but keep the learned weights/values?

Thanks for creating this repository!

While you're using browser tech, why not link to a working build? Github pages is great for this.

Drive into a dead end way, the car can't back out.

waterworld terrorizes mankind.
no changes made to code just waited some seconds for climate change to destroy the fun.

It would be good :)

Hey, awesome project!

I might be missing something, but I'm not able to change any of the source files in src or example/cars, the files aren't rebuilt, even after running npm run build. Is there a step/configuration I'm missing?

Is it possible to train this network with episodes? E.g. in Karpathy Waterworld, one can add a rule "the character dies if it eats a green pill". After death the "character" shall be revived, how do I tell the network to switch to a new episode? The same could be done for cars example, if a car "explodes" when it touches a wall.

Great lib anyway, and code is well written.