Comments (5)
The discrete value object creates an array with various values that are set. These values might just be proxies for integers themselves, but the index into the array of values must still be positive, because it doesn't know that they're just a sequence of ints.
Alternatively, if you just want a very large number of integers (like your -5000 to +5000 example), you should use the IntValue type instead of the DiscreteValue type.
from burlap.
Thanks! INT
type values was what I really needed.
from burlap.
Tangentially related, the MDP I am testing has an agent that moves stochastically on this integer line, with probabilities based on the actions taken. You could think about it like a monetary account balance that changes over time. Is there something built into Burlap that will graphically visualize this? I didn't find anything obvious, but I did notice that you provide a GraphDefinedDomain. My current thought is to take the data written to file from policy.evaluateBehavior.writeToFile
and graph it externally.
from burlap.
Hmm probably not. Each visualizer is pretty specific to its domain so I'm not sure if there is something that can be easily co-opted to a 1D attribute visualizer. GraphDefinedDomain is also currently the only domain lacking a visualizer because I haven't yet decided what the best way to visualize arbitrary graphs is (graph visualization is effectively a research topic itself with many approaches).
It probably wouldn't be difficult for you to write your own if it's just a 1D visualization, but dumping to a file and using external graph tools would surely work as well.
from burlap.
That makes sense. Thanks again.
from burlap.
Related Issues (20)
- Is this a bug in SarsaLam implementation? HOT 2
- Hashing Performance in SimpleHashableState HOT 4
- DiscretizingMaskedHashableStateFactory is missing methods for handling config HOT 1
- StochasticGames SCPSolver does not work with Java 64-bit under Windows x64 HOT 2
- Renaming objects in a GenericOOState changes the order in objectsByClass list
- is the website source available?
- PerformancePlotter TRIAL_AVERAGES_ONLY Mode
- Null action issue on allApplicableActionsForTypes in ActionUtils.java
- Burlap incompatibilities HOT 1
- ROS - Continous Domain
- Possible bug in "performReachabilityFrom" function in PolicyIteration.java
- Actions are not published after terminal state
- StatePainter's Graphics2D Context Doesn't Update
- getTotalValueIterations() for ValueIteration?
- PolicyUtils.Rollout(Policy, State, SampleModel) will hang when policy does not reach goal state
- Agent can try to move out of bounds, throwing an ArrayIndexOutOfBoundsException HOT 1
- Q Learning Stochastic Movements HOT 5
- PolicyIteration error, type mismatch? HOT 1
- Cumulative probability incorrect in EMinMaxPolicy.getActionDistributionForState() ? HOT 1
- Cumulative probability incorrect in ECorrelatedQJointPolicy.getActionDistributionForState() ? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from burlap.