cardillo / joinery Goto Github PK
View Code? Open in Web Editor NEWData frames for Java
Home Page: https://joinery.sh
License: GNU General Public License v3.0
Data frames for Java
Home Page: https://joinery.sh
License: GNU General Public License v3.0
probably using apache-poi
for example, cumsum, cumprod, cummin, and cummax.
would be nice to add tab completion for objects, fix the method resolution issues (this is especially tricky since nashorn uses dynalink and rhino has an internal prioritization mechanism), add ability to source script files.
such as avoiding copies, making efficient use of memory, parallelization, etc.
this will also require refactoring the indices to no longer be strictly strings (similar to timeseries support)
The function provided as argument would be iterated through the rows and its output would be stored in the newly created column.
I can think of many use cases but the one why I am posting is: creating mid prices from bid and ask columns for time series of prices.
Ideally the iterated function would accept the whole current row as argument. The row itself would be a Map so as to be able to access individual items using the column name, not using their position.
Hi, I would like to know why this project is copyright to IBM? Is it supported by IBM? Additionally, is it possible to use another open source license, such as MIT?
occasionally, it is more clear to display a grid of charts with one column per chart rather than plotting all the columns on a single chart.
similar to grouping by a custom key function, it should be possible to sort with a custom comparator.
Could you show me a way to calculate the covariance of this Dataframe?
0 1
0_left 29789,00000000 29657,00000000
0_right 39140,00000000 26047,00000000
0 1380349,00000000 698550,00000000
Rgds,
JJ
More of a question/potential enhancement request than anything. Basically, I was just wondering what it would take to create methods to coerce existing objects into a DataFrame object? I would imagine 2d Arrays would be fairly easy to handle (although I could be completely wrong). My hope was that as I get some other work wrapped up on some readers/parsers for Stata formatted files (as well as others in the future) it'd be possible to build the classes/methods around an idea of being able to coerce the data into a DataFrame (then there'd be the advantage of joins/unions of files from different statistical software platforms). Also, I haven't looked too much into the documentation yet, but if there is a way to retain any metadata with the file that would be helpful as well (e.g., variable labels (distinct from column names), value labels (e.g., analogous to descriptions in a look up table in a SQL database), etc...).
diff and percentChange could be updated to use this as well.
Joinery misses too many useful api. For example, I cannot even set a specific type for fields from .csv file in the method of read_csv
method. Joinery just reads original String
type as Double
and I just can do nothing about this.
Is there a way to extend the joinery Dataframe class to add custom methods.
similar to summary(df) in R
http://nd4j.org, http://math.nist.gov/javanumerics/jama/, or http://dst.lbl.gov/ACSSoftware/colt/ for example. the primary issue appears to be support for primitives versus objects.
and other reading flexibility such as preferred numeric type and date time format
worst case is single element groups in which the higher the index the larger the bitset, could go back to hashmap based implementation or investigate sparse bitset.
as a convenient way to display summary statistics about the data frame.
This isn't an issue (sorry), just wanted to say thanks for making this. As a programmer who used pandas religiously in grad school, and now forced to program in pure Java, this is a godsend.
PS, wondering what it would take to embed the dataframe plot into an existing JFrame/JPanel? I have an existing JPanel with a JFree chart in there, and would love to swap it out with the plot that's mostly controlled by the dataframe.
the current way of overloading is confusing and prone to surprises, each of these operations probably needs its own name.
dates are currently written out as strings in a format not recognized by the csv reader
after toying with this idea a bit, it isn't trivial to make the row and column indices generic, but with a little work and/or casting it could work. the biggest challenge is how to represent the type of index returned by grouping (could be any object type or a list depending on the number of columns). at this point I don't think it is worth the added complexity.
The Serialization.<V>writeCsv(final DataFrame<V> df, final OutputStream output)
method doesn't write the row names if df
is a dataframe which has row names.
area, bar, scatter, etc.
inverse of pivot, possibly add stack and unstack as well.
It would be great to have factors (like in R) as type for columns. I didn't find something similar. Are there any plans in this directions?
this will take some significant refactoring since currently the row and column indices are hard coded as strings (and parsing to/from datetime types is not a solution).
the initial convert implementation only checked the first row for type conversions, therefore it was possible it would detect a column as Long
numeric value but later in the frame a Double
would be found causing the conversion to fail. though it is rather expensive, convert shouldn't be used all that often (the most common use will be just after reading from disk) so I think it is safe to scan the entire column to test the conversion.
currently, interrupt (^C) in the shell stops the shell altogether, this is ok if nothing is running, but it would be nice if it could also be used to stop the current command and leave the shell running if one wants to cancel a long-running operation.
Hi,
How can i add an extra argument numShares?
public void getStaticProfile(int numShares) {
this.service.getDf().apply(new Function<Object,Number>() {
public Number apply(Object value) {
BigDecimal b = new BigDecimal(value.toString());
System.out.println(b);
return b.multiply(new BigDecimal(numShares));
}
});
}
Rgds,
JJ
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.