Comments (8)
Maybe the intention was to open the file on call? Have no idea what else could that be.
It is also puzzling that we don't need to close the file.
Read 2nd answer from: http://stackoverflow.com/questions/4458864/whats-the-right-way-to-use-scala-io-source and it turns out that we should actually avoid scala's Source.fromFile()...
from cassovary.
Aha -- not closing the file is definitely a bug that we should fix.
I wouldn't go to the extent to completely avoid io.Source but yes should take care of exceptions
But this will need to be modified too in AdjacencyListGraphReader as this will be evaluated as soon as the class is created:
val (edgesBySource, nodeMaxOutEdgeId) = readEdgesBySource()
from cassovary.
That is true, but () => Iterator is still weird. IMO Iterable looks better than this, if some initialization is needed.
I would like to see there sth like
def iteratorSeq: Iterable[NodeStream]
where
NodeStream extends Iterable[NodeIdEdgesMaxId] with Closeable {..}
from cassovary.
Agreed Iterable is good.
from cassovary.
I'm working on this. I did as @szymonm said. Then, do I also have to change
Seq[() => Iterator[NodeIdEdgesMaxId]]
to Iterable[NodeStream]
?
from cassovary.
Sorry. I mean, do I have to change Seq[() => Iterator[NodeIdEdgesMaxId]]
to Iterable[NodeStream]
in ArrayBasedDirectedGraph
and SharedArrayBasedDirectedGraph
?
from cassovary.
Pls squash the commits, @AnishShah when this will be ready to merge.
from cassovary.
@szymonm Done.
from cassovary.
Related Issues (20)
- ListOfEdgesGraphReader: Handle duplicate edges and/or maintain specified/sorted order HOT 4
- [Bug?] PageRank sum is much less 1 HOT 11
- Exception loading graph in SharedArrayBasedDirectedGraph HOT 5
- java.lang.OutOfMemoryError: PermGen space HOT 5
- Allow sorting and de-duplication of neighbors in AdjacencyListGraphReader as well
- Allow sparse array representation in ArrayBasedDirectedGraph HOT 1
- Convert Node.inboundNodes() and outboundNodes() to have Array[Int] instead of Seq[Int] HOT 7
- build falling HOT 1
- Build fails due to twitter metrics dependency HOT 3
- Do not use finagle-stats inside cassovary-core
- Write a Cassovary shell HOT 1
- Refactor API: s/node/vertex HOT 3
- Implement GraphX API on Cassovary HOT 1
- Implement Giraph API on Cassovary
- [question] Property Graph? HOT 1
- PerformanceBenchmark doesn't seem to be able to read gzipped files HOT 1
- Add optional command-line arg in PerformanceBenchmark to store only outgoing edges HOT 1
- Inconsistency in Node API HOT 1
- [question] What is the status of Cassovary? HOT 1
- How to Fix a Self-Dependence Error
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cassovary.