Comments (5)
Hi !
It is a research project so it doesn't have much of a documentation. I
suggest reading papers on columnar databases and database compression
algorithms. Most of the logic is in bison.y and cm.cu files.
I test most of the queries on a scale 100 (100GB of data).
Regards,
Anton
On Wed, Mar 20, 2013 at 10:43 AM, sam1988 [email protected] wrote:
hi anton, i'm a freshman studying in gpu, and recently i'm looking into
your project, it's impressed me a lot, but it makes me hard to understand
your project because lack of documents except manual file. if you have some
detail documents,please send me,thank you. and also what kind of IDE when
you doing this project?my email: [email protected]
—
Reply to this email directly or view it on GitHubhttps://github.com//issues/5
.
from alenka.
100G?wow! but it seems that it store the origin related data in a binary file and then compress(using pfor and dictionary ) and then doing the filter or some other operation on gpu by transfer the compressed data to gpu. and is the compressed data enough small to alloc it on gpu?(because gpu memory is limited) or am i thinking wrong?
sorry to bother you
from alenka.
Alenka stores data in segments small enough to fit GPU memory. Data are processed segment by segment, the totals are calculated in the end.
from alenka.
i see, have you ever compare the query performs to some other on columnar databases like monetdb or c-store or some other mature database?
from alenka.
Yes, I compared Alenka against a few other databases using TPC-H tests:
http://www.tpc.org/tpch/results/tpch_perf_results.asp?resulttype=noncluster
For example, Query1 on a 100 GB dataset runs 11 seconds on GTX580. You can compare it with other results using the link.
from alenka.
Related Issues (20)
- Device Errors HOT 5
- Loading error HOT 2
- Alenka unable to find a table HOT 1
- trivial_copy_n: an illegal memory access was encountered HOT 14
- Project license? HOT 2
- What is the syntax for appending data into a table? HOT 1
- Data partitioning architecture HOT 12
- OpenCL port HOT 4
- Compilation on Windows HOT 2
- Generic Interface for Storage Behavior Layout HOT 1
- Compilation time very long HOT 4
- Benchmarking HOT 3
- License? HOT 1
- Compile problem for strings_sort_device.cu HOT 4
- Is this project live? HOT 1
- Out of memory error HOT 3
- Compile problem HOT 1
- Hardware spec HOT 4
- Case sensitive columns HOT 1
- mgpu::cuda_exception_t "Invalid device function" exception HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from alenka.