The LDBC benchmark data sets are stored under SURF's CWI repositories.
๐ก The LDBC SNB Business Intelligence (BI) workload's data sets are stored in Cloudflare R2. See the links to the BI data sets.
๐ก The LDBC SNB Interactive v2 workload's data sets are stored in Cloudflare R2. See the links to the Interactive v2 data sets and update streams.
The data sets are stored on tape, therefore, you may have to stage them before they can be downloaded. To do so, visit the repository of the data set and click "Request" for offline files. Staging a 20 GB file takes approx. 3-5 minutes, while staging a 200 GB one takes approx. 10-15 minutes.
To decompress, use curl and zstd.
curl --silent --fail set_url_here | tar -xv --use-compress-program=unzstd
We provide the download-data-set.sh
script, which attempts to download the data set and stages it to disk if necessary. Replace the data_set_url
with one of the URLs linked below in this README (right click and select Copy Link Address).
./download-data-set.sh data_set_url
Example:
./download-data-set.sh https://repository.surfsara.nl/datasets/cwi/snb/files/social_network-csv_basic-longdateformatter/social_network-csv_basic-longdateformatter-sf0.1.tar.zst
These data sets were incorrectly generated, see the related issue, hence we removed their links. The correctly generated data sets will be deployed in the autumn of 2022.
social_network-csv_basic-sf0.1.tar.zst
social_network-csv_basic-sf0.3.tar.zst
social_network-csv_basic-sf1.tar.zst
social_network-csv_basic-sf3.tar.zst
social_network-csv_basic-sf10.tar.zst
social_network-csv_basic-sf30.tar.zst
social_network-csv_basic-sf100.tar.zst
social_network-csv_basic-sf300.tar.zst
social_network-csv_basic-sf1000.tar.zst
These data sets were correctly generated unlike the other data sets using the LongDateFormatter
. Feel free to use them.
social_network-csv_composite-longdateformatter-sf0.1.tar.zst
social_network-csv_composite-longdateformatter-sf0.3.tar.zst
social_network-csv_composite-longdateformatter-sf1.tar.zst
social_network-csv_composite-longdateformatter-sf3.tar.zst
social_network-csv_composite-longdateformatter-sf10.tar.zst
social_network-csv_composite-longdateformatter-sf30.tar.zst
social_network-csv_composite-longdateformatter-sf100.tar.zst
social_network-csv_composite-longdateformatter-sf300.tar.zst
social_network-csv_composite-longdateformatter-sf1000.tar.zst
social_network-csv_composite-sf0.1.tar.zst
social_network-csv_composite-sf0.3.tar.zst
social_network-csv_composite-sf1.tar.zst
social_network-csv_composite-sf3.tar.zst
social_network-csv_composite-sf10.tar.zst
social_network-csv_composite-sf30.tar.zst
social_network-csv_composite-sf100.tar.zst
social_network-csv_composite-sf300.tar.zst
social_network-csv_composite-sf1000.tar.zst
These data sets were incorrectly generated, see the related issue, hence we removed their links. The correctly generated data sets will be deployed in the autumn of 2022.
social_network-csv_composite_merge_foreign-sf0.1.tar.zst
social_network-csv_composite_merge_foreign-sf0.3.tar.zst
social_network-csv_composite_merge_foreign-sf1.tar.zst
social_network-csv_composite_merge_foreign-sf3.tar.zst
social_network-csv_composite_merge_foreign-sf10.tar.zst
social_network-csv_composite_merge_foreign-sf30.tar.zst
social_network-csv_composite_merge_foreign-sf100.tar.zst
social_network-csv_composite_merge_foreign-sf300.tar.zst
social_network-csv_composite_merge_foreign-sf1000.tar.zst
These data sets were incorrectly generated, see the related issue, hence we removed their links. The correctly generated data sets will be deployed in the autumn of 2022.
social_network-csv_merge_foreign-sf0.1.tar.zst
social_network-csv_merge_foreign-sf0.3.tar.zst
social_network-csv_merge_foreign-sf1.tar.zst
social_network-csv_merge_foreign-sf3.tar.zst
social_network-csv_merge_foreign-sf10.tar.zst
social_network-csv_merge_foreign-sf30.tar.zst
social_network-csv_merge_foreign-sf100.tar.zst
social_network-csv_merge_foreign-sf300.tar.zst
social_network-csv_merge_foreign-sf1000.tar.zst
social_network_ttl_sf0.1.tar.zst
social_network_ttl_sf0.3.tar.zst
social_network_ttl_sf1.tar.zst
social_network_ttl_sf3.tar.zst
social_network_ttl_sf10.tar.zst
social_network_ttl_sf30.tar.zst
social_network_ttl_sf100.tar.zst
social_network_ttl_sf300.tar.zst
social_network_ttl_sf1000.tar.zst
All: substitution_parameters.tar.zst
substitution_parameters-sf0.1.tar.zst
substitution_parameters-sf0.3.tar.zst
substitution_parameters-sf1.tar.zst
substitution_parameters-sf3.tar.zst
substitution_parameters-sf10.tar.zst
substitution_parameters-sf30.tar.zst
substitution_parameters-sf100.tar.zst
substitution_parameters-sf300.tar.zst
substitution_parameters-sf1000.tar.zst
social_network-sf0.1-numpart-1.tar.zst
social_network-sf0.1-numpart-2.tar.zst
social_network-sf0.1-numpart-4.tar.zst
social_network-sf0.1-numpart-8.tar.zst
social_network-sf0.1-numpart-16.tar.zst
social_network-sf0.1-numpart-24.tar.zst
social_network-sf0.1-numpart-32.tar.zst
social_network-sf0.1-numpart-48.tar.zst
social_network-sf0.1-numpart-64.tar.zst
social_network-sf0.1-numpart-96.tar.zst
social_network-sf0.1-numpart-128.tar.zst
social_network-sf0.1-numpart-192.tar.zst
social_network-sf0.1-numpart-256.tar.zst
social_network-sf0.1-numpart-384.tar.zst
social_network-sf0.1-numpart-512.tar.zst
social_network-sf0.1-numpart-768.tar.zst
social_network-sf0.1-numpart-1024.tar.zst
social_network-sf0.3-numpart-1.tar.zst
social_network-sf0.3-numpart-2.tar.zst
social_network-sf0.3-numpart-4.tar.zst
social_network-sf0.3-numpart-8.tar.zst
social_network-sf0.3-numpart-16.tar.zst
social_network-sf0.3-numpart-24.tar.zst
social_network-sf0.3-numpart-32.tar.zst
social_network-sf0.3-numpart-48.tar.zst
social_network-sf0.3-numpart-64.tar.zst
social_network-sf0.3-numpart-96.tar.zst
social_network-sf0.3-numpart-128.tar.zst
social_network-sf0.3-numpart-192.tar.zst
social_network-sf0.3-numpart-256.tar.zst
social_network-sf0.3-numpart-384.tar.zst
social_network-sf0.3-numpart-512.tar.zst
social_network-sf0.3-numpart-768.tar.zst
social_network-sf0.3-numpart-1024.tar.zst
social_network-sf1-numpart-1.tar.zst
social_network-sf1-numpart-2.tar.zst
social_network-sf1-numpart-4.tar.zst
social_network-sf1-numpart-8.tar.zst
social_network-sf1-numpart-16.tar.zst
social_network-sf1-numpart-24.tar.zst
social_network-sf1-numpart-32.tar.zst
social_network-sf1-numpart-48.tar.zst
social_network-sf1-numpart-64.tar.zst
social_network-sf1-numpart-96.tar.zst
social_network-sf1-numpart-128.tar.zst
social_network-sf1-numpart-192.tar.zst
social_network-sf1-numpart-256.tar.zst
social_network-sf1-numpart-384.tar.zst
social_network-sf1-numpart-512.tar.zst
social_network-sf1-numpart-768.tar.zst
social_network-sf1-numpart-1024.tar.zst
social_network-sf3-numpart-1.tar.zst
social_network-sf3-numpart-2.tar.zst
social_network-sf3-numpart-4.tar.zst
social_network-sf3-numpart-8.tar.zst
social_network-sf3-numpart-16.tar.zst
social_network-sf3-numpart-24.tar.zst
social_network-sf3-numpart-32.tar.zst
social_network-sf3-numpart-48.tar.zst
social_network-sf3-numpart-64.tar.zst
social_network-sf3-numpart-96.tar.zst
social_network-sf3-numpart-128.tar.zst
social_network-sf3-numpart-192.tar.zst
social_network-sf3-numpart-256.tar.zst
social_network-sf3-numpart-384.tar.zst
social_network-sf3-numpart-512.tar.zst
social_network-sf3-numpart-768.tar.zst
social_network-sf3-numpart-1024.tar.zst
social_network-sf10-numpart-1.tar.zst
social_network-sf10-numpart-2.tar.zst
social_network-sf10-numpart-4.tar.zst
social_network-sf10-numpart-8.tar.zst
social_network-sf10-numpart-16.tar.zst
social_network-sf10-numpart-24.tar.zst
social_network-sf10-numpart-32.tar.zst
social_network-sf10-numpart-48.tar.zst
social_network-sf10-numpart-64.tar.zst
social_network-sf10-numpart-96.tar.zst
social_network-sf10-numpart-128.tar.zst
social_network-sf10-numpart-192.tar.zst
social_network-sf10-numpart-256.tar.zst
social_network-sf10-numpart-384.tar.zst
social_network-sf10-numpart-512.tar.zst
social_network-sf10-numpart-768.tar.zst
social_network-sf10-numpart-1024.tar.zst
social_network-sf30-numpart-1.tar.zst
social_network-sf30-numpart-2.tar.zst
social_network-sf30-numpart-4.tar.zst
social_network-sf30-numpart-8.tar.zst
social_network-sf30-numpart-16.tar.zst
social_network-sf30-numpart-24.tar.zst
social_network-sf30-numpart-32.tar.zst
social_network-sf30-numpart-48.tar.zst
social_network-sf30-numpart-64.tar.zst
social_network-sf30-numpart-96.tar.zst
social_network-sf30-numpart-128.tar.zst
social_network-sf30-numpart-192.tar.zst
social_network-sf30-numpart-256.tar.zst
social_network-sf30-numpart-384.tar.zst
social_network-sf30-numpart-512.tar.zst
social_network-sf30-numpart-768.tar.zst
social_network-sf30-numpart-1024.tar.zst
social_network-sf100-numpart-1.tar.zst
social_network-sf100-numpart-2.tar.zst
social_network-sf100-numpart-4.tar.zst
social_network-sf100-numpart-8.tar.zst
social_network-sf100-numpart-16.tar.zst
social_network-sf100-numpart-24.tar.zst
social_network-sf100-numpart-32.tar.zst
social_network-sf100-numpart-48.tar.zst
social_network-sf100-numpart-64.tar.zst
social_network-sf100-numpart-96.tar.zst
social_network-sf100-numpart-128.tar.zst
social_network-sf100-numpart-192.tar.zst
social_network-sf100-numpart-256.tar.zst
social_network-sf100-numpart-384.tar.zst
social_network-sf100-numpart-512.tar.zst
social_network-sf100-numpart-768.tar.zst
social_network-sf100-numpart-1024.tar.zst
social_network-sf300-numpart-1.tar.zst
social_network-sf300-numpart-2.tar.zst
social_network-sf300-numpart-4.tar.zst
social_network-sf300-numpart-8.tar.zst
social_network-sf300-numpart-16.tar.zst
social_network-sf300-numpart-24.tar.zst
social_network-sf300-numpart-32.tar.zst
social_network-sf300-numpart-48.tar.zst
social_network-sf300-numpart-64.tar.zst
social_network-sf300-numpart-96.tar.zst
social_network-sf300-numpart-128.tar.zst
social_network-sf300-numpart-192.tar.zst
social_network-sf300-numpart-256.tar.zst
social_network-sf300-numpart-384.tar.zst
social_network-sf300-numpart-512.tar.zst
social_network-sf300-numpart-768.tar.zst
social_network-sf300-numpart-1024.tar.zst
social_network-sf1000-numpart-1.tar.zst
social_network-sf1000-numpart-2.tar.zst
social_network-sf1000-numpart-4.tar.zst
social_network-sf1000-numpart-8.tar.zst
social_network-sf1000-numpart-16.tar.zst
social_network-sf1000-numpart-24.tar.zst
social_network-sf1000-numpart-32.tar.zst
social_network-sf1000-numpart-48.tar.zst
social_network-sf1000-numpart-64.tar.zst
social_network-sf1000-numpart-96.tar.zst
social_network-sf1000-numpart-128.tar.zst
social_network-sf1000-numpart-192.tar.zst
social_network-sf1000-numpart-256.tar.zst
social_network-sf1000-numpart-384.tar.zst
social_network-sf1000-numpart-512.tar.zst
social_network-sf1000-numpart-768.tar.zst
social_network-sf1000-numpart-1024.tar.zst
lsqb-merged/social-network-sf0.1-merged-fk.tar.zst
lsqb-merged/social-network-sf0.3-merged-fk.tar.zst
lsqb-merged/social-network-sf1-merged-fk.tar.zst
lsqb-merged/social-network-sf3-merged-fk.tar.zst
lsqb-merged/social-network-sf10-merged-fk.tar.zst
lsqb-merged/social-network-sf30-merged-fk.tar.zst
lsqb-merged/social-network-sf100-merged-fk.tar.zst
lsqb-merged/social-network-sf300-merged-fk.tar.zst
lsqb-merged/social-network-sf1000-merged-fk.tar.zst
lsqb-projected/social-network-sf0.1-projected-fk.tar.zst
lsqb-projected/social-network-sf0.3-projected-fk.tar.zst
lsqb-projected/social-network-sf1-projected-fk.tar.zst
lsqb-projected/social-network-sf3-projected-fk.tar.zst
lsqb-projected/social-network-sf10-projected-fk.tar.zst
lsqb-projected/social-network-sf30-projected-fk.tar.zst
lsqb-projected/social-network-sf100-projected-fk.tar.zst
lsqb-projected/social-network-sf300-projected-fk.tar.zst
lsqb-projected/social-network-sf1000-projected-fk.tar.zst
TBA