data in spider format about text2sql-data HOT 2 CLOSED

@mousaazari Just saw you closed this. Were you able to do the conversion / construction? If so, I'd be glad to incorporate it into the repository.

Sorry for not responding sooner!

from text2sql-data.

After analyzing the related files, I figured out that there are similar datasets in the spider. There is a slight difference in the total number of instances, which was negligible in my case. So we can extract the required information from the JSON files. I used the following script to extract the IMDB subset from the spider dataset:

import pickle, json

dataset_name = 'imdb'
dataset = json.load(open('spider.json', 'r'))
new_dataset = []
for entry in dataset:
    if(entry['db_id'] in (dataset_name)):
        new_dataset.append(entry)

with open(dataset_name + '.json', 'w') as outfile:
        json.dump(new_dataset, outfile, indent=4)

Thank you for all the helpful information in this repo.

from text2sql-data.