Giter VIP home page Giter VIP logo

tabular-data-viewer's Introduction

tabular-data-viewer

Apache-2.0 License Version Installs Downloads https://ko-fi.com/dataPixy


Tabular Data Viewer δΈ­ for Visual Studio Code

See Data Preview 🈸 vscode extension for advanced Grid Data Viewer with many common data formats support, search, sort, filters, grouping, splits, pivot tables, aggregates and basic charts πŸ“Š.

Tabular Data Viewer δΈ­

Tabular Data Viewer provides fast DSV data loading and custom Table View πŸ€„ display for very large (1-8 GB) .csv, .tsv and .tab data files via table and Papa Parse CSV parser with NodeJS File Streams and Worker threads:

Tabular Data View δΈ­

Features

  • View large CSV and TSV data files in a custom Tabulator Table View πŸ€„
  • Open Data File Table View πŸ€„ via quick file path input prompt
  • Load large datasets with millions of rows and over 1GB of tabular data using Papa Parse CSV parser in a worker thread with data streaming and incremental loading into Table View πŸ€„
  • View data loading progress, file size, colulmns, rows and load time stats display in vscode status bar
  • Sort displayed table data by multiple columns
  • Resize table columns
  • Rearrange table columns and rows
  • Hide, freeze, or delete table columns
  • Freeze or delete table rows
  • Select table rows column
  • Persist table columns layout and sort order
  • Restore customized table columns and sort configuration on vscode reload
  • Copy tab delimited table data to Clipboard
  • Save displayed table data in CSV (, or ; delimited), TSV, HTML table, or JSON data array format
  • Generate and view Frictionless Table *.schema.json configration file created with tableschema-js.infer()
  • Load saved table configuration options from auto-generated *.table.json config file when reopening previously customized Table View πŸ€„
  • Set default Data Page Size to 1K, 10K, or 100K (default) rows per page via standard vscode Preferences -> Settings -> Extensions -> Tabular Data Viewer configuration options to speed up large datasets parsing and loading into Table View πŸ€„

...

Limitations

Large CSV data files streaming and display is very alpha and has the following limitations for now:

  • Large datasets are paged and loaded into view for display with default page size set to 100K rows per page
  • Columns sort only works for the paged data loaded and displayed in Table View πŸ€„ and doesn't sort data for the whole dataset
  • Save data uses Tabulator Download Table Data feature and is also limited to max 100k rows for the currently displayed tabular data in Table View πŸ€„

Tabular Data View δΈ­ Large Dataset

Contributions

Tabular Data Viewer δΈ­ Settings, Commands, Languages, Custom Editors and Activation Events contributed to VSCode IDE:

Tabular Data Viewer δΈ­ Feature Contributions

Settings

Create User or Workspace Settings in vscode to change Tabular Data Viewer δΈ­ extension Settings:

Setting Type Default Value Description
tabular.data.pageSize integer 100000 Default Data Page Size to use for incremental loading and display of large datasets.
tabular.data.parser.dynamicTyping boolean true Enable type conversions for numeric and boolean data fields when parsing CSV data. Set this option to false to speed up large datasets parsing and loading.
tabular.data.createTableSchemaConfig boolean true Create table *.schema.json configuration file alongside data file when parsing CSV data.
tabular.data.createTableViewConfig boolean true Create *.table.json configuration file alongside data file for saving and restoring customized Table View πŸ€„ columns and sort settings.

You can view Tabular Data Viewer δΈ­ Configuration Settings via standard vscode Preferences -> Settings -> Extensions -> Tabular Data Viewer Settings view or use custom Tabular Data: View Settings command from View -> Command Palette... menu prompt by typing Tabular in it. Hit Reload β†Ί button in open Table View πŸ€„ after you toggle Tabular Data Settings to activate your configuration changes for an open table view.

Tabular Data Viewer δΈ­ Configuration Settings

Observable JS Notebook

You can try Tabular Data Viewer πŸ€„ Observable Notebook πŸ““ with public datasets and supported data formats in a browser:

Tabular Data Viewer δΈ­ Observable Notebook πŸ““

Recommended Extensions

Recommended custom dataViz extensions produced by Random Fractals Inc. and other 3rd party vscode extension devs for working with data 🈸 charts πŸ“ˆ geo πŸ—ΊοΈ data formats and Interactive Notebooks πŸ“š in VSCode:

Extension Description
Rainbow CSV 🌈 Highlight CSV and TSV files, Run SQL-like queries
Data Preview 🈸 Data Preview 🈸 extension for importing πŸ“€ viewing πŸ”Ž slicing πŸ”ͺ dicing 🎲 charting πŸ“Š & exporting πŸ“₯ large JSON array/config, YAML, Apache Arrow, Avro & Excel data files
Geo Data Viewer πŸ—ΊοΈ kepler.gl Geo Data Analytics tool to gen. some snazzy πŸ—ΊοΈs w/0 Py 🐍 pyWidgets βš™οΈ pandas 🐼 or react βš›οΈ
Vega Viewer πŸ“ˆ Provides Interactive Preview of Vega & Vega-Lite maps πŸ—ΊοΈ & graphs πŸ“ˆ
Observable JS Observable JS compiler with Observable js and md code outline and previews.
JS Notebook πŸ““ Inspector πŸ•΅οΈ Provides Interactive Preview of Observable JS Notebooks πŸ“š, Notebook πŸ““ nodes βŽ‡ & cells βŒ— source code
Data Table 🈸 Data Table 🈸 renderer for Notebook πŸ““ cell βŒ— data outputs
Leaflet Map 🌿 πŸ—ΊοΈ Leaflet Map πŸ—ΊοΈ for Notebook πŸ““ cell βŒ— data outputs

Dev Log

See #TabularDataViewer πŸ€„ tag on Twitter for the latest and greatest updates on this vscode extension and what's in store next.

Dev Build

$ git clone https://github.com/RandomFractals/tabular-data-viewer
$ cd tabular-data-viewer
$ npm install
$ npm run compile
$ code .

Press F5 to launch Tabular Data Viewer πŸ€„ extension debug session, or run the following command to generate tabular-data-viewer-x.x.x.vsix package with vsce from our latest for local dev install from .vsix in vscode.

tabular-data-viewer>vsce package

Contributing

Any and all test, code or feedback contributions are welcome. Open an issue or submit a pull request to make this Tabular Data Viewer πŸ€„ extension work better for all.

Backers

support me on ko-fi.com

tabular-data-viewer's People

Contributors

randomfractals avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.