Giter VIP home page Giter VIP logo

webankfintech / scriptis Goto Github PK

View Code? Open in Web Editor NEW
804.0 74.0 266.0 51.55 MB

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

License: Apache License 2.0

JavaScript 40.15% HTML 0.05% Vue 51.88% Shell 0.46% Sass 0.61% SCSS 6.86%
hue zeppelin spark hive sql pyspark scala ide hql hive-table

scriptis's Introduction

Scriptis

License

English | Chinese

!This project has been merged into DataSphereStudio

Introduction

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

running

Features

  • Script editor: Support multi-language, auto-completion, syntax highlighting and SQL syntax error-correction.

  • Computation engines: Based on Linkis, Scriptis connects with multiple computation engines such as Spark, Hive, Python, etc.

  • Runtime functionality: Complete job life cycle display and intelligent diagnosis.

  • Result set: Multiple result sets support, customized result set alias and one-click visualization.

  • Database Services: Functionalities for database management and files(CVS, Excel) import/export to/from tables.

  • Context: UDFs, custom variables and functions management and sharing.

  • Console: Customized settings for engine parameters, task/engine management and resource isolation/display.

QuickStart

Read the Quick Start Quick Start

Comparison with similar scheduler systems

Comparison

Documentations

Quick Start

Quick Use

User Manual

Compilation

Community

If you desire immediate response, please kindly raise issues to us or scan the below QR code by WeChat and QQ to join our group:

WeChatQQ

License

Scriptis is under the Apache 2.0 license. See the LICENSE file for details

scriptis's People

Contributors

allwefantasy avatar demonray avatar leeebai avatar mounthuang avatar ooooowenxu avatar peacewong avatar sargentti avatar wanchun avatar webankadmin avatar wushengyeyouya avatar xtt55 avatar yangzhiyue avatar zwx-master avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

scriptis's Issues

代码补全失效

代码补全失效,打日志的时候,provideCompletionItems函数有被触发,但是返回数据后,并没有触发代码补全的提示。想问下有哪些情况是导致代码提示无法显示

做Doris映射表查询,bigint 类型和datetime类型在dss环境查不出来,会报错

报错详情如下:
ERROR[Linkis-Default-Scheduler-Thread-11]org.apache,linkis,engineconnplugin,flink,executor,FlinkS0LComputationExecutor 214 $anonfun$toExecuteTasks9[JobId-410] - execute code failed!

org;apache,linkis,engineconnplupin,flink,client,shims,exception,SglExecutionException: err(ode: 16022 ,desc:Could not create a table from statement: create table dorisTable01(

【需求】开发任务多版本支持

问题描述:
目前Scriptis只针对已经运行的任务才记录运行时刻对应的脚本内容,多版本支持比较弱。需要能够支持。

期待解决方案:

  • 支持多版本
  • 如果能够跟Github打通就更完美了

【需求】暗黑系皮肤的支持

问题描述:
目前Scriptis开发IDE全部是白底,对数据开发同学长时间开发而言容易造成视野疲劳,如果能够支持暗黑系皮肤,并能让开发自己选择切换更好。

期待解决方案:
支持多套开发IDE皮肤,最好是能同时支持白底、暗黑系皮肤,供数据开发自己选择切换最佳。

未请求到根目录

登录Scriptis后,点击”工作空间“,界面提示 "未请求到工作空间根目录,请刷新重试"。点击”HDFS“,提示”未请求到HDFS根目录,请刷新重试“。

页面初始化后,双击左侧与右侧间的拖拽线,会导致右边栏空白

image
如图,页面初始化后,双击左侧与右侧间的拖拽线,会导致右边栏空白;
经过查找,是因为src\js\component\panel\panel.vue组件中,currentChange没有设置在data中。双击的时候,没有经过move事件,会导致currentChange获取到的值为undefined和null。
解决办法:在data中设置currentChange为0就可以了。
currentChange: 0,

Hello,Can linkis support the jdbc engine?

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

flink1.16.2引擎下做kafka的映射表报错

flink引擎下做kafka的映射表,select kafka映射表的时候,出现ClassNotFound Exception报错
报错详情:task is Failed,errorMsg: ClassCastException:org.apache.kafka.clients.consumer.OffsetResetStrategy

npm run serve 无法启动

前端 ./src/js/component/table/table.vue

<style lang="sass" src="./index.scss"></style> 需要修改为 scss 否则无法启动

本地运行项目联调跨域的问题

每次本地开发联调的时候需要启动浏览器的跨域模式,不太方便;而且websocke跨域模式下也无法访问。建议用代理的方式优化开发联调体验

Who is using Scriptis

Who is using Scriptis

We’d like to thank everyone in this community for your constant support of Scriptis and Linkis. We’re confident that, with our effort and your support, this community could grow more prosperous and serve a greater number of users.

Our Intentions

  1. Scriptis cannot grow without the voice from the community.
  2. Scriptis desires more contributions from more partners.
  3. Scriptis provides a series of enterprise level features. We hope to get closer to the practical scenarios to plan the roadmap for future releases of Scriptis.

Our Expectation

We would appreciate it if you could leave us a comment with the following information:

  • Your company, colleage or any other organizations
  • Your city & nation
  • Your contact infomation: Weibo, email or WeChat
  • Your practical business scenarios

Sample:

  • Organization:Webank
  • Location:Shenzhen, China
  • Contact information:[email protected]
  • Business scenario:for interactive data analysis with script development(SQL, Pyspark, HiveQL).

Thanks again!!!
Your support is the biggest motivator for facilitating the progress of open-sourcing the Scriptis!

Yours sincerely,
Scriptis Team


谁在使用Scriptis

感谢社区每一位关注并使用Scriptis的伙伴。我们会持续投入,争取将Scriptis社区和生态打造的更加繁荣,让更多伙伴从Scriptis中受益。

此Issue初衷

  1. Scriptis的成长,离不开社区的声音
  2. Scriptis需要更多伙伴参与进来一起贡献
  3. Scriptis提供了非常多的企业级特性,我们希望了解大家的实际应用场景,以便规划Scriptis的后续版本

期待

期望您提交一条评论, 内容包括:

  • 您所在公司、学校或组织
  • 您所在的国家和城市
  • 您的联系方式: 微博、邮箱或微信
  • 您的实际业务场景

示例:

  • 公司:微众银行
  • 地点:**深圳
  • 联系方式:[email protected]
  • 业务场景:作为数据分析工具

再次感谢!!!
您的支持是Scriptis开源前进的最大动力!!

Scriptis团队拜上

Failed to resolve async component:

[Vue warn]: Failed to resolve async component: function component() {
return Promise.all(/*! import() /[webpack_require.e(1), webpack_require.e(0), webpack_require.e(10)]).then(webpack_require.bind(null, /! ./container.vue */ "./src/js/module/workbench/container.vue"));
}
Reason: TypeError: Cannot read property 'Vue' of undefined

【需求】Scriptis在库表管理中缺失了导出数据表的功能

问题描述:
目前开源版本Scriptis的缺失了对库表数据导出为csv/txt的功能;对探索之后的数据缺少了行列转换的功能

期待解决方案:
方便快捷的导出数据可以在线下对数据进行探索分析,行列转换功能可以用另外一种视角方便的查看探索之后的结果

timeoutException

使用 hadoop/hadoop登录scriptis,除了开发,管理台按钮。界面一片空白
20191021231344

scriptis register udf,udf jar name check rule bug

问题描述:
目前Scriptis在注册udf的时候,对udf jar包路径校验错误。jar名称符合了“后缀名只支持jar,且jar包名仅支持英文,数字,下划线!”。但是注册时校验依旧不通过

问题分析:jar包名称是符合校验规则的,jar包所在的路径中有个‘-’。路径校验规则bug
register_udf

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.