MaxCompute Spark
本文档帮助快速构建可以运行在MaxCompute Spark上的应用，并提供相关API的使用Demo. 参考文档
aliyun / maxcompute-spark Goto Github PK
View Code? Open in Web Editor NEWMaxCompute spark demo for building a runnable application.
License: Apache License 2.0
maxcompute-spark's Introduction
maxcompute-spark's People
Contributors
Stargazers
Watchers
Forkers
kqsmea8 p79n6a xumeng914 zhousteven gtxinyi codemonkey-aaron wangchenkang josephjdfung xiaoholy simonshiwt a14772586233 haiming2019 zxyscz jnadorg 631591678 liuyong19892 wjianlin csyjx lzzc-ape qikanghu yq-shang china-bear shihunzunzhe yabaoya lebron666 saaassfgcqbx dpcc2017 ahnqirage zhouxinfei hearmit14 gshf qiqihaer1 spoon94 shujiewu zzzheep lixiaofengch benben2022 skkk2288 yanghong chujiezhou style-ma ch2go woruoweikunlun shunzizi chenshuai1981 yuanshuaigit dujiaoshoushou web-logs2 dorbodwolf banyc1989maxcompute-spark's Issues
拜托 给的Demo 得能运行吧
🤷♂️ 请问你们的代码有测试过吗？一大堆问题😤
解决步骤：
1- 注释掉所有scope 标签；
2- 添加依赖：
<!-- https://mvnrepository.com/artifact/org.scala-lang.modules/scala-xml -->
<dependency>
<groupId>org.scala-lang.modules</groupId>
<artifactId>scala-xml_2.11</artifactId>
<version>1.0.5</version>
</dependency>
3- .master("local[*]")
否则你有处理不完的错误。。。。🤔
想请问maxcompute-spark支持pyspark任务的提交吗
Spark 3.x 提交 PySpark 代码
请问 Spark 3.x 提交 PySpark 代码有文档么，这里的文档和官网的文档要么没有 Spark 3.x, 要么没有提交 PySpark 的例子。在很多方面，比如配置文件和提交方式，面对 Spark 3.x 都写的比较混乱，让人摸不着头脑。我想知道 Spark 3.x 提交 PySpark 代码，具体有几种方式，分别是什么，最好有清晰的文档，谢谢
强烈建议lightGBM
强烈建议lightGBM
需要用到如下的包
lightgbm
eli5
catboost
spark 相关的类jar在哪里下载
这里面两个类在那个jar中？ 在哪里下载
.config("spark.sql.catalog.odps", "org.apache.spark.sql.execution.datasources.v2.odps.OdpsTableCatalog")
.config("spark.sql.extensions", "org.apache.spark.sql.execution.datasources.v2.odps.extension.OdpsExtensions")
spark 2.3分支的包还有更新么，其他版本的有么
spark 2.3.x最新分支版本2.3.4；
spark 2.4.x最新分支版本2.4.5；
新版本有没有支持，这几个帮助页面提供的spark版本有点老了。
https://developer.aliyun.com/article/728374?spm=a2c6h.12873581.0.0.12d9187aXmBwN0
和
https://github.com/aliyun/aliyun-cupid-sdk/#5.3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.