The cloud-native-batch from baobao211195

cloud-native-batch's Introduction

Configure the Spring Cloud Config Server with an application.properties or application.yml in batch-job/src/main/resources with the following properties configured:
- spring.datasource.driverClassName
- spring.datasource.url
- spring.datasource.username
- spring.datasource.password
- spring.datasource.schema - this should point to the schema-mysql.sql in the same directory
- job.resource-path - this should be the S3 bucket
- cloud.aws.credentials.accessKey
- cloud.aws.credentials.secretKey
- cloud.aws.region.static - the region the S3 bucket exists in
- cloud.aws.region.auto - this should be false unless you are running this on AWS
Launch the Config server & eureka via spring cloud configserver eureka
Build the project from the root via ./mvnw clean install
Launch Skipper via:

java -jar bin/spring-cloud-skipper-server-2.0.0.RELEASE.jar \
    --spring.datasource.url=jdbc:mysql://localhost:3306/cloud_native_batch \
    --spring.datasource.username=root \
    --spring.datasource.password=p@ssw0rd \
    --spring.datasource.driver-class-name=org.mariadb.jdbc.Driver

Launch Spring Cloud Data Flow (SCDF) via:

java -jar bin/spring-cloud-dataflow-server-2.0.1.RELEASE.jar \
    --spring.datasource.url=jdbc:mysql://localhost:3306/cloud_native_batch \
    --spring.datasource.username=root \
    --spring.datasource.password=p@ssw0rd \
    --spring.datasource.driver-class-name=org.mariadb.jdbc.Driver

Launch Spring Cloud Data Flow Shell via java -jar bin/spring-cloud-dataflow-shell-2.0.1.RELEASE.jar
Register the app with SCDF in the shell via app register --name S3JDBC --type task --uri "maven://io.spring.cloud-native-batch:batch-job:0.0.1-SNAPSHOT"
Launch the UI from http://localhost:9393/dashboard
Launch the task via the UI
Verify results via the query select * from cloud_native_batch.foo; assuming your schema is called cloud_native_batch

Recommend Projects