spring-cloud / spring-cloud-stream-samples Goto Github PK

Samples for Spring Cloud Stream

License: Apache License 2.0

Java 94.27% Kotlin 5.52% CSS 0.06% HTML 0.15%

spring-cloud-stream-samples's Introduction

Spring Cloud Stream Sample Applications

This repository contains a collection of applications written using Spring Cloud Stream. All the applications are self-contained. They can be run against either Kafka or RabbitMQ middleware technologies. You have the option of running the samples against local or Docker containerized versions of Kafka and Rabbit.

You can build the entire samples by going to the root of the repository and then execute: ./mvnw clean package.

However, the recommended approach to build them is to pick the sample that you are interested in and go to that particular app and follow the instructions there in the README for that app.

Provided Sample Applications

Below, you can find the list of all the provided sample applications.

Confluent Schema Registry Integration

This set of sample applications show how Spring Cloud Stream Kafka applications integrate with Confluent Schema Registry. You can find more details at README.

Spring Cloud Stream Schema Registry Integration

These samples show how Spring Cloud Stream Schema Registry can help with schema evolution use cases. More details are available at README.

Batch Producer Consumer

This sample app shows how to write batch consumers and producers using spring Cloud Stream and Apache Kafka. More details are at README.

Kafka Binder Native App

This sample shows how to run the same Spring Cloud Stream Kafka based application on the normal JVM, AOT-only mode on the JVM and finally, natively on graalvm. For more information, please see README.

spring-cloud-stream-samples's People

Contributors

Stargazers

Watchers

Forkers

mbogoevici ilayaperumalg felipeg48 viniciusccarvalho markfisher garyrussell sdeleuze markpollack mage234 ashraf-revo cppwfs tspannhw vstars thomasdarimont badalb colrich epiphyllum wanghy6503 novicelayman gspear yansongfu vivek114 hongyang070 cl151 sokie weifwstudy yangminglis scambam1 aliesystems seethasp jonathanborenstein rongfengliang drkchoudary billho lanxy88 naheedmk nikhilkumarbhagat ursmfamily jannikweichert khoe1991 rajashekar2014 importsource dsi-tecnocampus chinatelecomit said66 chenlxspace weblabt1-16 victortianpei zgf123456 vsmolik tagama baixiangyang xxxwei will-zhang-1981 praveens9 mnenad pruv vietkhuong lethetann appseamr ivartanian jmpcn sobychacko narayanasamy-ashok muthhus dgolcher mengxianchuang jforkyao gnahsz grayoxygen borgio oatesp javalai artembilan fengzhisheng dturanski cook853 garyfub usha1234567 jhines2k7 mustang2247 xwolf-wang imravichaudhary pradeepadi88 dodalovic zhaoshaoquan rcollette sabbyanandan zgzwelldone zukobronja zhoudaifa007 bala-ideas2it lenaluo dalakov omerholz arturskk kuylim dhpandey ajayk russellchang54

spring-cloud-stream-samples's Issues

getting NoClassDefFoundError: org/springframework/tuple/spel/Tuple PropertyAccessor while trying to run kinesis-produce-consume application

Hi Team,

I am trying to run kinesis-produce-consume application by following steps mentioned in README file, I am getting below error

2018-02-11 17:51:36.882 WARN 6504 --- [ main] ationConfigEmbeddedWebA
pplicationContext : Exception encountered during context initialization - cancel
ling refresh attempt: org.springframework.beans.factory.BeanCreationException: E
rror creating bean with name 'propertyAccessorBeanPostProcessor' defined in clas
s path resource [org/springframework/cloud/stream/config/BindingServiceConfigura
tion$PostProcessorConfiguration.class]: Bean instantiation via factory method fa
iled; nested exception is org.springframework.beans.BeanInstantiationException:
Failed to instantiate [org.springframework.beans.factory.config.BeanPostProcesso
r]: Factory method 'propertyAccessorBeanPostProcessor' threw exception; nested e
xception is java.lang.NoClassDefFoundError: org/springframework/tuple/spel/Tuple
PropertyAccessor
2018-02-11 17:51:36.894 ERROR 6504 --- [ main] o.s.b.f.s.DefaultListab
leBeanFactory : Destroy method on bean with name 'org.springframework.boot.c
ontext.properties.ConfigurationPropertiesBindingPostProcessor' threw an exceptio
n

Create example showing schema registry usage

As a developer, I'd like to create a sample for schema registry and its usage patterns.

Acceptance:

A simple schema resolution scenario for a processor application is demonstrated
Project structure, DB configurations and the sample YAML included
Unit-test procedure documented
Troubleshooting guide/hints included

Add docker file examples

All samples dont include a docker and kubernetes config generator.

Tests fail for multibinder-differentsystems.

Tests are inconsistent. While running the tests on Mac OS, it seems like the tests randomly succeed or fail. Seems to be a racing condition between the two Embedded Kafka instances that ends up with the test failing.

Add StreamEmitter sample

See spring-cloud-stream/1349#issuecomment-379023358 for background.

Create a sample demonstrating schema registry

Create a sample demonstrating how our schema registry support works with Avro serialization. This needs to show how one can use our built-in schema registry support as well as Confluent schema registry support. See this test as an example for the latter: https://github.com/spring-cloud/spring-cloud-stream-binder-kafka/blob/1.3.x/spring-cloud-stream-binder-kafka-0.10.2-test/src/test/java/org/springframework/cloud/stream/binder/kafka/Kafka_0_10_2_BinderTests.java#L183

Refactor s-c-s samples to use @ConfigurationProperties

From @sabbyanandan on November 1, 2015 22:28

The spring-cloud-streams samples have module options classes copied over from XD.
They should use a pure @ConfigurationProperties approach, making sure metadata is generated/hand written as appropriate.

@Mixins are still referenced there but obviously can't work, so provide an equivalent

Copied from original issue: spring-cloud/spring-cloud-stream#186

Stream Binding definitions in yml files do not work anymore

Running the samples is not possible. Also the tests fail. Affected samples: sink, transform, rxjava.

Cause is some property definition issue for the stream bindings in application.yml files.
The according error messages look like this:

Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'bindingService' defined in class path resource [org/springframework/cloud/stream/config/ChannelBindingServiceConfiguration.class]: Unsatisfied dependency expressed through constructor argument with index 0 of type [org.springframework.cloud.stream.config.ChannelBindingServiceProperties]: Error creating bean with name 'spring.cloud.stream.CONFIGURATION_PROPERTIES': Could not bind properties to ChannelBindingServiceProperties (prefix=spring.cloud.stream, ignoreInvalidFields=false, ignoreUnknownFields=true, ignoreNestedProperties=false); nested exception is org.springframework.validation.BindException: org.springframework.boot.bind.RelaxedDataBinder$RelaxedBeanPropertyBindingResult: 1 errors
Field error in object 'spring.cloud.stream' on field 'bindings[input]': rejected value [testtock]; codes [typeMismatch.spring.cloud.stream.bindings[input],typeMismatch.spring.cloud.stream.bindings,typeMismatch.bindings[input],typeMismatch.bindings,typeMismatch]; arguments [org.springframework.context.support.DefaultMessageSourceResolvable: codes [spring.cloud.stream.bindings[input],bindings[input]]; arguments []; default message [bindings[input]]]; default message [Failed to convert property value of type [java.lang.String] to required type [org.springframework.cloud.stream.config.BindingProperties] for property 'bindings[input]'; nested exception is java.lang.IllegalStateException: Cannot convert value of type [java.lang.String] to required type [org.springframework.cloud.stream.config.BindingProperties] for property 'bindings[input]': no matching editors or conversion strategy found]; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'spring.cloud.stream.CONFIGURATION_PROPERTIES': Could not bind properties to ChannelBindingServiceProperties (prefix=spring.cloud.stream, ignoreInvalidFields=false, ignoreUnknownFields=true, ignoreNestedProperties=false); nested exception is org.springframework.validation.BindException: org.springframework.boot.bind.RelaxedDataBinder$RelaxedBeanPropertyBindingResult: 1 errors
Field error in object 'spring.cloud.stream' on field 'bindings[input]': rejected value [testtock]; codes [typeMismatch.spring.cloud.stream.bindings[input],typeMismatch.spring.cloud.stream.bindings,typeMismatch.bindings[input],typeMismatch.bindings,typeMismatch]; arguments [org.springframework.context.support.DefaultMessageSourceResolvable: codes [spring.cloud.stream.bindings[input],bindings[input]]; arguments []; default message [bindings[input]]]; default message [Failed to convert property value of type [java.lang.String] to required type [org.springframework.cloud.stream.config.BindingProperties] for property 'bindings[input]'; nested exception is java.lang.IllegalStateException: Cannot convert value of type [java.lang.String] to required type [org.springframework.cloud.stream.config.BindingProperties] for property 'bindings[input]': no matching editors or conversion strategy found]

It looks as if there was somewhere in the framework stack an update on how to define stream bindings?
When I check the source sample (this runs with tests by the way) and check, what is the difference to sink, I notice that stream bindings can be defined either this way

spring:
  cloud:
    stream:
      bindings:
        input: testtock

or that way

spring:
  cloud:
    stream:
      bindings:
        input:
          destination: testtock

First one is the syntax from sink, and it causes the failure. Second one is the syntax from source which builds perfectly. Changing the syntax also in sink, transform and rxjava to the one using explicit "destination" helps in building these modules with tests.

Add Kafka stream samples

Kinesis sample depends on old version of spring-cloud-stream. . .

It causes issue described here

Add sample to showcase @StreamListener

Source module cannot be build in my IntelliJ IDE

Other modules are all OK except the source module.

Test embedded kafka sample no longer needs ZK property

	@BeforeClass
	public static void setup() {
		System.setProperty("spring.cloud.stream.kafka.binder.brokers", embeddedKafka.getBrokersAsString());
		System.setProperty("spring.cloud.stream.kafka.binder.zkNodes", embeddedKafka.getZookeeperConnectionString());
	}

Create sample that showcases multiple input/output channels binding

As a user, I would like to see how to bind multiple input/output channels in an application using SCSt

Can producer code be used in maven....not in spring boot

I want to produce messages to stream in already existing application which is in maven only .But I want to use message channel in maven not in spring boot.Is it possible?If yes ....please share the code

Bad symbolic links

Some .mvn symbolic links are bad - e.g. test-embedded-kafka/.mvn points to ../.mvn instead of ../../.mvn.

Implement tests on the Dynamic Source example

The Test for Dynamic Source example is empty. Writing tests to confirm our implementation using Dynamic sources is working, but are having trouble creating message channels to read from for the dynamically created channel so that we can see the message we sent. It would be very helpful having an example test for this.

Tests fail for multibinder-differentsystems

When building spring-cloud-stream-samples the test for multibinder-differentsystems fail.
Error message:

Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 15.641 sec <<< FAILURE! - in multibinder.TwoKafkaBindersApplicationTest
messagingWorks(multibinder.TwoKafkaBindersApplicationTest)  Time elapsed: 0.016 sec  <<< ERROR!
java.lang.NullPointerException: while trying to invoke the method org.springframework.cloud.stream.binder.kafka.KafkaProducerProperties.getPartitionCount() of a null object loaded from local variable 'properties'
    at org.springframework.cloud.stream.binder.kafka.KafkaMessageChannelBinder.doBindProducer(KafkaMessageChannelBinder.java:319)
    at org.springframework.cloud.stream.binder.kafka.KafkaMessageChannelBinder.doBindProducer(KafkaMessageChannelBinder.java:101)
    at org.springframework.cloud.stream.binder.AbstractBinder.bindProducer(AbstractBinder.java:155)
    at multibinder.TwoKafkaBindersApplicationTest.messagingWorks(TwoKafkaBindersApplicationTest.java:96)

Sample using Spring Boot 2.x

Hello,

I would appreciate it if you could inform me if there is some sample that uses the Spring Boot 2.x (as of this writing the latest milestone is Spring Boot 2.0.0.M2).
If there is no such sample available, are there any known issues when integrating Spring Cloud Stream and Spring Boot 2.x?

Thank you for your time?
George

Add e2e SNAPSHOT tests against cloud platforms

From @sabbyanandan on January 3, 2018 15:32

As a developer, I'd like to add/improve IT test coverage to test standalone SCSt apps on cloud platforms.

Acceptance:

The goal is to run SNAPSHOTs of the standalone apps on:
- CF
- K8S
We could follow the similar infrastructure in place for SCDF's acceptance tests, but run the apps in isolation; independently via a different CI plan.
Consider a CI plan for both the recent release-branch and as well as for master.

Copied from original issue: spring-cloud/spring-cloud-stream-starters#43

Add a sample demonstrating how basic partitioning works

child of #71

Update master to Spring Cloud Stream 2.0

As a developer, I'd like to update all the samples in the master branch to 2.0.

Acceptance:

Decide between parent-pom vs. standalone application with its dependencies
Update master to be on 2.0 for all the apps (1.3 must continue on SCSt 1.3.x)
Verify master and ditmars CI plans continue to build on incremental commits
Verify CI plan is a child of SCSt core/binder plans

Useless `@EnableAutoConfiguration`

I wonder why this class is annotated with @EnableAutoConfiguration?

You don't need to do that, @SpringBootApplication already enables auto-configuration and it's not something you enable outside of the main class anyway. Looks like an oversight to me.

Create tapping example

Build fails due to some change of dependency management in parent projects

I don't know, how to really develop against snapshot repositories, perhaps I'm doing something wrong. Today the samples projects don't build due to

[ERROR]   The project org.springframework.cloud:spring-cloud-stream-sample-source:1.0.0.BUILD-SNAPSHOT (C:\Users\D053139\git\spring-cloud-stream-samples\source\pom.xml) has 1 error
[ERROR]     'dependencies.dependency.version' for org.springframework.cloud:spring-cloud-stream-binder-redis:jar is missing. @ org.springframework.cloud:spring-cloud-stream-sample-source:[unknown-version], C:\Users\D053139\git\spring-cloud-stream-samples\source\pom.xml, line 25, column 15

And that error message for each of the top level and the single sample projects...

Fixing the version of spring-cloud-stream-binder-redis manually to 1.0.0.BUILD-20160317.060453-286 in all affected modules helps. But surely this is not the way how to solve such issues?

Can't build project

Consuming and producing avro messages with kafka binder and Spring Boot

Question - not issue.

Trying to setup avro message producer sending message to kafka and consume there message with spring boot consumer.

Is there any example including there techs with Schema Registry Server (@EnableSchemaRegistryServer) and Schema registry client (@EnableSchemaRegistryClient).

I made some example reading doc but getting error when avro message have array in schema. The error I'm getting is:

com.esotericsoftware.kryo.KryoException: java.lang.NullPointerException at org.springframework.integration.codec.kryo.PojoCodec.doDecode when try to decode array.

Thanks!

Create example showing custom message sending

As a first time spring cloud stream user I would like to know how to send a custom message to a queue after a certain event/request and not using a poller.
I will provide a pull-request with this issue.

Add a sample for embedded kafka tests

Add a sample for dynamic event handling

We should use `spring-kafka-test` in `multibinder` sample

See spring-cloud/spring-cloud-stream-binder-kafka#102 (comment) for details.

Add sample for non self contained aggregate application

As a user I'd like to have a sample application that showcases how to write a non self contained (the aggregate application is bound to external broker one either or both inbound/outbound of the application while the applications inside are directly bound. ex: a source + processor with directly bound and the processor's output channel is bound external destination at the broker) aggregate application

How to add new property to application.yml file

How to add following properties :

autoAddShards
minShardCount

in application.yml

Update samples to Chelsea RELEASE

Make samples acceptance tests run from CI build

Create Sample that showcases contentType conversion from JSON -> POJO automatically

As a user, I would like to refer to a sample that does the application/json contentType to a POJO automatically.

Sample application to demonstrate the advanced capabilities of an Aggregate application

Add a multi-binder sample to validate the latest upstream changes

The goal is to have 2 different Rabbit clusters and with multi-binder integration, we wanted to make sure it functions as expected.

Refer to spring-cloud/spring-cloud-stream#1272

spring-cloud-starter-config confilts with cloud stream?

when I start my stream project , I find the following errors:

`2017-06-27 10:37:04.266  WARN 43934 --- [           main] lientConfigServiceBootstrapConfiguration : Could not locate configserver via discovery

org.springframework.beans.factory.NoSuchBeanDefinitionException: No bean named 'configServerRetryInterceptor' available
        at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeanDefinition(DefaultListableBeanFactory.java:687) ~[spring-beans-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.beans.factory.support.AbstractBeanFactory.getMergedLocalBeanDefinition(AbstractBeanFactory.java:1207) ~[spring-beans-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:284) ~[spring-beans-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) ~[spring-beans-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.retry.annotation.AnnotationAwareRetryOperationsInterceptor.getDelegate(AnnotationAwareRetryOperationsInterceptor.java:175) ~[spring-retry-1.2.0.RELEASE.jar:na]
        at org.springframework.retry.annotation.AnnotationAwareRetryOperationsInterceptor.invoke(AnnotationAwareRetryOperationsInterceptor.java:150) ~[spring-retry-1.2.0.RELEASE.jar:na]
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) ~[spring-aop-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:673) ~[spring-aop-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.cloud.config.client.ConfigServerInstanceProvider$$EnhancerBySpringCGLIB$$3cee7d12.getConfigServerInstance(<generated>) ~[spring-cloud-config-client-1.3.0.RELEASE.jar:1.3.0.RELEASE]
        at org.springframework.cloud.config.client.DiscoveryClientConfigServiceBootstrapConfiguration.refresh(DiscoveryClientConfigServiceBootstrapConfiguration.java:80) [spring-cloud-config-client-1.3.0.RELEASE.jar:1.3.0.RELEASE]
        at org.springframework.cloud.config.client.DiscoveryClientConfigServiceBootstrapConfiguration.startup(DiscoveryClientConfigServiceBootstrapConfiguration.java:66) [spring-cloud-config-client-1.3.0.RELEASE.jar:1.3.0.RELEASE]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_131]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_131]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_131]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_131]
        at org.springframework.context.event.ApplicationListenerMethodAdapter.doInvoke(ApplicationListenerMethodAdapter.java:253) [spring-context-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.context.event.ApplicationListenerMethodAdapter.processEvent(ApplicationListenerMethodAdapter.java:174) [spring-context-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.context.event.ApplicationListenerMethodAdapter.onApplicationEvent(ApplicationListenerMethodAdapter.java:137) [spring-context-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.context.event.SimpleApplicationEventMulticaster.invokeListener(SimpleApplicationEventMulticaster.java:167) [spring-context-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:139) [spring-context-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:383) [spring-context-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:337) [spring-context-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:882) [spring-context-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:545) [spring-context-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:737) [spring-boot-1.5.3.RELEASE.jar:1.5.3.RELEASE]
        at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:370) [spring-boot-1.5.3.RELEASE.jar:1.5.3.RELEASE]
        at org.springframework.boot.SpringApplication.run(SpringApplication.java:314) [spring-boot-1.5.3.RELEASE.jar:1.5.3.RELEASE]
        at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.5.3.RELEASE.jar:1.5.3.RELEASE]
        at org.springframework.cloud.bootstrap.BootstrapApplicationListener.bootstrapServiceContext(BootstrapApplicationListener.java:175) [spring-cloud-context-1.2.0.RELEASE.jar:1.2.0.RELEASE]
        at org.springframework.cloud.bootstrap.BootstrapApplicationListener.onApplicationEvent(BootstrapApplicationListener.java:98) [spring-cloud-context-1.2.0.RELEASE.jar:1.2.0.RELEASE]
        at org.springframework.cloud.bootstrap.BootstrapApplicationListener.onApplicationEvent(BootstrapApplicationListener.java:64) [spring-cloud-context-1.2.0.RELEASE.jar:1.2.0.RELEASE]
        at org.springframework.context.event.SimpleApplicationEventMulticaster.invokeListener(SimpleApplicationEventMulticaster.java:167) [spring-context-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:139) [spring-context-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:122) [spring-context-4.3.8.RELEASE.jar:4.3.8.RELEASE]
        at org.springframework.boot.context.event.EventPublishingRunListener.environmentPrepared(EventPublishingRunListener.java:73) [spring-boot-1.5.3.RELEASE.jar:1.5.3.RELEASE]
        at org.springframework.boot.SpringApplicationRunListeners.environmentPrepared(SpringApplicationRunListeners.java:54) [spring-boot-1.5.3.RELEASE.jar:1.5.3.RELEASE]
        at org.springframework.boot.SpringApplication.prepareEnvironment(SpringApplication.java:336) [spring-boot-1.5.3.RELEASE.jar:1.5.3.RELEASE]
        at org.springframework.boot.SpringApplication.run(SpringApplication.java:307) [spring-boot-1.5.3.RELEASE.jar:1.5.3.RELEASE]
        at org.springframework.boot.SpringApplication.run(SpringApplication.java:1162) [spring-boot-1.5.3.RELEASE.jar:1.5.3.RELEASE]
        at org.springframework.boot.SpringApplication.run(SpringApplication.java:1151) [spring-boot-1.5.3.RELEASE.jar:1.5.3.RELEASE]
        at cn.superid.demo.Application.main(Application.java:24) [classes/:na]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_131]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_131]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_131]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_131]
        at org.springframework.boot.maven.AbstractRunMojo$LaunchRunner.run(AbstractRunMojo.java:527) [spring-boot-maven-plugin-1.5.3.RELEASE.jar:1.5.3.RELEASE]
        at java.lang.Thread.run(Thread.java:748) [na:1.8.0_131]
`

the following are my pom dependenccies:

`<dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-hystrix-dashboard</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-config</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-stream-binder-rabbit</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-autoconfigure</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-configuration-processor</artifactId>
            <optional>true</optional>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-stream</artifactId>
        </dependency>`

spring-cloud.version is Dalston.RELEASE and
cloud-sream.version is Chelsea.SR2.

When I remove spring-cloud-starter-config ,It works OK!
does spring-cloud-starter-config confilts with cloud stream?

Validate interactive query works with multiple Kafka streams app instances

When there are multiple instances of the same kafka stream application and interactive query feature is used across all of them, we need to verify that this type of querying is possible through the support in spring cloud stream. Use this sample as a reference for this validation: https://github.com/spring-cloud/spring-cloud-stream-samples/tree/master/kafka-streams-samples/kafka-streams-interactive-query-advanced

How could I change an iterator type to use a kinesis?

Hi,

I want to change a kinesis default iterator type(latest) to another, but I leave a question because it is difficult to find a sample code.

I'd appreciate it if you could tell me what to do.
Sharing it with sample codes would be great.

Run e2e tests on CF

As a developer, I'd like to run the e2e tests on the CF environment.

Note: This is a continuation of samples-acceptance-tests, but for CF.

child of #71

US-RI026CO-MLT:spring-cloud-stream-samples richardcollette$ ./mvnw clean build
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO] 
[INFO] spring-cloud-stream-samples
[INFO] spring-cloud-stream-sample-source
[INFO] spring-cloud-stream-sample-dynamic-source
[INFO] spring-cloud-stream-sample-sink
[INFO] spring-cloud-stream-sample-transform
[INFO] spring-cloud-stream-sample-double
[INFO] spring-cloud-stream-sample-non-self-contained-aggregate-app
[INFO] spring-cloud-stream-sample-multibinder
[INFO] spring-cloud-stream-sample-multibinder-differentsystems
[INFO] spring-cloud-stream-sample-rxjava
[INFO] spring-cloud-stream-sample-multi-io
[INFO] spring-cloud-stream-sample-stream-listener
[INFO] spring-cloud-stream-sample-reactive-processor-kafka
[INFO] spring-cloud-stream-sample-test-embedded-kafka
[INFO] spring-cloud-stream-sample-kinesis
[INFO] spring-cloud-stream-sample-kstream-parent
[INFO] kstream-word-count
[INFO] kstream-product-tracker
[INFO] kstream-interactive-query
[INFO] testing
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building spring-cloud-stream-samples 1.2.0.BUILD-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] spring-cloud-stream-samples ........................ FAILURE [  0.038 s]
[INFO] spring-cloud-stream-sample-source .................. SKIPPED
[INFO] spring-cloud-stream-sample-dynamic-source .......... SKIPPED
[INFO] spring-cloud-stream-sample-sink .................... SKIPPED
[INFO] spring-cloud-stream-sample-transform ............... SKIPPED
[INFO] spring-cloud-stream-sample-double .................. SKIPPED
[INFO] spring-cloud-stream-sample-non-self-contained-aggregate-app SKIPPED
[INFO] spring-cloud-stream-sample-multibinder ............. SKIPPED
[INFO] spring-cloud-stream-sample-multibinder-differentsystems SKIPPED
[INFO] spring-cloud-stream-sample-rxjava .................. SKIPPED
[INFO] spring-cloud-stream-sample-multi-io ................ SKIPPED
[INFO] spring-cloud-stream-sample-stream-listener ......... SKIPPED
[INFO] spring-cloud-stream-sample-reactive-processor-kafka  SKIPPED
[INFO] spring-cloud-stream-sample-test-embedded-kafka ..... SKIPPED
[INFO] spring-cloud-stream-sample-kinesis ................. SKIPPED
[INFO] spring-cloud-stream-sample-kstream-parent .......... SKIPPED
[INFO] kstream-word-count ................................. SKIPPED
[INFO] kstream-product-tracker ............................ SKIPPED
[INFO] kstream-interactive-query .......................... SKIPPED
[INFO] testing ............................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 0.679 s
[INFO] Finished at: 2017-12-07T10:09:57-05:00
[INFO] Final Memory: 32M/437M
[INFO] ------------------------------------------------------------------------
[ERROR] Unknown lifecycle phase "build". You must specify a valid lifecycle phase or a goal in the format <plugin-prefix>:<goal> or <plugin-group-id>:<plugin-artifact-id>[:<plugin-version>]:<goal>. Available lifecycle phases are: validate, initialize, generate-sources, process-sources, generate-resources, process-resources, compile, process-classes, generate-test-sources, process-test-sources, generate-test-resources, process-test-resources, test-compile, process-test-classes, test, prepare-package, package, pre-integration-test, integration-test, post-integration-test, verify, install, deploy, pre-clean, clean, post-clean, pre-site, site, post-site, site-deploy. -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/LifecyclePhaseNotFoundException

I don't see the build lifecycle listed in the intellij maven tool window either.

why "destination" is not the topic?

   bindings:
      im_test_in:
        destination: im_test
        group: im
      im_test_out:
        destination: im_test

In kafka,the topic is im_test_in or im_test_out ,not im_test...

spring-cloud / spring-cloud-stream-samples Goto Github PK

spring-cloud-stream-samples's Introduction

Spring Cloud Stream Sample Applications

Provided Sample Applications

Confluent Schema Registry Integration

Spring Cloud Stream Schema Registry Integration

Batch Producer Consumer

Kafka Binder Native App

spring-cloud-stream-samples's People

Contributors

Stargazers

Watchers

Forkers

spring-cloud-stream-samples's Issues

Recommend Projects

Recommend Topics

Recommend Org