dapr / components-contrib Goto Github PK

Describe the proposal

To have support for dynamodb for state.

Describe the proposal

Add support for Cloud Firestore (in datastore mode) as a state component.

Describe the proposal

As discussed in #59 (comment), the StateStore interface can be renamed to Store for simplicity.

Describe the proposal

Add support for NATS as a pubsub component in Dapr. To be specific, the intention is to use NATS queue groups such that consumer Dapr apps can share the workload in a load-balanced way

Describe the proposal

Implement Cassandra as a state store and transactional state store.

Describe the proposal

Using custom topics as event source and WebHooks as event handlers

Describe the proposal

Implement the Transactions interface for MongoDB.
That would make MondoDB be able to operate multi-operation transactions and be certified for an Actor state store for Dapr.

Expected Behavior

When the a.metadata.AutoDeleteOnIdleInSec is not nil we can set the configuration setting on the subscription.

Actual Behavior

The wrong metadata setting i.e. a.metadata.DefaultMessageTimeToLiveInSec is checked instead so it'll incorrectly try to set AutoDeleteOnIdleInSec even if it was nil in the metadata.

Sorry this was my bad - didn't catch it before merge of my PR for issue #93

The redis state store returns an Etag mismatch error for every error, even if unrelated to etag.

Ask your question here

Just want to check if there is any plan to track the version of tools used. Here is common approach for go module https://github.com/golang/go/wiki/Modules#how-can-i-track-tool-dependencies-for-a-module

Describe the proposal

Implement memcached as a state store .

Describe the proposal

Provide a state store implementation for Couchbase

Hello,

Is there a way to subscribe to a topic? I have tried the sample and can connect to a queue successfully but not to a topic (even with the /dapr/subscriptions endpoint added):

https://github.com/dapr/docs/blob/master/concepts/bindings/specs/servicebusqueues.md

Also I traced the http response and can't seem to get the message properties from the service bus message, just the content. I would like at least to get the CorrelationId from the message headers if that is supported? Thanks

Describe the proposal

In the spirit of #70, we need to change TransactionalStateStore to TransactionalStore for consistency.

Implement HashiCorp Vault as a secret store.

Describe the proposal

Add support for GCP KMS as a Secrets Store.

The means to authenticate with GCP resources can be found in other components like GCP Pub/Sub, and the way these get passed in can be inferred from the other secrets store implementations.

Describe the proposal

The go-redis package is a common and highly used package for interacting with Redis for Go. It's used by Redis for Pub/Sub, while the Redis State Store uses redispipe, which favors implicit pipelining but does not support things like TLS.

I propose to standardize on go-redis as the package for Redis interactions in components-contrib.

When using the WAIT command for strong consistency, the command currently receives a hardcoded 1000 value for connected slaves instead of using r.replicas

For various Bindings, client should have way to get configuration settings from the metadata.
E.g. For Kafka bindings, following producer configs are not configurable.
Required Acks
Maximum Retry

Justification:

Since we move out component-contrib from actions repo, we need to manage its pkg version.

Ask your question here

As per pubsub docs "Dapr guarantees At-Least-Once semantics for message delivery". Does this imply that means that pubsub component does not depend on the underlying messaging implementation semantics? e.g. if the "implementation A" supports (or is configured to support) "at-most-once" (no duplicates), Dapr might still end up re-trying and sending duplicate messages?

Let me know if this is posted/detailed elsewhere

Describe the proposal

This is the issue to track the gitter conversation

Need to provide the dev document to build and test component-contrib for developing new component.

• : Create document to build component-contrib with dapr runtime
• : Create document to test component-contrib with dapr runtime

Implement MongoDB as a state store .

Describe the proposal

Provide a state store implementation for Hazelcast using its Map data structure

Add contribution guidance

Support RabbitMQ as a Pub/Sub component.

Adding and Correcting code comments and types as part of release checklist.

Describe the proposal

Currently custom metadata to a state store implementation is only supported through a SetRequest.

This proposes to add passing metadata with GetRequest and DeleteRequest also.

Improved with

1. YAML spec needs to be included
2. Merge can only occur after all Tasks completed
3. Review the contribute proposal template for all the task
4. Make sure that you assign the issues to yourself to indicate you are working on this

Describe the proposal

Etcd is a distributed key-value store with features comparable to Redis.
I propose adding Etcd as another state option for Dapr.

PR should be gated with running all tests.

Describe the proposal

Hello, I'm trying to use Dapr with Digital Ocean managed Redis which is using secured connection. I'm getting following message:

time="2019-11-02T17:45:45Z" level=warning msg="error initializing pub sub pubsub.redis: redis streams: error connecting to redis at private-dapr01-do-user-2603541-0.db.ondigitalocean.com:25061: EOF"

I suspect it is caused by the missing TLS configuration here:

https://github.com/dapr/components-contrib/blob/master/pubsub/redis/redis.go#L69

	client := redis.NewClient(&redis.Options{
		Addr:            m.host,
		Password:        m.password,
		DB:              0,
		MaxRetries:      3,
		MaxRetryBackoff: time.Second * 2,
	})

Could you confirm or refute whether the current implementation of Redis pub sub supports secure connection?

Thanks in advance!

Implement HashiCorp Consul as a state store for dapr.

Ask your question here

I just saw this

Implementing a new binding
A compliant binding needs to implement one or more interfaces, depending on the type of binding (Input or Output):

Input binding:

type InputBinding interface {
	Init(metadata Metadata) error
	Read(handler func(*ReadResponse) error) error
}
Output binding:

type OutputBinding interface {
	Init(metadata Metadata) error
	Write(req *WriteRequest) error
}

And how to test?
Thanks!

Azure ServiceBus PubSub

Add an Azure ServiceBus PubSub implementation. Opening this as a reference issue for an incoming PR. Proposal is fairly self explanatory.

Thought it might be useful to some folks to use a hosted message bus for pubsub rather than redis or the newly added NATS implementation. Apologies I didn't open this sooner to discuss, if we don't think this is a good idea then no problem!

Related: #73
PR: #93

Describe the proposal

Implement the Transactions interface for Cassandra.
That would make Cassandra be able to operate multi-operation transactions and be certified for an Actor state store for Dapr.

Describe the proposal

now the name is components-contrib, but it's too long.
I suggest that rename to common or base or components, ok?
thanks!

for example

• pubsub should be gcp-pubsub
• sns should be aws-sns
• blobstorage should be azure-blobstorage

Describe the proposal

Add support for AWS Secret Manager as a Secrets Store.

The means to authenticate with AWS resources can be found in other components like SQS, and the way these get passed in can be inferred from the other secrets store implementations.

Expected Behavior

No error for go mod tidy

Actual Behavior

The below error is happening

github.com/dapr/dapr/pkg/components/bindings imports
        github.com/dapr/components-contrib/bindings/kubernetes imports
        github.com/kubernetes-client/go/kubernetes/config tested by
        github.com/kubernetes-client/go/kubernetes/config.test imports
        k8s.io/client/kubernetes/config/api: git ls-remote -q https://github.com/kubernetes/client in /Users/XXX/go/pkg/mod/cache/vcs/1873572271fcf325ad32062ccf6aee165fdb6b2229b714b40050d6bf3d599824: exit status 128:
        remote: Repository not found.
        fatal: repository 'https://github.com/kubernetes/client/' not found

$ go version
go version go1.13.3 darwin/amd64

Steps to Reproduce the Problem

Just run go mod tidy

Describe the proposal

Kafka brokers can be configured to support SASL authentication. The Dapr Kafka binding can be enhanced to provide this. This will allow integration with any Kafka broker including managed ones (where auth is mandatory) such as Azure Event Hubs, Confluent etc.

This authentication is optional and can be disabled using Dapr config e.g. authRequired: "false"

Expected Behavior

Cassandra state store should allow user-defined port

Actual Behavior

gocql driver connects to port 9042 by default

Steps to Reproduce the Problem

start a cassandra instance on port other than the default one (9042) and run any app along side Dapr. You should see connection related error logs

1. The table of Bindings here https://github.com/dapr/components-contrib/tree/master/bindings should have links to each of the respective folders.

azure-xxxtech e.g. azure-cosmosdb
aws-xxxtechn e..g. aws-sns
gcp-xxxtech e.g. gcp-pubsub

Not sure if any plan to do so for this repo.