abraham-leal / ccloud-schema-exporter Goto Github PK
View Code? Open in Web Editor NEWSync multiple Confluent Cloud Schema Registries
License: Apache License 2.0
Sync multiple Confluent Cloud Schema Registries
License: Apache License 2.0
Hello!
How can I use this to backup using <go run ./cmd/ccloud-schema-exporter.go -getLocalCopy -syncDeletes -localPath .$@/${ENV}/${datestring}> and then restore back to confluent cloud if a schema is deleted from schema registry please?
So if i bring a backup from ccloud in local, what command would i need to send it back to ccloud?
When we are uplaoding the schema registry using -fromLocalCopy it upload full path as name of schema registry
e.g D:\Schematest\SchemaRegistryBackup\myNew-Topic-value-1-35421-JSON is the name instead of myNew-Topic-value-1-35421-JSON
The tool should support contexts for all capabilities.
Enrich the import and export from the local filesystem
Hello,
Currently I have an issue where upon launching the docker and setting environment variables it is saying it hasn't been specified.
The variables have been set at the start of my makefile to have three different environments use the same variable which when running a check against my credentials it runs correctly and my colleague is able to run the code, however when i run it from an M1 mac it says it hasnt been specified.
ENV ?= noenv
SRC_API_KEY ?= unknown
PWD = $(shell pwd)
REGION ?= eu-west-1
datestring = $(shell date '+%Y-%m-%d')
ifeq ($(ENV),dev)
SRC_SR_URL = REDACTED
endif
ifeq ($(ENV),nonprod)
SRC_SR_URL = REDACTED
endif
ifeq ($(ENV),prod)
SRC_SR_URL = REDEACTED
endif
As per your documentation I ran the commands
git clone https://github.com/abraham-leal/ccloud-schema-exporter
cd ccloud-schema-exporter
go build ./cmd/ccloud-schema-exporter/ccloud-schema-exporter.go
and
docker run
-e SRC_SR_URL=$SRC_SR_URL
-e SRC_API_KEY=$SRC_API_KEY
-e SRC_API_SECRET=$SRC_API_SECRET
-e DST_SR_URL=$DST_SR_URL
-e DST_API_KEY=$DST_API_KEY
-e DST_API_SECRET=$DST_API_SECRET
abrahamleal/ccloud-schema-exporter:latest
Can you please advise on where I may have missed something.
Status: Downloaded newer image for abrahamleal/ccloud-schema-exporter:latest
2023/06/27 14:36:44 Starting exposure of metrics on :9020/metrics
panic: SRC_SR_URL environment variable has not been specified
goroutine 1 [running]:
github.com/abraham-leal/ccloud-schema-exporter/cmd/internals.SrcGetSRUrl(0x8ea800, 0xc0001cc2a0)
/app/cmd/internals/getInfo.go:43 +0xa5
github.com/abraham-leal/ccloud-schema-exporter/cmd/internals.NewSchemaRegistryClient(0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x93ab13, 0x3, 0x8f4260)
/app/cmd/internals/schema-registry-light-client.go:39 +0x11c
main.main()
/app/cmd/ccloud-schema-exporter/ccloud-schema-exporter.go:108 +0xd5
We are currently running "ccloud-schema-exporter" as a Kubernetes pod with the metrics end point exposed. We want to setup alerts to check if the service is up and running. I tried killing the pod/deployment and could still find the metrics end point exposing some data.
Is there any metrics value used to tell if the ccloud-schema-exporter is running(Up or down)? We want to determine when ccloud-schema-exporter is down, so team could recover in case of any issues?
I did build a new image with docker file it starts up successfully. But unable to access metrics endpoint at localhost:9020/metrics.
logs:
ccloud-schema-exporter-withmetrics:latest
2020/12/17 15:48:48 Starting exposure of metrics on :9020/metrics
2020/12/17 15:48:52 Finished sync in 2482 ms
2020/12/17 15:49:55 Finished sync in 2999 ms
2020/12/17 15:50:58 Finished sync in 3032 ms
2020/12/17 15:52:01 Finished sync in 3199 ms
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.