abraham-leal / ccloud-schema-exporter Goto Github PK

Hello!
How can I use this to backup using <go run ./cmd/ccloud-schema-exporter.go -getLocalCopy -syncDeletes -localPath .$@/${ENV}/${datestring}> and then restore back to confluent cloud if a schema is deleted from schema registry please?

So if i bring a backup from ccloud in local, what command would i need to send it back to ccloud?

When we are uplaoding the schema registry using -fromLocalCopy it upload full path as name of schema registry
e.g D:\Schematest\SchemaRegistryBackup\myNew-Topic-value-1-35421-JSON is the name instead of myNew-Topic-value-1-35421-JSON

The tool should support contexts for all capabilities.

Enrich the import and export from the local filesystem

Hello,
Currently I have an issue where upon launching the docker and setting environment variables it is saying it hasn't been specified.
The variables have been set at the start of my makefile to have three different environments use the same variable which when running a check against my credentials it runs correctly and my colleague is able to run the code, however when i run it from an M1 mac it says it hasnt been specified.

ENV ?= noenv
SRC_API_KEY ?= unknown
PWD = $(shell pwd)
REGION ?= eu-west-1
datestring = $(shell date '+%Y-%m-%d')
ifeq ($(ENV),dev)
SRC_SR_URL = REDACTED
endif

ifeq ($(ENV),nonprod)
SRC_SR_URL = REDACTED
endif

ifeq ($(ENV),prod)
SRC_SR_URL = REDEACTED
endif

As per your documentation I ran the commands

git clone https://github.com/abraham-leal/ccloud-schema-exporter
cd ccloud-schema-exporter
go build ./cmd/ccloud-schema-exporter/ccloud-schema-exporter.go

and

docker run
-e SRC_SR_URL=$SRC_SR_URL
-e SRC_API_KEY=$SRC_API_KEY
-e SRC_API_SECRET=$SRC_API_SECRET
-e DST_SR_URL=$DST_SR_URL
-e DST_API_KEY=$DST_API_KEY
-e DST_API_SECRET=$DST_API_SECRET
abrahamleal/ccloud-schema-exporter:latest

Can you please advise on where I may have missed something.

Status: Downloaded newer image for abrahamleal/ccloud-schema-exporter:latest
2023/06/27 14:36:44 Starting exposure of metrics on :9020/metrics
panic: SRC_SR_URL environment variable has not been specified

goroutine 1 [running]:
github.com/abraham-leal/ccloud-schema-exporter/cmd/internals.SrcGetSRUrl(0x8ea800, 0xc0001cc2a0)
        /app/cmd/internals/getInfo.go:43 +0xa5
github.com/abraham-leal/ccloud-schema-exporter/cmd/internals.NewSchemaRegistryClient(0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x93ab13, 0x3, 0x8f4260)
        /app/cmd/internals/schema-registry-light-client.go:39 +0x11c
main.main()
        /app/cmd/ccloud-schema-exporter/ccloud-schema-exporter.go:108 +0xd5

We are currently running "ccloud-schema-exporter" as a Kubernetes pod with the metrics end point exposed. We want to setup alerts to check if the service is up and running. I tried killing the pod/deployment and could still find the metrics end point exposing some data.

Is there any metrics value used to tell if the ccloud-schema-exporter is running(Up or down)? We want to determine when ccloud-schema-exporter is down, so team could recover in case of any issues?

I did build a new image with docker file it starts up successfully. But unable to access metrics endpoint at localhost:9020/metrics.

logs:

ccloud-schema-exporter-withmetrics:latest
2020/12/17 15:48:48 Starting exposure of metrics on :9020/metrics
2020/12/17 15:48:52 Finished sync in 2482 ms
2020/12/17 15:49:55 Finished sync in 2999 ms
2020/12/17 15:50:58 Finished sync in 3032 ms
2020/12/17 15:52:01 Finished sync in 3199 ms