Giter VIP home page Giter VIP logo

eko / monday Goto Github PK

View Code? Open in Web Editor NEW
1.3K 17.0 45.0 15.29 MB

⚡️ A dev tool for microservice developers to run local applications and/or forward others from/to Kubernetes SSH or TCP

Home Page: https://vincent.composieux.fr/article/how-does-monday-use-go-and-how-does-it-work/

License: MIT License

Go 97.16% Dockerfile 0.72% Makefile 2.12%
kubernetes ssh tcp microservice architecture devops development-tools development hacktoberfest

monday's Introduction

Monday: dev tool for local app and port-forwarding

Test (master) GoDoc GoReportCard

Your new microservice development environment friend. This CLI tool allows you to define a configuration to work with both local applications (Go, NodeJS, Rust or others) and forward some other applications over Kubernetes in case you don't want to run them locally.

What Monday can do for you?

✅ Define a unified way to setup applications for all your developers

✅ Run your local applications

✅ Hot reload your applications automatically when a change is made locally

✅ Port-forward an application locally using a remote one on Kubernetes (targeting a pod via label) or over SSH

✅ Forward traffic of a remote application over Kubernetes, SSH or TCP locally (see example forward types)

✅ Auto reconnect when a port-forward connection is lost

✅ Forward multiple times the same port locally, using an hostname

✅ Monitor your local and/or forwarded applications

Installation

Homebrew (macOS)

$ brew install eko/homebrew-tap/monday

This will install the latest available release

Download binary

You can download the latest version of the binary built for your architecture here:

From sources

Optionally, you can download and build it from the sources. You have to retrieve the project sources by using one of the following way:

$ go get -u github.com/eko/monday
# or
$ git clone https://github.com/eko/monday.git

Then, build the binary using the available target in Makefile:

$ make build

Configuration: Define your projects

Configuration of Monday lives in one or multiple YAML files, depending on how you want to organize your files.

By default, monday init will initiates a ~/monday.yaml file. You can customize the configuration directory by setting the MONDAY_CONFIG_PATH environment variable.

Please note that you can also split this configuration in multiple files by respecting the following pattern: ~/monday.<something>.yaml, for instance:

  • ~/monday.localapps.yaml
  • ~/monday.forwards.yaml
  • ~/monday.projects.yaml

This will help you navigate more easily in your configuration files.

Define a local project

Here is an example of a local application:

<: &graphql-local
  name: graphql
  path: $GOPATH/src/github.com/eko/graphql
  watch: true
  hostname: graphql.svc.local # Project will be available using this hostname on your machine
  setup: # Setup, installation step in case specified path does not exists
    - go get github.com/eko/graphql
  build: # Optionally, you can define a build section to build your application before running it
    commands:
      - go build -o ./build/graphql-app cmd/ # Here, just build the Go application
    env:
      CGO_ENABLED: on
  run:
    command: ./build/graphql-app # Then, run it using this built binary
    env: # Optional, in case you want to specify some environment variables for this app
      HTTP_PORT: 8005
    env_file: "github.com/eko/graphql/.env" # Or via a .env file also
  files: # Optional, you can also declare some files content with dynamic values coming from your project YAML or simply copy files
    - type: content
      to: $GOPATH/src/github.com/eko/graphql/my_file
      content: |
        This is my file content and here are the current project applications:
          {{- range $app := .Applications }}
          Name: {{ $app.Name }}
          {{- end }}
    - type: copy
      from: $GOPATH/src/github.com/eko/graphql/.env.dist
      to: $GOPATH/src/github.com/eko/graphql/.env

Then, imagine this GraphQL instance needs to call a user-api but we want to forward it from a Kubernetes environment, we will define it as follows.

Define a port-forwarded project

<: &user-api-forward
  name: user-api
  type: kubernetes
  values:
    context: staging # This is your kubernetes cluster (kubectl config context name)
    namespace: backend
    labels:
      app: user-api
    hostname: user-api.svc.local # API will be available under this hostname
    ports:
     - 8080:8080

Well, you have defined both a local app and an application that needs to be forwarded, now just create the project!

Define a project with both local app and a port-forwarded one

 - name: graphql
   local:
    - *graphql-local
   forward:
    - *user-api-forward

Your project configuration is ready, you can now work easily with your microservices.

For an overview of what's possible to do with configuration file, please look at the configuration example directory here.

To learn more about the configuration, please take a look at the Configuration Wiki page.

Usage: Run your projects!

Monday Asciinema

First, you have to initialize monday and edit your configuration file (you have a configuration example directory here). Run the following command and edit the ~/monday.yaml configuration file just created for you:

⚠️ Important note: Because Monday tries to be your best dev tool and manage things for you, you have to give it some chances to help you in editing host file and manipulating network interface for IP/port mapping.

That's why I suggest to run Monday using the following alias:

alias monday='sudo -E monday'
$ monday init

Once your configuration file is ready, you can simply run Monday:

$ monday [--ui]

Note the --ui option that will allow you to enable the user interface (you can also define a MONDAY_ENABLE_UI environment variable to enable it).

Or, you can run a specific project directly by running:

$ monday run [--ui] <project name>

When you want to edit your configuration again, simply run this command to open it in your favorite editor:

$ monday edit

Environment variables

The following environment variables can be used to tweak your Monday configuration:

Environment variable Description
MONDAY_CONFIG_PATH Specify the configuration path where your YAML files can be found
MONDAY_EDITOR Specify which editor you want to use in order to edit configuration files
MONDAY_EDITOR_ARGS Specify the editor arguments you want to pass (separated by coma), example: -t,--wite
MONDAY_ENABLE_UI Specify that you want to use the terminal UI instead of simply logging to stdout
MONDAY_KUBE_CONFIG Specify the location of your Kubernetes config file (if not in your home directory)

Community

You can join the community Slack space to discuss about your issues, new features or anything else regarding Monday.

Run tests

Test suite can be run with:

$ go test -v ./...

monday's People

Contributors

ajsharma avatar davidnuon avatar dependabot-preview[bot] avatar dependabot[bot] avatar dlecorfec avatar eko avatar ldechoux avatar miles- avatar rvarunrathod avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

monday's Issues

panic if Dial error in Proxy.handleConnections

pkg/proxy/proxy.go:121: "defer target.Close()" causes a panic if "target, err := net.Dial()" (line 114) failed. Missing a break/return/continue statement after "p.view.Writef()" line 116? Or juste add a check for nil pointer in the defer statement?

(unable to reproduce the panic, unfortunately)

Chmod +a not available on Linux

The +a parameter you use in the README and also in your curl installer script is not available on Linux, this is a Mac only parameter.

I'm running this on ubuntu 18.04 but as far as I know this gives the same error message on other distros:

chmod: invalid mode: ‘+a’

monday overwrites zshrc config

When updating the Monday using curl | sh method on Mac it overwrites my .zshrc file entirely with a single line: alias monday='sudo -E monday'

Not found getmonday.sh

It seems that https://composieux.fr/getmonday.sh is not found now.
So I installed monday with other method.

Steps for Reproduction

  • curl -i https://composieux.fr/getmonday.sh

Expected behavior:

It returns content of getmonday.sh.

Actual behavior:

curl -i https://composieux.fr/getmonday.sh
HTTP/2 404
server: nginx/1.10.3
date: Mon, 05 Aug 2019 02:51:51 GMT
content-type: text/html; charset=utf-8
content-length: 169

<html>
<head><title>404 Not Found</title></head>
<body bgcolor="white">
<center><h1>404 Not Found</h1></center>
<hr><center>nginx/1.10.3</center>
</body>
</html>

Platforms:

macOS 10.13.16

Include browser, operating system and respective versions

Versions:

README in master

No Auth Provider found for name "oidc"

Our company uses okta for authentication. When I try to connect do port-forwarding I get the following error:
❌ No Auth Provider found for name "oidc"

Part of our configuration looks like this:

  • context:
    cluster: staging.company.com
    user: okta
    name: staging.company.com

  • name: okta
    user:
    auth-provider:
    config:
    client-id: clientid
    id-token: token
    idp-issuer-url: https://company.okta.com
    name: oidc

chmod: 无效模式:"+a"

Hi guys,

When I set up monday with the shell cmd in https://github.com/eko/monday, I got the error as follows:

# curl https://composieux.fr/getmonday.sh | sh
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  1091  100  1091    0     0    432      0  0:00:02  0:00:02 --:--:--   432
-> Determining your OS and architecture type...\n
-> Downloading Monday binary...\n
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   138    0   138    0     0    205      0 --:--:-- --:--:-- --:--:--   205
  0     0    0   609    0     0    398      0 --:--:--  0:00:01 --:--:--  594k
100 26.8M  100 26.8M    0     0    99k      0  0:04:36  0:04:36 --:--:-- 74759
-> Setting permissions on Monday binary (password could be required)\n
-> Setting access to /etc/hosts file for the current user (password could be required)\n
chmod: 无效模式:"+a"
Try 'chmod --help' for more information.
-> monday alias has been added in your ~/.bashrc\n
🖥  Monday - version 1.0.1

I checked the issues in this repository, I found this #3.

Someone said the shell script is now up-to-date, but I still come into this problem.
Can anybody help me?

Secure one liner script with https

Hi there,

I noticed your documentation serves your one liner script over HTTP, instead of HTTPS. This isn't a good practice, as you're recommending the output be piped directly to sh without any validation. If the connection was some how intercepted, a bad actor would be able to run arbitrary code on the developers box without the developer knowing what exactly was ran.

I'd recommend installing SSL and serving your script over HTTPS. If you need help getting SSL set up, I'd be happy to assist.

Cheers,
Scott

Ctrl-C signal not handled if labels not found on forwards

Hi,

Another issue that's kind of allowing I noticed, might as well raise it, should be easy to fix. If I start some forwards and the namespace does not contain the deployment with the labels specified, then it's going to hang forever, and no feedback at all from the program just blank screen. It would be nice to first have some feedback whats it trying to do, here find the deployment with those labels, maybe even print the labels its looking for, so we might realise we made an error or wrong namespace.
And at this point monday already is catching signal Ctrl-C so we can't kill the program at this point from that shell. We need to open a new shell and kill the process manually. And then the other shell is in a bad state cause the program was also trying to redirect stdout stderr I am guessing. It's not closed "properly".

If you have sometime to work on that at some point, I wouldn't say its high priority but a nice to have.

Thanks for the tool again.

Steps for Reproduction*

  1. Set up a kubernetes-remote forward in the config.yaml configuration file with labels not available in the namespace specified or a wrong namespace
  2. Start Monday
  3. Blank screen
  4. Hit Ctrl-C to kill the program

Expected behavior:

The program is closed properly.

Actual behavior:

Nothing happens, manually killing the process then put that shell in a "bad" state.

Platforms:

Linux Ubuntu 18.04 / Mac OS

Versions:

Monday 1.0.4

k8s.io libs version are not synchronized

This seems to be the issue:

monday/go.mod

Lines 14 to 16 in fcd9227

k8s.io/api v0.28.4
k8s.io/apimachinery v0.29.0
k8s.io/client-go v0.28.4

error assignment is missing here:

upgradeRoundTripper := spdy.NewRoundTripperWithConfig(spdy.RoundTripperConfig{
TLS: tlsConfig,
Proxier: proxy,
PingPeriod: time.Second * 5,
})

see:
https://github.com/kubernetes/client-go/blob/fb8b7346aacefea5ee2ab2e234afc4451c90c435/transport/spdy/spdy.go#L46-L51

Provide optional args for install script

That will be great to allow the user to optionally provide his aliases path instead of adding the alias in .zshrc or .basrc 👍

Also I think it is safe to call source ~/$profile in order to load the newly added alias 😄

Q: how that diagram has been made

Hey! Sorry not a technical issue, I just wondered how this diagram has been created:
image

Are those just stock icons and some simple app or that was some kind of a studio with lots of stock objects? I'm using OmniGraffle and Sketch for all my diagrams, but sometimes I need something more rich that just a colored rectangle :D

That terminal window frame there is dope. Arrows look like it has been declared programmatically i.e. using dot / postscript.

😅

Issues with creating ip address/assinging port in Linux (arch)

I am having some issues running monday on arch linux, while looking through the code base looks like the networkinterface is being hard coded:
/monday/pkg/proxy/network.go:

const (
	networkInterface = "lo0"
)

my loopback interface is set to lo. I changed the constant and ran into some other issues: ifconfig is being used to, some linux distros dont come with net-tools installed (ip is a better choice) but even with net-tools installed it is running ifconfig incorrectly for linux:

args := []string{"lo0", "alias", ip.String(), "up"}

linux should be args := []string{"lo", ip.String(), "up"}

after making all these changes on my local i am still getting this error:

Unable to find an available IP/Port

Looks like its unable to assign a port to ip addresses ( last byte in addr is always off by one so it never assigns a port) in
/monday/pkg/proxy/network.go
if addr.String() == ip.String()+"/8"

monday should exit after a number of unsuccessful reconnection retries?

Hello!

In pkg/forwarder/forwarder.go, at line 211:

for {
    err := forwarder.Forward(ctx)
    if err != nil {
        time.Sleep(1 * time.Second)
        f.view.Writef("%v\n👓  Forwarder: lost port-forward connection trying to reconnect...\n", err)
    }
}
  • It doesn't seem to ever exit the for loop?
  • This message happens when I forget that monday is running, leave it for the night, my k8s token expires, and there a flood of such messages while my CPU fan goes brrrrr (an unfortunate side effect of the repeated connection attempts catched by security tools installed by my employer on this Mac, apparently)
  • I think a limited number of retries (with possible a longer wait time between retries), followed by a clean exit of monday, would be an acceptable failure mode (at least in my case ;)

What do you think?

howto forward vm pg to localhost

<: &postgres
  name: postgres
  type: ssh
  values:
    remote: [email protected] # SSH <user>@<hostname>
    args:
      - "-i.vagrant/machines/default/virtualbox/private_key"
      - "-p 2222"
    ports:
     - 5432:5432

projects:
 - name: forward-only
   forward:
    - *postgres

I want to do this
ssh -NT -L 5432:127.0.0.1:5432

log:

❌  An error has occured while trying to write host file for application 'postgres' (ip: 127.0.1.1): open /etc/hosts: permission denied
✅  Successfully mapped hostname 'postgres' with IP '127.0.1.1' and port 9401
🔌  Proxifying postgres locally (127.0.1.1:5432) <-> forwarding to 127.0.0.1:9401

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.