Giter VIP home page Giter VIP logo

spring-cloud-dataflow-ui's Introduction

Spring Cloud Connectors

Spring Cloud Connectors provides a simple abstraction that JVM-based applications can use to discover information about the cloud environment on which they are running, connect to services, and have discovered services registered as Spring beans. It provides out-of-the-box support for discovering common services on Heroku and Cloud Foundry cloud platforms, and it supports custom service definitions through Java Service Provider Interfaces (SPI).

Note
This project is in maintenance mode, in favor of the newer Java CFEnv project. We will continue to release security-related updates but will not address enhancement requests.

Learn more

Build

The project is built with Gradle. The Gradle wrapper allows you to build the project on multiple platforms and even if you do not have Gradle installed; run it in place of the gradle command (as ./gradlew) from the root of the main project directory.

To compile the project and run tests

./gradlew build

To build a JAR

./gradlew jar

To generate Javadoc API documentation

./gradlew api

To list all available tasks

./gradlew tasks

Contributing

Spring Cloud is released under the non-restrictive Apache 2.0 license, and follows a very standard Github development process, using Github tracker for issues and merging pull requests into master. If you want to contribute even something trivial please do not hesitate, but follow the guidelines below.

Sign the Contributor License Agreement

Before we accept a non-trivial patch or pull request we will need you to sign the Contributor License Agreement. Signing the contributor’s agreement does not grant anyone commit rights to the main repository, but it does mean that we can accept your contributions, and you will get an author credit if we do. Active contributors might be asked to join the core team, and given the ability to merge pull requests.

Code of Conduct

This project adheres to the Contributor Covenant code of conduct. By participating, you are expected to uphold this code. Please report unacceptable behavior to [email protected].

Code Conventions and Housekeeping

None of these is essential for a pull request, but they will all help. They can also be added after the original pull request but before a merge.

  • Use the Spring Framework code format conventions. If you use Eclipse you can import formatter settings using the eclipse-code-formatter.xml file from the Spring Cloud Build project. If using IntelliJ, you can use the Eclipse Code Formatter Plugin to import the same file.

  • Make sure all new .java files to have a simple Javadoc class comment with at least an @author tag identifying you, and preferably at least a paragraph on what the class is for.

  • Add the ASF license header comment to all new .java files (copy from existing files in the project)

  • Add yourself as an @author to the .java files that you modify substantially (more than cosmetic changes).

  • Add some Javadocs and, if you change the namespace, some XSD doc elements.

  • A few unit tests would help a lot as well — someone has to do it.

  • If no-one else is using your branch, please rebase it against the current master (or other target branch in the main project).

  • When writing a commit message please follow these conventions, if you are fixing an existing issue please add Fixes gh-XXXX at the end of the commit message (where XXXX is the issue number).

spring-cloud-dataflow-ui's People

Contributors

aclement avatar angular-cli avatar boykoalex avatar claudiahub avatar corneil avatar felipeg48 avatar garyrussell avatar ghillert avatar github-actions[bot] avatar hpoettker avatar ilayaperumalg avatar jnt0r avatar jvalkeal avatar kalvarez2 avatar klopfdreh avatar markfisher avatar markpollack avatar mbogoevici avatar mminella avatar nikitka27 avatar onobc avatar oodamien avatar ronxbysu avatar sabbyanandan avatar snimmagadda1 avatar spring-builds avatar spring-operator avatar sylank avatar trisberg avatar tzolov avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

spring-cloud-dataflow-ui's Issues

Runtime Tab: app-dialog window auto-closes after few seconds

As a user, while I was accessing the app details from the 'Runtime' tab, the dialog window automatically closes after 2s and it is repetitive. The background get greyed out and the only option is to reload the SPA to use the dashboard. This is repeatable in Chrome and Safari.

Implement bulk import of apps

As a developer, I'd like to add the option to bulk import apps from a file, so users can register several apps in 1-go.

Acceptance:

  • bulk import button is available in the Apps tab
  • on-click of the bulk import button, a file upload dialog pops-up to point to a file
  • listed app URIs from within the file can be successfully imported and registered

Add visual distinction between batch jobs and the tasks

As a user, I'd want distinction between the core batch job view vs. the tasks that orchestrate batch jobs, so it is easy to differentiate between the both in the UI.

Acceptance:
The idea is to add one more layer to the Task Execution Tab. The highest level is a Task, a Task may or may not be a Job. Thus, the details view should be different for each.

Error loading runtime modules in CF

As a user, I'm trying to load runtime modules tab, but I'm getting 500 errors on load. The REST call fails with the following in browser console.

GET http://s-c-dataflow-admin.app.navy.springapps.io/runtime/modules?page=0&size=10 500 (Internal Server Error)(anonymous function) @ angular.js:9734sendReq @ angular.js:9538serverRequest @ angular.js:9255processQueue @ angular.js:13075(anonymous function) @ angular.js:13091Scope.$eval @ angular.js:14291Scope.$digest @ angular.js:14107(anonymous function) @ angular.js:14329completeOutstandingRequest @ angular.js:4858(anonymous function) @ angular.js:5231
angular.js:9734 XHR finished loading: GET "http://s-c-dataflow-admin.app.navy.springapps.io/runtime/modules?page=0&size=10".(anonymous function) @ angular.js:9734sendReq @ angular.js:9538serverRequest @ angular.js:9255processQueue @ angular.js:13075(anonymous function) @ angular.js:13091Scope.$eval @ angular.js:14291Scope.$digest @ angular.js:14107(anonymous function) @ angular.js:14329completeOutstandingRequest @ angular.js:4858(anonymous function) @ angular.js:5231
angular.js:11500 Response Error 500 Object {data: Array[1], status: 500, config: Object, statusText: "Internal Server Error"}

Implement Job Executions List

As a developer, I'd like to integrate with the job executions REST endpoint, so I can populate the job execution list page.

Acceptance:

  • i'm able to list the execution times of completed batch jobs
  • job executions in shell match with the UI list

Remove `exec` token from the hints

As a user, I'm trying to register apps with exec token as described in the hits; however, I cannot use them after registration. The exec qualifier is removed from all apps and the hints need corrected.

image

Replace XD with Data Flow

As a developer, I'd like to replace all references of Spring XD with Spring Cloud Data Flow.

Acceptance:
Name changes reflect in admin-ui

Fix links in the 'about' page

As a developer, I'd like to fix all the links in admin-ui that's wrongly mapped with stale ref. guides / docs.

Acceptance:
Links in about and stream/job tabs are updated with relevant links

Adapt to PUI color theme

As a developer, I'd like to adapt admin-ui and flo with PUI color theme, so it inherits consistent look and feel.

Acceptance:

  • PUI's teal color is applied instead of the usual green

Error loading runtime modules in YARN

As a user, I'm trying to load Runtime Modules tab; however, I'm getting an empty page and the browser console includes the following error.

XHR finished loading: GET "http://localhost:9393/runtime/modules?page=0&size=10".(anonymous function) @ angular.js:9734sendReq @ angular.js:9538serverRequest @ angular.js:9255processQueue @ angular.js:13075(anonymous function) @ angular.js:13091Scope.$eval @ angular.js:14291Scope.$digest @ angular.js:14107(anonymous function) @ angular.js:14329completeOutstandingRequest @ angular.js:4858(anonymous function) @ angular.js:5231
angular.js:11500 TypeError: Cannot read property 'moduleStatusResourceList' of undefined
    at containers.js:39
    at processQueue (angular.js:13075)
    at angular.js:13091
    at Scope.$eval (angular.js:14291)
    at Scope.$digest (angular.js:14107)
    at Scope.$apply (angular.js:14395)
    at done (angular.js:9569)
    at completeRequest (angular.js:9756)
    at XMLHttpRequest.requestLoaded (angular.js:9697)(anonymous function) @ angular.js:11500(anonymous function) @ angular.js:8479processQueue @ angular.js:13083(anonymous function) @ angular.js:13091Scope.$eval @ angular.js:14291Scope.$digest @ angular.js:14107Scope.$apply @ angular.js:14395done @ angular.js:9569completeRequest @ angular.js:9756requestLoaded @ angular.js:9697

I launched dataflow:>runtime modules from the shell and I get the expected output.

╔═══════════════════════╤═══════════╤═════════════════════════════╗
║Module Id / Instance Id│Unit Status│No. of Instances / Attributes║
╚═══════════════════════╧═══════════╧═════════════════════════════╝

Create Task Tab

As a developer, I want to create a new tab for Tasks, so I can view the list of tasks.

Replace Jobs with Tasks

  • Replace all visual reference to Jobs with tasks
  • Ensure that that REST calls use the task parameter rather than using job

See http://localhost:9393/modules?type=job

Add logout button & show logged-in username

As a user, I'd like add a logout button, so I can logout from dataflow-ui session.

Acceptance:

  • Logged-in user name is displayed in the top-right corner
  • Logout option is listed when you click the logged-in user name
  • Clicking logout option ends the dataflow-ui session

Spike: Explore options to replace container's view in admin-ui

As a developer, I'd like to study viable alternatives for the existing container view in admin-ui.

Acceptance:

  • At the end of this exercise we should be in a position to decide whether to support this view or not
  • If we do decide to support, we should have design specs on what it means for different SPI variants and what should this view include

Create Task Definitions Tab

As a developer, I want to create a new Task Definitions tab, so I can view a list of the module definitions in the UI.

Add SPI type and version in 'about' section

As a user, I'd like to see the version and SPI type in the about section, so I can confirm which build of admin-ui I'm currently using.

Acceptance:
The requirement for REST-API to include SPI type and the corresponding release revision is documented

Task deployment page is not loading

As a user, I'm trying to load Job, Job Deployment, and Job Executions page, but I'm seeing an error (Error fetching data. Is the XD server running?) instead.

Acceptance:
REST API's are wired correctly and the pages load with expected results

Job modules page wouldn't load

As a user, I'm trying to load Job - Modules page in admin-ui, but I'm seeing exceptions in console and the page wouldn't load.

Failed to convert value of type 'java.lang.String' to required type 'org.springframework.cloud.dataflow.core.ArtifactType'; nested exception is org.springframework.core.convert.ConversionFailedException: Failed to convert from type java.lang.String to type @org.springframework.web.bind.annotation.RequestParam org.springframework.cloud.dataflow.core.ArtifactType for value 'job'; nested exception is java.lang.IllegalArgumentException: No enum constant org.springframework.cloud.dataflow.core.ArtifactType.job 

Cleanup build warnings

As a developer, I'd like to cleanup build warnings. See below for some examples. Perhaps this could be OS specific.

fsevents
[INFO] > node-pre-gyp install --fallback-to-build
[INFO]
[INFO] [fsevents] Success: "/Users/sanandan/CodeSpaces/nextgen/spring-cloud-dataflow-ui/ui/node_modules/karma/node_modules/chokidar/node_modules/fsevents/lib/binding/Release/node-v14-darwin-x64/fse.node" is installed via remote
[ERROR] npm WARN engine [email protected]: wanted: {"node":">=4.0"} (current: {"node":"0.12.2","npm":"2.9.1"})
[INFO]
[INFO] > [email protected] install /Users/sanandan/CodeSpaces/nextgen/spring-cloud-dataflow-ui/ui/node_modules/protractor/node_modules/selenium-webdriver/node_modules/ws/node_modules/bufferutil
[INFO] > node-gyp rebuild
[INFO]
[ERROR] xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance
[ERROR]
[ERROR] xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance
[ERROR]
[INFO]   CXX(target) Release/obj.target/bufferutil/src/bufferutil.o
[INFO]   SOLINK_MODULE(target) Release/bufferutil.node
[INFO]   SOLINK_MODULE(target) Release/bufferutil.node: Finished
[INFO]
[INFO] > [email protected] install /Users/sanandan/CodeSpaces/nextgen/spring-cloud-dataflow-ui/ui/node_modules/protractor/node_modules/selenium-webdriver/node_modules/ws/node_modules/utf-8-validate
[INFO] > node-gyp rebuild
[INFO]
[ERROR] xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance
[ERROR]
[ERROR] xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance
[ERROR]

Job executions view wouldn't load

As a user, I'm trying to list all the batch-job (as task) executions; however, the list view wouldn't load and browser console includes the following error.

image

Cleanup Task "Apps" tab

As a developer, I'd like to change the "coordinates" column with "description" of the task application.

image

Problem while creating new stream from UI in IE11

I was trying to patch spring-cloud-dataflow-ui-1.0.0.M2 version with spring-cloud-dataflow-server-cloudfoundry-1.0.0.M2,,as per instructions at https://docs.pivotal.io/spring-cloud-data-flow/installing-scdf.html. but did not work.
Then I had patched spring-cloud-dataflow-ui-1.0.0.M3 with spring-cloud-dataflow-server-cloudfoundry-1.0.0.M2.. and it worked.

So now flo UI up and running I see few problems -

  1. Creating new stream from UI - when you drag drop time source and log sink to create tick tock stream...create stream pop-up window stays there doing nothing.. no logs on dataflow-server
    Same stream I can create from dataflow-shell.
    Is there any issue patching flo with dataflow-server-cloudfoundry-1.0.0.M2?

  2. New stream created (from shell) does not get reflected in runtime or stream definition unless browser cache is cleaned.

Problem creating streams in UI when using destinations

These streams can be built just fine in the UI but upon pressing the create stream button there is some code that incorrectly rebuilds the stream text that is going to be used for the actual definitions. To see the problem open the UI and enter this block of streams:

:foo > log
http > :foo
:a > transform > :b

If you then press the create stream button it will show some proposed stream definitions in the popup dialog, each of the above will be missing a ':' or a '>'

Dashboard won't load

As a user, I'm trying to launch the dashboard; however, I only see the loading... prompt and the SPA never renders. Browser console includes the attached require.js timeout error. Similar errors with Local and PCF dataflow-server variants.

Note: This is noticed sporadically and it is not consistently repeatable. Perhaps there's some default timeout setting that needs bumped to allow backend service calls to complete in reasonable time?

image

Add Task Execution Details Page

It would be nice to see the details of a Task Execution. E.g. Right now you cannot see the the parameters used to launch the task.

Implement Job Deployment

As a developer, I'd like to invoke the job deployment REST endpoint, so I can list all the jobs that are deployed and ready to be launched.

Enable FieldValueCounter widgets

As a user, I'd like to use the FVC widgets from the Analytics tab, so I can explore counts persisted by field-name criteria included in the streams.

Error loading analytics tab

Seeing the following 404s on tab load:

GET http://localhost:9393/metrics/aggregate-counters 404 (Not Found)(anonymous function) @ angular.js:9734sendReq @ angular.js:9538serverRequest @ angular.js:9255processQueue @ angular.js:13075(anonymous function) @ angular.js:13091Scope.$eval @ angular.js:14291Scope.$digest @ angular.js:14107Scope.$apply @ angular.js:14395(anonymous function) @ angular.js:16121completeOutstandingRequest @ angular.js:4858(anonymous function) @ angular.js:5231
angular.js:9734 GET http://localhost:9393/metrics/field-value-counters 404 (Not Found)

UI - Change `Admin` -> `Dashboard`

Since the Data Flow Server is changed from admin to server now, wherever we refer the Data Flow Server, it is better to rename the UI fragments to Dashboard.

Acceptance:

  • UI URI is changed from /admin-ui to /dashboard

Runtime and Stream tab results are empty

As a user, I deployed the ticktock stream successfully, but I cannot see the stream listing in the UI. The same issue is observed with the runtime tab as well. However, I do see the results when hitting the respective REST-APIs directly. Following requests result with runtime and stream listing correctly.

http://dataflow-server.navy.springapps.io/runtime/modules
http://dataflow-server.navy.springapps.io/streams/definitions

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.