spring-cloud / spring-cloud-dataflow-ui Goto Github PK
View Code? Open in Web Editor NEWThis repo provides the Dashboard application of Spring Cloud Data Flow
Home Page: https://dataflow.spring.io/
License: Apache License 2.0
This repo provides the Dashboard application of Spring Cloud Data Flow
Home Page: https://dataflow.spring.io/
License: Apache License 2.0
As a developer, I want to be able to see a list of task modules I can run.
As a user, I'd like to use the FVC widgets from the Analytics
tab, so I can explore counts persisted by field-name criteria included in the streams.
As a developer, I'd like to adapt admin-ui
and flo
with PUI color theme, so it inherits consistent look and feel.
Acceptance:
These streams can be built just fine in the UI but upon pressing the create stream
button there is some code that incorrectly rebuilds the stream text that is going to be used for the actual definitions. To see the problem open the UI and enter this block of streams:
:foo > log
http > :foo
:a > transform > :b
If you then press the create stream button it will show some proposed stream definitions in the popup dialog, each of the above will be missing a ':' or a '>'
Since the Data Flow Server is changed from admin
to server
now, wherever we refer the Data Flow Server, it is better to rename the UI fragments to Dashboard
.
Acceptance:
/admin-ui
to /dashboard
As a developer, I want to create a new tab for Tasks
, so I can view the list of tasks.
As a developer I want to be able to create a task definition.
As a user, I'm trying to load Runtime Modules
tab; however, I'm getting an empty page and the browser console includes the following error.
XHR finished loading: GET "http://localhost:9393/runtime/modules?page=0&size=10".(anonymous function) @ angular.js:9734sendReq @ angular.js:9538serverRequest @ angular.js:9255processQueue @ angular.js:13075(anonymous function) @ angular.js:13091Scope.$eval @ angular.js:14291Scope.$digest @ angular.js:14107(anonymous function) @ angular.js:14329completeOutstandingRequest @ angular.js:4858(anonymous function) @ angular.js:5231
angular.js:11500 TypeError: Cannot read property 'moduleStatusResourceList' of undefined
at containers.js:39
at processQueue (angular.js:13075)
at angular.js:13091
at Scope.$eval (angular.js:14291)
at Scope.$digest (angular.js:14107)
at Scope.$apply (angular.js:14395)
at done (angular.js:9569)
at completeRequest (angular.js:9756)
at XMLHttpRequest.requestLoaded (angular.js:9697)(anonymous function) @ angular.js:11500(anonymous function) @ angular.js:8479processQueue @ angular.js:13083(anonymous function) @ angular.js:13091Scope.$eval @ angular.js:14291Scope.$digest @ angular.js:14107Scope.$apply @ angular.js:14395done @ angular.js:9569completeRequest @ angular.js:9756requestLoaded @ angular.js:9697
I launched dataflow:>runtime modules
from the shell and I get the expected output.
╔═══════════════════════╤═══════════╤═════════════════════════════╗
║Module Id / Instance Id│Unit Status│No. of Instances / Attributes║
╚═══════════════════════╧═══════════╧═════════════════════════════╝
As a user, I'm trying to launch the dashboard; however, I only see the loading...
prompt and the SPA never renders. Browser console includes the attached require.js
timeout error. Similar errors with Local and PCF dataflow-server variants.
Note: This is noticed sporadically and it is not consistently repeatable. Perhaps there's some default timeout setting that needs bumped to allow backend service calls to complete in reasonable time?
As a user, I'm trying to load Job, Job Deployment, and Job Executions page, but I'm seeing an error (Error fetching data. Is the XD server running?) instead.
Acceptance:
REST API's are wired correctly and the pages load with expected results
As a developer, I'd like to explore options to expose module stats (i.e: instances running vs. requested) in order to back Flo color-codes in the Stream
list page.
As a developer, I'd like to add docs for each UI tabs.
As a user, I'd like add a logout button, so I can logout from dataflow-ui session.
Acceptance:
task
parameter rather than using job
See http://localhost:9393/modules?type=job
It would be nice to see the details of a Task Execution. E.g. Right now you cannot see the the parameters used to launch the task.
As a developer, I'd like to fix all the links in admin-ui
that's wrongly mapped with stale ref. guides / docs.
Acceptance:
Links in about
and stream/job tabs are updated with relevant links
From @ghillert on March 31, 2016 20:38
This issue depends on spring-cloud/spring-cloud-dataflow#482
In order to provide a better single-sign-on experience, the UI-login process should be OAuth based, so that when the user is already logged into the OAuth server, (s)he shall not be required to re-enter the username and password.
Copied from original issue: spring-cloud/spring-cloud-dataflow#483
See also: spring-cloud/spring-cloud-dataflow#503
As a developer, I'd like to invoke the job deployment
REST endpoint, so I can list all the jobs that are deployed and ready to be launched.
As a developer, I'd like to remove unused code and refactor old terminology references. There are still several references to xd, admin, and containers.
As a developer, I want to be able to view my task executions.
As a developer, I'd like to integrate with the job executions
REST endpoint, so I can populate the job execution list page.
Acceptance:
shell
match with the UI listAs a developer, I'd like to add the option to bulk import apps from a file, so users can register several apps in 1-go.
Acceptance:
Apps
tabBreaking change from XD that slipped through. On the Step Execution Details page, the values of the Step Execution Context are not rendered correctly.
Under the Run Modules
tab, show the information from the runtime modules
command:
As a user, while I was accessing the app details from the 'Runtime' tab, the dialog window automatically closes after 2s and it is repetitive. The background get greyed out and the only option is to reload the SPA to use the dashboard. This is repeatable in Chrome and Safari.
As a user, I deployed the ticktock
stream successfully, but I cannot see the stream listing in the UI. The same issue is observed with the runtime
tab as well. However, I do see the results when hitting the respective REST-APIs directly. Following requests result with runtime and stream listing correctly.
http://dataflow-server.navy.springapps.io/runtime/modules
http://dataflow-server.navy.springapps.io/streams/definitions
As a developer, I'd like to study viable alternatives for the existing container
view in admin-ui.
Acceptance:
As a developer, I'd like to replace all references of Spring XD with Spring Cloud Data Flow.
Acceptance:
Name changes reflect in admin-ui
As a developer, I want to create a new Task Definitions
tab, so I can view a list of the module definitions in the UI.
As a user, I'd like to see the version and SPI type in the about
section, so I can confirm which build of admin-ui I'm currently using.
Acceptance:
The requirement for REST-API to include SPI type and the corresponding release revision is documented
Several scripts inside the dataflow UI has references to XD as we moved some of the changes from XD admin UI client. It is better we rename them to use dataflow
instead.
As a developer, I'd like to cleanup build warnings. See below for some examples. Perhaps this could be OS specific.
fsevents
[INFO] > node-pre-gyp install --fallback-to-build
[INFO]
[INFO] [fsevents] Success: "/Users/sanandan/CodeSpaces/nextgen/spring-cloud-dataflow-ui/ui/node_modules/karma/node_modules/chokidar/node_modules/fsevents/lib/binding/Release/node-v14-darwin-x64/fse.node" is installed via remote
[ERROR] npm WARN engine [email protected]: wanted: {"node":">=4.0"} (current: {"node":"0.12.2","npm":"2.9.1"})
[INFO]
[INFO] > [email protected] install /Users/sanandan/CodeSpaces/nextgen/spring-cloud-dataflow-ui/ui/node_modules/protractor/node_modules/selenium-webdriver/node_modules/ws/node_modules/bufferutil
[INFO] > node-gyp rebuild
[INFO]
[ERROR] xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance
[ERROR]
[ERROR] xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance
[ERROR]
[INFO] CXX(target) Release/obj.target/bufferutil/src/bufferutil.o
[INFO] SOLINK_MODULE(target) Release/bufferutil.node
[INFO] SOLINK_MODULE(target) Release/bufferutil.node: Finished
[INFO]
[INFO] > [email protected] install /Users/sanandan/CodeSpaces/nextgen/spring-cloud-dataflow-ui/ui/node_modules/protractor/node_modules/selenium-webdriver/node_modules/ws/node_modules/utf-8-validate
[INFO] > node-gyp rebuild
[INFO]
[ERROR] xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance
[ERROR]
[ERROR] xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance
[ERROR]
As a developer, I'd like to invoke the job execution by job_execution_id
REST endpoint, so I can list all the relevant details for review.
See spring-cloud/spring-cloud-dataflow#640
If the task support is disabled, the UI should not show task/job related components.
As a user, I'm trying to load runtime modules
tab, but I'm getting 500
errors on load. The REST call fails with the following in browser console.
GET http://s-c-dataflow-admin.app.navy.springapps.io/runtime/modules?page=0&size=10 500 (Internal Server Error)(anonymous function) @ angular.js:9734sendReq @ angular.js:9538serverRequest @ angular.js:9255processQueue @ angular.js:13075(anonymous function) @ angular.js:13091Scope.$eval @ angular.js:14291Scope.$digest @ angular.js:14107(anonymous function) @ angular.js:14329completeOutstandingRequest @ angular.js:4858(anonymous function) @ angular.js:5231
angular.js:9734 XHR finished loading: GET "http://s-c-dataflow-admin.app.navy.springapps.io/runtime/modules?page=0&size=10".(anonymous function) @ angular.js:9734sendReq @ angular.js:9538serverRequest @ angular.js:9255processQueue @ angular.js:13075(anonymous function) @ angular.js:13091Scope.$eval @ angular.js:14291Scope.$digest @ angular.js:14107(anonymous function) @ angular.js:14329completeOutstandingRequest @ angular.js:4858(anonymous function) @ angular.js:5231
angular.js:11500 Response Error 500 Object {data: Array[1], status: 500, config: Object, statusText: "Internal Server Error"}
As a developer, I want to be able to launch a task from the UI
As a user, I'm trying to load Job - Modules page in admin-ui, but I'm seeing exceptions in console and the page wouldn't load.
Failed to convert value of type 'java.lang.String' to required type 'org.springframework.cloud.dataflow.core.ArtifactType'; nested exception is org.springframework.core.convert.ConversionFailedException: Failed to convert from type java.lang.String to type @org.springframework.web.bind.annotation.RequestParam org.springframework.cloud.dataflow.core.ArtifactType for value 'job'; nested exception is java.lang.IllegalArgumentException: No enum constant org.springframework.cloud.dataflow.core.ArtifactType.job
As a user, I'd want distinction between the core batch
job view vs. the tasks
that orchestrate batch jobs, so it is easy to differentiate between the both in the UI.
Acceptance:
The idea is to add one more layer to the Task Execution Tab. The highest level is a Task
, a Task
may or may not be a Job
. Thus, the details view should be different for each.
I was trying to patch spring-cloud-dataflow-ui-1.0.0.M2 version with spring-cloud-dataflow-server-cloudfoundry-1.0.0.M2,,as per instructions at https://docs.pivotal.io/spring-cloud-data-flow/installing-scdf.html. but did not work.
Then I had patched spring-cloud-dataflow-ui-1.0.0.M3 with spring-cloud-dataflow-server-cloudfoundry-1.0.0.M2.. and it worked.
So now flo UI up and running I see few problems -
Creating new stream from UI - when you drag drop time source and log sink to create tick tock stream...create stream pop-up window stays there doing nothing.. no logs on dataflow-server
Same stream I can create from dataflow-shell.
Is there any issue patching flo with dataflow-server-cloudfoundry-1.0.0.M2?
New stream created (from shell) does not get reflected in runtime or stream definition unless browser cache is cleaned.
Seeing the following 404s on tab load:
GET http://localhost:9393/metrics/aggregate-counters 404 (Not Found)(anonymous function) @ angular.js:9734sendReq @ angular.js:9538serverRequest @ angular.js:9255processQueue @ angular.js:13075(anonymous function) @ angular.js:13091Scope.$eval @ angular.js:14291Scope.$digest @ angular.js:14107Scope.$apply @ angular.js:14395(anonymous function) @ angular.js:16121completeOutstandingRequest @ angular.js:4858(anonymous function) @ angular.js:5231
angular.js:9734 GET http://localhost:9393/metrics/field-value-counters 404 (Not Found)
As a developer, I need to adapt dashboard with SCDF's Teal logo.
As a developer, I'd like to replace all Job(s) references with Task(s).
Acceptance:
All references are updated to Task
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.