graphistry / graphbi Goto Github PK

• get api key
• upload
• make url

• Example of using Python widget on sample data against a free Graphistry Hub account via PyGraphistry (pip install graphistry)

• Instructions for Leo / user to duplicate the flow

• on git tag (git tag 0.1.2) trigger a build
• ensure build uses that tag for version numbers: UI, pbi file
• save generated pbiviz as part of github tag downloads
• include version badge + link to tag download page on readme

React component does not go beyond loading state:

• parent creates iframe
• iframe signals ready (load event + init postMessage)
• graphistryjs receives init
• unclear if graphistryjs successfully posts ready / iframe receives it: no error

table names passed from powerbi are showing up as overly-long field names

• maybe a toggle for whether to strip?
• strip in some areas but not others?

may be an edge-only issue, or when embedded some reason

Several user errors are currently not propagated to the UI:

• bad domain
• bad username/password

These may go away with SSO...

Histograms and inspector panel are not appearing in powerbi embedded iframes. Unclear if powerbi deskop or web reports; embedded react standalone seems fine.

Start with honeypot

Setup:

• powerbi reports online account
• windows wsl2 ubuntu for nodejs dev
• checkout graphbi repo and build "graphistry for powerbi" component
• import component in powerbi reports and create a viz (can use a free graphistry hub account)

Filling in src/dst properties does not actually make them appear in the UI

When multiple fields are put in for the src/dst, only the first is used

Ex: src = [ VP, Region ] should cause nodes like (Jane, USA) but instead only creates node Jane

On loading les mis:

Access to resource at 'https://hub.graphistry.com/streamgl/pipe?id=b17e851bc74e428baef22091d45faaea' from origin 'null' has been blocked by CORS policy: No 'Access-Control-Allow-Origin' header is present on the requested resource.

It seems that GET /pipe (=tick?) gives a 200, but the browser rejects because it was a sec-fetch-mode: cors, origin: null call with no Access-Control-Allow-Origin: null response header. In contrast, POST /open, POST /read, POST /play respond with Access-Control-Allow-Origin: null.

Network:

GENERAL
Request URL: https://hub.graphistry.com/streamgl/pipe?id=b17e851bc74e428baef22091d45faaea
Request Method: GET
Status Code: 200 
Referrer Policy: strict-origin-when-cross-origin

RESPONSE HEADERS
cache-control: no-cache
content-security-policy: default-src 'self';base-uri 'self';block-all-mixed-content;font-src 'self' https: data:;frame-ancestors 'self';img-src 'self' data:;object-src 'none';script-src 'self';script-src-attr 'none';style-src 'self' https: 'unsafe-inline';upgrade-insecure-requests
content-type: text/event-stream;charset=UTF-8
date: Mon, 13 Dec 2021 07:06:48 GMT
expect-ct: max-age=0
referrer-policy: no-referrer
server: Caddy
server: nginx
strict-transport-security: max-age=15552000; includeSubDomains
x-content-type-options: nosniff
x-dns-prefetch-control: off
x-download-options: noopen
x-frame-options: SAMEORIGIN
x-permitted-cross-domain-policies: none
x-xss-protection: 0

REQUEST HEADERS
:authority: hub.graphistry.com
:method: GET
:path: /streamgl/pipe?id=b17e851bc74e428baef22091d45faaea
:scheme: https
accept: text/event-stream
accept-encoding: gzip, deflate, br
accept-language: en-US,en;q=0.9
cache-control: no-cache
dnt: 1
origin: null
pragma: no-cache
sec-ch-ua: " Not A;Brand";v="99", "Chromium";v="96", "Google Chrome";v="96"
sec-ch-ua-mobile: ?0
sec-ch-ua-platform: "macOS"
sec-fetch-dest: empty
sec-fetch-mode: cors
sec-fetch-site: cross-site
user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36

In github repo, DEVELOP.md for how to build & run JS custom visual

Ex:

Some reason the bool properties are showing up and impacting layout, but numeric properties are not showing up in the panel and thus not impacting layout, ex, gravity ( https://github.com/graphistry/graphbi/search?q=gravity : strength of center of gravity in middle of screen ~= blackhole vortex)

• config.LayoutGravity = this.visualSettings.layoutSetting.gravity;
• but some reason not showing up in the powerbi panel either
• in this particular case, also, gravity missing in extraOpts at

  graphbi/pbiviz/src/components/Graphistry.tsx

  Line 37 in 704be2e

  const extraOpts = {

• should appear in the url of the generated visualization as &gravity=...

See also: https://hub.graphistry.com/docs/api/1/rest/url/#urloptions

vs

• Unaggregated view: Should be possible, Mike should discuss w/ Meagan in the Slack
• How to do an unsigned widget packaging?: .pbviz should be locally installed by user + by org admin so should be fine for now: let's generate and confirm w/ user
• how long to get approval: ~Months for appsource. Leo will network w/ MS (appsource) and internally at customer (org admin.)
• getting pygraphistry approved on powerbi app source: First should do feasibility studies. Unlikely due to outcalls being explicitly prohibited, but may be fine via org admins in practice or after networking.

See customer email **Internal** crash in PBIX Desktop

Likely around edge properties

• password field: show as *** <-- not possible
• text: "Graphistry Url" => "Graphistry Server"
• URL: auto-append to iframe url: ...&splashAfter=true
• URL: auto-append to iframe url: ...&menu=false <- default
• menu toggle: menu=true vs menu=false
• menu toggle: splashAfter
• dataset id: allow entry of dataset id, which skips upload and just shows iframe/link . server/username/pass can be empty in this case.

re:url params, for reference: https://hub.graphistry.com/docs/api/1/rest/url/#urloptions

The powerbi CI seems to be failing due to some lint and likely subsequent test errors: https://github.com/graphistry/graphbi/actions

Let's fix those as a warmup!

• Upload via REST API
• Visualize via iframe

See https://github.com/graphistry/graphbi/wiki/PowerBI-Custom-Visual-MVP

This refers to the code

• run daily scans for critical-level vulns
• status badge on repo

In pbiviz.json, the guid should not be tableExample04E649621A964F0491F29D514385D7FC

• rename to graphistry
• research whether we need to include the numeric part: where does it come from?

In the generated bundle, it already includes the version (nameGUID.version.pbiviz) so we are good there

Either a custom video or one already on youtube that shows in ~30s-3min how to install a .pbviz and have it show up in your visuals panel

See https://github.com/graphistry/graphbi/wiki/PowerBI-Custom-Visual-MVP

This refers to the an installable artifact

We need to figure out for embedded cross-origin react->iframe apps that allow user to login, upload, and view

Requires investigation & planning!

User was inadvertently using an old version..

• Create & push a git tag of the version (ex: 0.1.1)
• During the build, use the current git tag to:
• ... in the js console, during load, print a friendly message + pbi version number
• ... in the pbi ui, such as the settings panel or the component name when adding, maybe there is a way to get the version number somewhere in the UI (so no code skills needed)

To simplify development, we should create a powerbi dataset good for testing:

• multiple node attributes and of different types
• multiple edge attributes and of different types
• several node/edge attributes good for metrics

Ideally something fun and reusable by our users, like log activity data or transactions from some interesting system (bitcoin, ...), and potentially augmented for testing purposes

We can work with meagan on the process for this

• stuck fetching
• css container different?
• panel settings dispapear on load, breaking

30s-3min video of putting in your creds into the graphistry component and ensuring they work