Change Magic Contract about sparkmagic HOT 6 CLOSED

@alope107 I'd like to capture some of the widget brainstorming we had the other day.

We could create a drop down menu that lists the endpoints and their languages. You would add/remove endpoints from that menu. That way, we prevent users from having their passwords in clear text.
Furthermore, we could add a button that inserts text into a cell for a given endpoint and language (default vs sql). That way, people don't have to remember the syntax to input into the cell.

What do you think?

from sparkmagic.

I know... this is an old issue. But, still, is there a way to avoid the %%spark at the beginning of each cell?

from sparkmagic.

There's a PySpark kernel these days, can you use that?

from sparkmagic.

I didn't try it and it doesn't seem to be mentioned in the docs. How do PySpark kernel and sparkmagic play together?

from sparkmagic.

See the PySpark notebook in the examples.

from sparkmagic.

I don't have the PySpark kernel available. Probably it is because I installed sparkmagic in a conda-environment and the kernel is not picked by conda?

Moreover, I don't understand in the example where I provide the livy URL for PySpark...

from sparkmagic.