PyHive and Transport mode - HTTP about pyhive HOT 13 OPEN

I'm very interested into this functionality too as I must start using the HTTP mode for Apache Knox.
Is it something that can be planned ?

from pyhive.

Any updates on HTTP support?

from pyhive.

Any timeline/priority when this will be available

from pyhive.

Please add HTTP support. As i am trying to use the code piece in prod environment where other teams are also connecting through JDBC, pyspark; i am not able to set it binary if that makes other connections not work.

from pyhive.

+1 .. Can you please add Http Support for Pyhive

from pyhive.

Sorry, there is no code for HTTP mode.

from pyhive.

Me too, I must use Apache Knox to authenticate with Hive. Is this currently possible with PyHive?

from pyhive.

Likewise, I'd also be interested in this functionality!

from pyhive.

+1

from pyhive.

Hi all, just created a PR to add support for Thrift connections over HTTP transport. You can follow its progress here: #325

from pyhive.

Our server is configured with hive.server2.transport.mode set to HTTP. When switching to binary , everything seems to work perfectly. Is there a way to enable PyHive to work with HTTP transport mode ?

So as an end user vs someone configuring the Hive datastore, this is likely not possible via my connection string.

e.g.

con = hive.Connection(host = hive_host, port = 10000, username = hive_username, auth='NOSASL')
Docstring for Hive Connection:

Init signature:
hive.Connection(
    host=None,
    port=None,
    username=None,
    database='default',
    auth=None,
    configuration=None,
    kerberos_service_name=None,
    password=None,
    thrift_transport=None,
)
Docstring:      Wraps a Thrift session
Init docstring:
Connect to HiveServer2

:param host: What host HiveServer2 runs on
:param port: What port HiveServer2 runs on. Defaults to 10000.
:param auth: The value of hive.server2.authentication used by HiveServer2.
    Defaults to ``NONE``.
:param configuration: A dictionary of Hive settings (functionally same as the `set` command)
:param kerberos_service_name: Use with auth='KERBEROS' only
:param password: Use with auth='LDAP' or auth='CUSTOM' only
:param thrift_transport: A ``TTransportBase`` for custom advanced usage.
    Incompatible with host, port, auth, kerberos_service_name, and password.

The way to support LDAP and GSSAPI is originated from cloudera/Impyla:
https://github.com/cloudera/impyla/blob/255b07ed973d47a3395214ed92d35ec0615ebf62
/impala/_thrift_api.py#L152-L160
File:           ~/miniconda3/envs/spark_2_4_4/lib/python3.8/site-packages/pyhive/hive.py
Type:           type
Subclasses:   

from pyhive.

@pauldevos , Thanks a lot for the above snippet. Can we log all the HTTP headers in spark thrift server ?

from pyhive.

Hi, are there any updates on this?

from pyhive.