pysql-beam-org / pysql-beam Goto Github PK

Hi,
It's not a bug but had a question and did not find any link for raising a question. Does this library also support AlloyDB which is an extension of Postgre-sql? I could not find it in the documentation so, wanted to confirm

https://github.com/yesdeepakverma/pysql-beam/blob/dbdfb5570d0c9ebb0eb88d133a2e2413d0b886d2/pysql_beam/sql_io/sql.py#L243

Looks like the closing curly bracket is outside the closing double quote. This is causing import errors:

from pysql_beam.sql_io.sql import ReadFromSQL
  File "/usr/local/lib/python3.8/site-packages/pysql_beam/sql_io/sql.py", line 243
    logging.info(f"pagination query do fn wrapper:{kwargs['wrapper']"})
                                                                     ^
 SyntaxError: closing parenthesis '}' does not match opening parenthesis '('

Hi,

You have a typo on documentation, on reading example you are using databse as argument of ReadFromSQL.

Regards!

Hi guys,

pip install not working with tarball as requirement.txt file is not present in package

Can u fix this ASAP

I tried to run script with passing table name only, which resulted in crash with error

File "/home/ameen/.virtualenvs/data-warehousing-exploration/lib/python3.8/site-packages/pysql_beam/sql_io/sql.py", line 242, in process source.query = source.query.strip(";") AttributeError: 'NoneType' object has no attribute 'strip' [while running 'Read from postgres/ReadFromSQL/SplitQuery']

Hi, after doing CustomSQLRead, how do you get the schema of the queried data?

need to turn that into Avro format, and first I will need the Schema of the data. Thank you so much!

https://github.com/yesdeepakverma/pysql-beam/blob/master/pysql_beam/sql_io/sql.py#L429

Is this a potential bug? If I want schema_only, should it yield schema instead of record?