socialpoint-labs / sqlbucket Goto Github PK

Small refacto plus new little features to add in the next few days:

• Add connection variables.
• Renaming variables sources (env => global).
• Documentation on variables, and distinction between the different ways to set them.
  • Distinction between global and project variables.
  • Distinction between variables submitted and variables set in config.
• Add a connection_query attribute in config, referencing an SQL to be ran before ETL, regardless of the steps (typically for setting up search path).

Hey,

I tried running a job with params -fs 1 -ts 2 and I got the first AND second query. Don't think this is intended, at least not according to the cli documentation. Am I doing something wrong?

Hi,

Does this project support Oracle connection? Or how can I set the connection?

I set connections as below
connections = {'conn': 'oracle+cx_oracle://name:passwd@ip:port/dbname'}

When I run the project , got error "TypeError: Invalid argument(s) 'isolation_level' sent to create_engine(), using configuration OracleDialect_cx_oracle/NullPool/Engine. Please check that the keyword arguments are appropriate for this combination of components.
"
Seems the isolation_level is fixed to "AUTOCOMMIT" in create_connection(runners.py).

Thanks