Toshifumi Tsutsumi's Projects
The platform fundament of Airbyte powering all your ELT pipelines. Please file issues in https://github.com/airbytehq/airbyte
Send events to Google Chat webhook URL on changing AWS Step Functions execution status
Run AWS Glue Crawler and check the status by AWS Step functions.
Refresh Amazon QuickSight SPICE Datasets
Apache Beam is a unified programming model for Batch and Streaming
Diff daily changes by BigQuery INFORMATION_SCHEMA.PARTITIONS records.
Save images continuously with a webcam
Change data capture from Amazon RDS to Google BigQuery
AWS CloudFormation stack drift detector
Change data capture from MySQL to Google Cloud Pub/Sub by Debezium Server.
Find target files from zip files
Executes commands on multiple container images and outputs results to standard output.
Miamizer retrieves AWS IAM resources from AWS CloudFormation Stack and outputs as DSL files for codenize-tools/miam.
AWS Batch on AWS Fargate, calling from AWS Step Functions.
Google Cloud Dataflow for 'Exactly-Once' streaming insertion, from Google Cloud Pub/Sub to Google BigQuery.
Multi-cloud Queuing Hub for Python
Unpacking ModuleNotFoundError
Sample codes for PyCon JP 2021, "Introduction to Python logging".
Ruby client for Google Cloud Translation
Detect text in screenshots of "Ring Fit Adventure for Nintendo Switch" posted on twitter and save the play record to Google BigQuery.
Cost estimator for Google BigQuery
A data lineage tool detects table dependencies from rendered SQL statements.
A web application rendering table dependency graph with tosh2230/stairlight, using Graphviz, Streamlit and Google Cloud Run.