avnyadav Goto Github PK

I design and implement data solutions using Microsoft Azure services, such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. With expertise in data modeling, ETL pipelines, and database administration, I ensure data quality and reliability while adhering to industry best practices. I am a collaborative problem-solver who can work with stakeholders to deliver scalable and secure data solutions on the Azure cloud platform.

• Programing Language: (Python, C#, C++, PySpark) | Databases (SQL Server, MongoDB and MySQL)
• Distributed Framework (Spark, Hadoop, Hive, Kafka) | Workflow Management(Airflow and IBM Tivoli)
• Azure Services: Azure Data Factory, Azure Data bricks, Azure Data Lake, Azure blob Storage, Azure SQL DB, Delta Lake
• AWS Services (S3 bucket, MWAA, Code Pipeline, AWS Lambda, ECS, ECR, Redshift and EC2)
• Build Tools & Containers (Docker and Kubernetes)
• Code Management and Documentation (Git, Azure Develops, Circle CI, and GitHub Action)
• Azure Services (Azure Storage, App Service and Azure Machine Learning Studio)
• Machine Learning (Regression, Classification, Clustering, Artificial Neural Network, Convolutional Neural
• Network, Recurrent Neural Network, Encoder and Decoder, Word Embedding)
• Machine Learning Framework and Libraries (Pandas, Numpy, Sklearn, PySpark, Pytorch, TensorFlow, Matplotlib, Seaborn, TFX.)

Currently learning: Azure HD Insight, Azure Synapse Analytics

Planning to be certified as Azure Data Engineer as soon as possible.