Sanjay H.
Mid-Level Azure Data Engineer
Open to offersNew to PlatformAbout
Sanjay H. is a seasoned Azure Data Engineer with 3.8 years of experience in designing and optimizing scalable data pipelines on the Azure cloud platform. Specializing in building end-to-end ETL/ELT processes, he has leveraged tools such as Azure Data Factory, Azure Databricks, and Delta Lake to handle large-scale data processing and advanced analytics. In his recent role at Wipro, Sanjay executed high-volume data ingestion pipelines, processing 2-3 TB of data daily for near real-time supply chain analytics. His adept use of Medallion architecture and performance tuning reduced pipeline runtime by 30%. Prior experience at SPACE MS Pvt. Ltd. involved similar ETL/ELT developments and data warehouse modeling. Sanjay holds a Master of Technology from Dayananda Sagar College of Engineering, passionately optimizing data pipelines for enhanced business performance.
Experience
Senior Software Engineer (Data Engineering – Azure)
Wipro · 2025 — 2025Designed and executed scalable ETL pipelines utilizing Azure Data Factory for data ingestion from APIs, ERP systems, and databases into Azure Data Lake Storage Gen2. Developed complete data pipelines employing Azure Databricks (PySpark) and Delta Lake following the Medallion architecture. Processed 2–3 TB of data daily to support near real-time supply chain analytics. Applied incremental load strategies with watermark logic and CDC, optimized Spark jobs with broadcast joins and partition pruning, and implemented Delta Lake optimization techniques to enhance performance. Automated ingestion workflows via REST API integration and constructed monitoring dashboards using Azure Monitor and Log Analytics. Conducted root causeDesign Executive (Data Engineering – Azure)
SPACE MS Pvt. Ltd. · 2021 — 2024Created and managed ETL/ELT pipelines with Azure Data Factory facilitating multi-source data ingestion. Developed PySpark transformations in Azure Databricks for processing large volumes of records. Implemented incremental load processes and CDC to enhance data refresh efficiency while designing data warehouse models utilizing star and snowflake schemas. Improved SQL query performance through indexing and query tuning, addressed data skew challenges, and integrated various data sources into centralized pipelines. Ensured data validation and consistency across systems.
Skills & Expertise
Education
- Master of TechnologyDayananda Sagar College of Engineering · — — 2020
- Bachelor of TechnologyVisvesvaraya Technological University · — — 2018
Interested in this professional?
Sign in as an employer to save this profile or invite Sanjay H. to a job.
Sign in as an employer