Post a Job Free
0 viewsTalent
balam S. — Mid-Level Azure Data Engineer from India

balam S.

Mid-Level Azure Data Engineer

India 2-3 years
Open to offersNew to Platform
Languages
EnglishTelugu
Video Introduction
No video introduction yet
The candidate has not added a video.
Contact information and social networks are private. Connect to unlock.
Hidden

About

B. Sahithya is a seasoned Data Engineering Analyst with 3 years of experience in business intelligence projects, focusing on system analysis, design, and the implementation of cutting-edge ETL solutions. With a solid background in Azure Data Factory, she excels at migrating ETL jobs from platforms like DataStage and Spark to Azure and Snowflake environments. Her proficiency with Spark and Azure Databricks enables her to design robust data ingestion pipelines and develop advanced Spark applications for complex data transformations. Sahithya has demonstrated expertise in managing workloads using Azure’s scheduling tools and implementing Azure cloud services, including ADLS, Synapse, and Blob Storage. Her tenure at Optum Global Solutions and Capgemini involved significant contributions to projects aimed at enhancing payment integrity and simplifying healthcare administration processes, showcasing her ability to resolve production support issues efficiently. A proactive team player based in Hyderabad, India, Sahithya is adept at leveraging diverse tools and technologies, including Apache Spark/Scala, Hive, and SQL Server, to drive data solutions that meet strategic business objectives.

Experience

  • Data Engineering Analyst

    Optum Global Solutions · 2023 — 2024
    Designed ETL jobs using Microsoft Azure to transform and load data into staging, ODS, and EDW. Created data ingestion pipelines using Apache Spark/Scala and Azure Databricks. Managed Azure Databricks clusters and conducted data ingestion into Azure services such as Azure Delta Lake and Azure Synapses. Developed and tested Spark/Scala code from Azure Databricks Notebooks and created Azure Data Factory pipelines. Utilized Azure Data Factory activities for data loading and constructed Data flows for transformations.

  • Data Engineering Analyst

    Optum Global Solutions · 2023 — 2023
    Designed ETL jobs with Microsoft Azure for transforming and loading data into various storage systems. Worked on data ingestion pipelines leveraging Apache Spark/Scala and Azure Databricks, including managing clusters and the Azure Databricks File System. Developed Spark applications and executed Azure Data Factory pipelines for data ingestion, ensuring effective data migration from on-premises to Azure.

  • Data Engineering Analyst

    Optum Global Solutions · 2022 — 2023
    Extracted data from web servers to HDFS with Flume and processed logs using Map Reduce. Managed job scheduling through Oozie to eliminate duplicate data. Created Hive tables and executed queries while optimizing performance. Employed Spark SQL for data transformations and integrated streaming processes from RDBMS into HBase tables. Handled production support issues and led troubleshooting efforts for effective solutions.

  • Associate Consultant

    Capgemini · 2021 — 2022
    Prepared technical specifications for job design and developed Spark applications for data transformations and cleansing. Wrote UDFs in Scala and utilized Spark SQL and Hive for querying. Executed Spark transformations from legacy ETL to Big Data while deploying projects using Maven and Jenkins. Conducted data profiling, unit testing, and scheduled jobs with Airflow to ensure operational efficiency.

Interested in this professional?

Sign in as an employer to save this profile or invite balam S. to a job.

Sign in as an employer