Post a Job Free
34 viewsjobseeker
Nikhil K. — Data Engineer from India

Nikhil K.

Data Engineer

India 3-6 years
Actively lookingNew to Platform
Languages
English
Video Introduction
No video introduction yet
The candidate has not added a video.
Contact information and social networks are private. Connect to unlock.
Hidden

About

Nikhil K. is a seasoned Data Engineer with over 5.5 years in IT and 4+ years of direct data engineering experience, supporting E-commerce, Healthcare, and Banking sectors. At C-Edge Technologies for State Bank of India, Nikhil has architected and optimized real-time and batch PySpark pipelines for high-volume transaction processing on platforms like SBI E-Pay 2.0, leveraging Apache Spark and Apache Kafka for data ingestion and enrichment. In previous roles at Universal Softech Hubs, he developed AWS-based ETL frameworks and analytics-ready data lakes for large-scale e-commerce and healthcare use cases, deploying solutions with AWS Glue, Redshift, and Airflow. His responsibilities have spanned designing secure, scalable data architectures, automating workflows, and ensuring high data accuracy and compliance with industry standards.

Experience

  • Data Engineer / Spark Engineer

    GR Consultants Pvt Ltd. (Deputed at C-Edge Technologies |Client: State Bank of India) · 2025 — Present
    Developed batch and streaming data pipelines using PySpark for SBI E-Pay 2.0, managing high-volume real-time transaction processing. Established Apache Kafka producers and consumers to facilitate real-time transaction ingestion and enhance merchant data. Deployed applications in Docker containers on Red Hat OpenShift adhering to SBI standards. Enhanced Spark job performance through caching, partitioning, adaptive query execution, and resource tuning. Streamlined ETL workflows to minimize manual effort and increase pipeline reliability. Collaborated with Java and IBM MQ teams to maintain end-to-end data flow.

  • Data Engineer

    Universal Softech Hubs Pvt Ltd. · 2021 — 2025
    Engineered scalable AWS Glue PySpark ETL pipelines for processing extensive E-commerce data, including product, customer, and sales information. Crafted and fine-tuned comprehensive data pipelines for the eCommerce sector to ensure data security, integrity, and scalability. Created and enhanced dimensional data models (Star Schema) in Amazon Redshift, yielding better analytical query performance. Utilized Apache Airflow to orchestrate ETL workflows with dependency management to improve pipeline efficiency. Conducted data validation, enrichment, and optimization through PySpark and SQL to achieve high data accuracy. Developed and sustained an AWS S3-based Data Lake architecture with optimized storage and partitioning. Automated deployment and version control processes

  • System Engineer

    Arkarz Internet Pvt Ltd · 2020 — 2021
    Oversaw and managed the system infrastructure while providing technical support resolving network and system-related issues. Worked collaboratively with teams to assess and enhance system performance.

Skills & Expertise

Data Engineering

Education

  • Master in Information Technology
    Deogiri College, Aurangabad, Maharashtra, India · 2019 — 2021
  • Bachelor of Computer Science
    Shiv Chhatrapati College, Aurangabad, Maharashtra, India · 2014 — 2018