J P.

Developed architecture and defined parameters for the Throughput optimization project to facilitate digital transformation. Migrated data using AWS Glue between S3 buckets and established data flows between AWS DMS and on-premises MS SQL server by setting up endpoints and replication instances. Managed the creation and configuration of multiple S3 buckets, applying various policies and permissions, and worked extensively on storage classes. Employed Glue crawlers for data organization and utilized AWS Athena for further analysis. Used Python scripts in Glue console to transform large datasets by delimiting and appending headers, as well as joining tables and storing updated data in S3. Engaged in querying with SSMS and DB Visualizer to extract data. Acquired knowledge on Big data technologies including Map Reduce and Spark while providing analytical problem-solving solutions. Established databases and data warehouses in Snowflake for storing data and linked them to Power BI for business intelligence visualizations.

Executed SQL queries for CRUD operations to retrieve and present data to worldwide managers during WBRs, ensuring data cleanliness through analysis. Managed AWS S3 operations such as bucket versioning and cross-regional replications, along with retrieving large data objects from multiple buckets. Organized and transformed datasets across the business by implementing cleaning, mapping, and enriching logics using AWS Glue while also operating data interactive services like AWS Athena with standard SQL. Steered data transfer between storage services using data-driven workflows.

Developed and conducted daily data quality checks to ensure accuracy. Managed SQL queries for the extraction, transformation, and loading of data. Built automated data pipelines utilizing AWS Glue to streamline processes. Communicated insights and findings to stakeholders through reports, dashboards, and presentations in Power BI. Collaborated with diverse teams to utilize data for informed decision-making and business initiatives. Continuously monitored data processes for efficiency and accuracy while coordinating incident resolutions and performing root cause analyses.

Wrote and executed Python and Spark functions according to specifications while collaborating with developers to troubleshoot and resolve issues. Identified defect root causes and proposed improvements in data warehouse validation processes. Presented business reports to leaders leveraging business analytics tools such as QuickSight and Power BI for effective visualizations. Gained experience in Agile environments, including Rapid development and Scrum development processes, and engaged in discovering schemas using Glue crawlers.