Le M.
Junior Data Engineer
Open to offersNew to PlatformAbout
Le M. Q. is a skilled Data Engineer Intern based in Go Vap District, Ho Chi Minh City, specializing in building scalable batch and real-time data pipelines, leveraging technologies such as Kafka, Spark, and Airflow. With a strong foundation in data modeling and distributed systems, Le has contributed to significant projects, including the creation of a CRM analytics platform and an e-commerce real-time analytics platform. In these projects, Le demonstrated proficiency in deploying containerized data platforms using Docker and implementing CI/CD workflows with GitHub Actions. As an intern, he refined his capabilities in designing data transformation workflows and integrating APIs to enhance data enrichment processes. Le's educational background from Ho Chi Minh Open University, where he is pursuing a Bachelor of Computer Science, complements his hands-on project experience, further demonstrated by his command of Python and SQL for data processing and analytics tasks.
Experience
Data Engineer Intern
nullGained hands-on experience in constructing scalable batch and real-time data pipelines utilizing Kafka, Spark, and Airflow. Developed containerized data platforms and implemented CI/CD workflows.Personal Project - Data Pipeline for CRM Analytics Platform Customer360
nullCreated an end-to-end ETL pipeline using PySpark for processing both structured and unstructured data into a PostgreSQL data warehouse. Integrated OpenAI API into Spark jobs for data enrichment and normalization of unstructured search queries. Designed a Star Schema data warehouse with a focus on fact and dimension tables, ensuring data consistency and facilitating analytical querying.Personal Project - E-Commerce Real-Time Analytics Platform
nullDeveloped a scalable ingestion layer simulating e-commerce user behavior to produce continuous streaming data. Configured Apache Druid Kafka Supervisors for real-time OLAP ingestion, achieving sub-second query latency. Managed batch and streaming workflows with Apache Airflow, employing Redis and PostgreSQL as backend services. Created interactive dashboards in Apache Superset to track essential business metrics. Executed automated testing and established CI/CD pipelines using GitHub Actions to boost reliability and consistency.
Skills & Expertise
Education
- Bachelor of Computer ScienceHo Chi Minh Open University · 2023 — Present
Interested in this professional?
Sign in as an employer to save this profile or invite Le M. to a job.
Sign in as an employer