Junior Big Data Engineer
NTT DATA Business Solutions
December 2021 – August 2022 · Istanbul, Turkey
Worked on the DMP project for ZF Global as a data engineering consultant.Designed and implemented data transformation scripts with PySpark and SQL through Databricks and Synapse.Integrated new source systems (manufacturing execution systems) into a common unified data model, improving data consistency and reliability for the serving layer, which is an angular app + PowerBI report showing OEE for respective plant.Following CI/CD principles and maintaining development, staging and production environments for the product.Ensured the stability of the product through bug fixing and performance improvements.Implementing important data engineering concepts such as row level security, multi hop architecture, fault tolerant data ingestion, test driven development, proper documentation and version control.Collaborated effectively with a multinational team & customer through pair programming, knowledge transfer and sprint DEMO sessions.