Senior Data Engineer (PySpark & Microsoft Fabric)

Key Responsibilities

Design, build, and maintain scalable data pipelines that extract, transform, and load data from multiple sources into centralized platforms such as data warehouses, lakehouses, and operational databases.

Develop and manage end-to-end data workflows using Microsoft Fabric, including integration with Azure Data Factory and related Azure data services.

Implement physical and logical data models that support efficient storage, performance, and analytical use cases, while maintaining data integrity and reliability.

Transform raw and semi-structured data into analytics-ready datasets through cleansing, standardization, and deduplication processes.

Integrate data from disparate systems and ensure consistency, accuracy, and quality across the data pipeline.

Optimize database and pipeline performance through tuning, monitoring, and proactive issue resolution.

Collaborate with analytics, reporting, and business teams to transl...