Job Description
Job Description:
The Data Engineer will perform the following tasks:
• Design, build, and maintain ETL/ELT pipelines.
• Automate data ingestion from various sources (databases, APIs, streaming services).
• Implement data validation and quality checks.
• Use platforms like Azure for cloud-based data solutions.
• Work with Data Scientists and Full stack Web Developers to provide clean, reliable data.
• Create and maintain comprehensive technical documentation, including user manuals, training materials, and product specifications, also developing functional specifications.
• Provide ongoing support for deployed pipelines including version control, data recovery processes, and deployment strategies.
• Research emerging technologies and industry trends, staying up to date with developments in the field, and actively assisting in testing and evaluating new products, tools, and technologies.
The ...