AWS Data Engineer - Contract - Sydney

Requirements

• Design and implement scalable data pipelines using Python or PySpark, and boto3
  
• Integrate with Amazon Redshift for data warehousing and perform data ingestion and transformation tasks
  
• Work with Amazon S3 to architect and manage data lakes
  
• Build and manage batch processing jobs using AWS Glue, EMR, and Lambda
  
• Support streaming data workflows using Amazon Kinesis
  
• Leverage AWS Secrets Manager and KMS for secure data handling and encryption
  
• Write efficient SQL for data querying, transformations, and performance ...