Data Engineer

Job role: AWS Data EngineerLocation: Remote (UK)Full-time role

An AWS Data Engineer designs, develops, and maintains scalable data pipelines, data warehouses, and data lakes on the AWS cloud platform to support data-driven initiatives. Key responsibilities include using services like AWS Glue, EMR, and Redshift for ETL, managing data quality and security, and collaborating with data scientists and analysts to meet business requirements.

Core responsibilities:

• Build data infrastructure: Design, build, and maintain scalable data pipelines, data warehouses (e.g., Redshift), and data lakes (e.g., S3, Lake Formation).
• Develop ETL/ELT processes: Create and manage processes to extract, transform, and load data using services like AWS Glue and AWS Lambda.
• Implement data governance and security: Design and implement data governance policies, security measures, and data quality checks.
• Optimize performance: Monitor and tune AWS data services for performance, cost, and scalability.
• Collaborate with teams: Work with data scientists, analysts, and other stakeholders to understand their data needs and build solutions.
• Troubleshoot issues: Resolve data-related problems and optimize data storage and processing.

Required skills and qualifications:

• Technical skills:
• Proficiency with AWS services like S3, Glue, Redshift, EMR, Kinesis, and Lambda.
• Strong experience with SQL and/or programming languages like Python.
• Knowledge of data modeling, database structures, and ETL processes.
• Experience with both structured and unstructured data.