Data Engineer

Job Title: Data EngineerRemote

We are seeking an experienced Data Engineer with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in PySpark, AWS Lambda, and AWS Glue with day shifts.

Responsibilities

• Develop and implement scalable data architectures using PySpark, AWS Lambda, and AWS Glue to support business objectives and enhance data processing capabilities.

• Collaborate with cross-functional teams to understand data requirements and translate them into effective architectural solutions.

• Optimize data workflows and processes to ensure efficient data handling and storage, improving overall system performance.

• Provide technical guidance and support to development teams, ensuring best practices are followed in data architecture and implementation.

• Develop and maintain documentation for data architecture, processes, and best practices to ensure clarity and consistency across teams.

• Evaluate and recommend new technologies and tools that can enhance data processing and storage capabilities, keeping the company at the forefront of technological advancements.

• Ensure data security and compliance with industry standards and regulations, safeguarding sensitive information and maintaining trust.

• Monitor and troubleshoot data systems to identify and resolve issues promptly, minimizing downtime and ensuring seamless operations.

• Collaborate with stakeholders to identify opportunities for data-driven improvements and innovations, contributing to the companys growth and success.

• Lead efforts to improve data quality and integrity, implementing strategies to ensure accurate and reliable data across systems.

• Provide training and mentorship to team members, fostering a culture of continuous learning and development.

• Participate in strategic planning sessions to align data architecture initiatives with company goals and objectives.

• Contribute to the companys mission by developing data solutions that have a positive impact on society, enhancing the quality of life for communities served.

Qualifications

• Possess a strong understanding of PySpark, AWS Lambda, and AWS Glue, with proven experience in designing and implementing data architectures.

• Demonstrate excellent problem-solving skills and the ability to work collaboratively with cross-functional teams.

• Exhibit strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

• Have a track record of optimizing data workflows and processes to improve system performance and efficiency.

• Show commitment to data security and compliance, with a focus on safeguarding sensitive information.

• Display a proactive approach to learning and adopting new technologies and tools that enhance data capabilities