Data Engineer II

About The Company Grow With Us: Join Our Team of Innovators. Our company is a leading provider of data-driven solutions, dedicated to empowering organizations through innovative technology and strategic insights. We specialize in delivering scalable, reliable, and efficient data infrastructure that enables our clients to harness the full potential of their data assets. Our team comprises experienced professionals committed to excellence, continuous learning, and fostering a collaborative environment that promotes growth and innovation. We serve a diverse range of industries, including finance, healthcare, retail, and technology, helping them achieve their business objectives through advanced data solutions. About The Role The Data Engineer II plays a critical role in designing, developing, and maintaining robust data infrastructure and pipelines that facilitate seamless data integration, transformation, and analysis. This role requires a technical expert with a strategic mindset, capable of optimizing cloud resources, ensuring data quality and governance, and implementing scalable solutions that align with business goals. The successful candidate will collaborate with cross-functional teams to develop database schemas, automate workflows, and troubleshoot complex technical issues. They will also contribute to process improvements, enhance data security measures, and support the organization’s data strategy initiatives. This position offers flexibility for both part-time and full-time employment, with a competitive salary commensurate with experience and expertise. Qualifications

• Bachelor’s degree in Data Science, Computer Science, Software Engineering, Information Systems, Mathematics, or a related technical field
• Equivalent practical experience in data engineering or related roles
• Proficiency in Python and SQL for data processing and query optimization
• Experience with PySpark and additional languages such as Scala, Java, or Bash
• Strong knowledge of relational databases (PostgreSQL, MySQL, Oracle)
• Experience with modern data warehouses (Snowflake, Amazon Redshift, Google BigQuery)
• Familiarity with data lakes (Amazon S3, Azure Data Lake) and lakehouse architectures (Delta Lake, Apache Iceberg)
• Hands-on experience with Apache Spark, Databricks, and real-time data streaming tools like Kafka
• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform
• Understanding of data governance, compliance standards (GDPR, HIPAA), and tools like Unity Catalog and Apache Atlas
• Knowledge of pipeline monitoring tools like Apache Airflow
• Certifications such as Microsoft DP-900, Databricks Data Engineer, AWS Certified Data Engineer, Snowflake SnowPro, or Google Professional Data Engineer are advantageous but not mandatory

Responsibilities

• Design, develop, and optimize database schemas for complex data models to support analytical reporting and business insights
• Create and implement automated data validation and quality checks to ensure data accuracy and consistency
• Collaborate with cross-functional teams to maintain data integrity across systems and pipelines
• Implement data lifecycle management practices, including data retention, archiving, and deletion policies
• Design, develop, and optimize ETL workflows for diverse data sources, ensuring efficient data transformation and integration
• Build and automate scalable data pipelines to ensure continuous and reliable data flow across platforms
• Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and reliability
• Conduct root cause analysis for technical issues, proposing and implementing effective solutions
• Write and optimize SQL queries for efficient data retrieval and processing
• Develop modular, high-performance data processing scripts in Python, ensuring traceability and repeatability
• Maintain version control practices and automate deployment processes using DevOps principles
• Review code and workflows to uphold quality standards and best practices
• Optimize cloud storage and data warehousing systems for cost-efficiency and performance
• Evaluate new tools and technologies, recommending improvements to enhance team productivity
• Integrate data governance and security measures into workflows, ensuring compliance and data protection

Benefits

• Paid Holidays and Paid Time Off
• Employer Retirement Contributions
• Health Savings Account Contributions
• Comprehensive Health, Vision, and Dental Insurance Coverage
• Profit Sharing and Annual Bonuses based on company performance
• Flexible Work Arrangements, including remote work options
• Professional Development Opportunities
• Access to Life Insurance, Short and Long-Term Disability Insurance, and Employee Assistance Programs

Equal Opportunity Our company is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, gender, sexual orientation, gender identity or expression, age, disability, or any other protected status. We believe in fostering a workplace where everyone can thrive and contribute to our collective success.