Senior Data Engineer

Cleartelligence is a data, analytics, and AI consultancy focused on helping enterprise and private equity clients envision, design, and implement solutions that solve complex business problems and accelerate value creation through data-driven insights.

As a Senior Data Engineer at Cleartelligence, you will play a crucial role in understanding and interpreting data from diverse systems. Your primary focus will be to tackle complex data integration challenges, with the goal of constructing sophisticated analytics datasets that drive insightful decision-making across the organization.

RESPONSIBILITIES

• Analyze data from a variety of sources to gain a deep understanding of the underlying systems, ensuring effective integration and utilization for analytics.
• Identify and resolve complex data integration issues, enabling the creation of comprehensive and coherent analytics datasets.
• Design scalable data architectures for high-volume data transfer and integration.
• Develop and maintain automated, performance-tuned ELT/ETL pipelines in Talend Cloud.
• Deploy and manage pipelines with CI/CD tools like GitHub/Gitlab.
• Use dbt extensively for data transformation within the data warehouse.
• Spearhead data migration to BigQuery
• Work with cross-functional teams and agile methodologies for solution delivery.
• Handle release management for databases and related applications.
• Develop workflows for efficient data pipeline orchestration.
• Offer expert advice and troubleshooting for data integration challenges.
• Maintain database security and manage user access controls.

QUALIFICATIONS

• Proven expertise in data engineering with a specific focus on data integration and analytics.
• Proficiency in SQL, ELT/ETL tools (Talend), and data warehousing concepts.
• 5-7 years experience with BigQuery
• Excellent communication skills, with an ability to translate complex technical concepts into understandable terms for non-technical stakeholders.
• 5+ years of hands-on experience working extensively with relational databases and and cloud-based data solutions
• 3+ years of hands-on experience with dbt
• Databricks and Snowflake experience a plus
• Experience working with Github and Gitlab
• Deep understanding of SQL; ability to write multi-layer statements that handle complex transformation needs
• Demonstrated ability to understand/discover business needs and craft data merges, transformations and aggregations to deliver data that can be used in reports, analytics repositors and applications
• Hands-on experience developing data pipelines in a cloud environment
• US location and ability to work EST
• Current US citizen or permanent resident.

It is our policy to provide and promote equal employment opportunity to all employees and applicants for employment following all local, state, and federal laws and regulations governing personnel activities. Under federal guidelines we are committed to a program of affirmative action for work sites in the United States.