Sr. Data Engineer (Databricks)

*****W2 ONLY / NO C2C / NO SPONSORSHIP*****

As a Senior Data Engineer on the Data Dynamics team, you will lead the design and development of scalable data pipelines and analytics solutions with a strong focus on Azure Databricks and Power BI. You’ll play a critical role in transforming large, complex datasets into structured, insight-driven platforms hosted in the Microsoft Azure ecosystem.

Reporting to the Senior Data Architect, you will manage end-to-end ETL workflows within Azure Databricks, support data integration needs, and ensure seamless data availability for analytics, forecasting, and visualization. You’ll also partner with internal teams and utility clients to design interactive Power BI dashboards that drive business decisions and operational efficiency.

Key Responsibilities:

🔹 Build and Optimize Data Pipelines in Azure Databricks

• Design, develop, and maintain scalable ETL workflows using Azure Databricks (Spark) and SQL
• Automate and monitor data ingestion pipelines from multiple sources
• Implement robust data quality checks and error-handling routines
• Collaborate with architects to standardize datasets for downstream analytics

🔹 Deliver Business Insights via Power BI

• Develop compelling Power BI dashboards and reports to visualize operational and strategic metrics
• Translate complex data findings into clear, actionable insights for internal stakeholders and clients
• Ensure seamless integration of Databricks output into Power BI models

🔹 Collaborate on Advanced Analytics Initiatives

• Work closely with Data Scientists and Research Scientists to prepare data for statistical and ML models
• Assist in data transformation and feature engineering within the Azure environment
• Contribute to data model design that supports predictive analytics use cases

🔹 Client Engagement & Strategic Impact

• Participate in client meetings to gather requirements and present technical solutions
• Help shape team strategy around Azure and data platform modernization

Qualifications:

✅ Education & Experience

• Bachelor’s degree in Computer Science, Data Engineering, or related field, or 5–7 years of equivalent experience
• Hands-on experience building data pipelines in Azure Databricks (Spark)
• Proficiency in SQL, Python, and/or Scala
• Demonstrated expertise in Power BI (DAX, data modeling, visual design)
• Solid understanding of the Microsoft Azure ecosystem, including Data Lake, Synapse, and related services

✅ Skills & Traits

• Proven ability to deliver production-grade data pipelines and visualizations
• Strong collaboration and communication skills, especially when working with cross-functional teams and clients
• Ability to self-manage tasks and adapt to new technologies in a dynamic environment

Work Environment:

Remote work supported with occasional in-person meetings. Must be available for virtual client interactions and internal collaboration.