Fully Remote - Senior Data Engineer - Databricks - 12 months contract
what we look for:
12 years of related experience with a bachelor’s degree.
Experience with Databricks is Must
5+ years of experience in SSIS and Data Warehousing Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets. In depth knowledge of Model and Design of DB schemas for read and write performance.
Extensive working knowledge of API or Stream based data extraction processes like Salesforce API and Bulk API is must.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
A successful history of manipulating, processing and extracting value from large, disconnected datasets.
Knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Experience supporting and working with cross-functional teams in a dynamic environment.
Experience with building data pipeline from various business applications like Salesforce, Marketo, NetSuite, Workday etc.
Experience with big data tools: Hadoop, Spark, Python, Scala, etc.