Job Description:
We are looking for a Senior Data Engineer to lead the design and implementation of a greenfield Databricks Lakehouse for our CRM domain. You will build scalable ETL/ELT pipelines across Salesforce, Redshift, and our Datalake, and establish the ML and analytics infrastructure needed for advanced customer forecasting.
Responsibilities:
• Architect and deliver Databricks Lakehouse and Medallion-layer pipelines.
• Integrate CRM and enterprise data sources, ensuring performance and data quality.
• Use Terraform to provision and secure Databricks and Unity Catalog with strict PII/GDPR compliance.
• Implement data monitoring, dashboards, BI solutions, and reverse ETL workflows.
• Support ML infrastructure (MLflow, Databricks Genie) and collaborate with data science.
• Define engineering best practices, review code, and mentor team members.
Qualifications:
• 5+ years in Data Engineering, including 3+ years with Databricks, Spark, and Delta Lake.
• Strong Python, Terraform, and CI/CD experience.
• Expertise in data governance, security, and PII handling.