Principal Engineer, Databricks Platform – Cardlytics

About Cardlytics
Remember that time you got cash back on a cup of coffee through your banking app? That was us!

Cardlytics (NASDAQ: CDLX) is the industry-leading purchase intelligence and incentives platform. We are a product-driven company that cares about three things: our people, our customers, and our partners. Together, we make commerce more rewarding for everyone by helping businesses attract, understand, and incentivize consumers through their banks’ digital channels.

About the Team

At Data Infra, our goal is to streamline Cardlytics data consumption across the entire organization. We understand that accessible, reliable data underpins informed decision-making and innovative problem-solving. By partnering closely with teams, we tailor our solutions to fit their specific workflow needs and make strategic investments in our Data Infra platform to ensure swift access to data. Our approach is designed to not only simplify the way teams interact with data but also to accelerate time-to-insight, enabling Cardlytics teams to harness the full potential of their data for impactful outcomes.

About the Position
Cardlytics is seeking a Principal Engineer, Databricks Platform to join our team, reporting to the Director, Cloud & Data Infra.

We are seeking a highly skilled and experienced Databricks Platform Engineer to join our growing team. In this role, you will be responsible for designing, building, and maintaining robust data infrastructure solutions on the Databricks Platform. You will leverage your in-depth knowledge of Databricks and your experience supporting Data Scientists, Data Engineers, and Analysts to ensure a high-performing and scalable data environment.

Responsibilities:

• Databricks Platform Infrastructure: Design, build, and maintain data infrastructure on the Databricks Platform, including Spark and Databricks SQL.
• Data Team Enablement: Provide technical expertise and support to Data Scientists, Data Engineers, and Analysts, enabling them to effectively utilize the Databricks platform.
• Performance Optimization: Optimize Databricks workloads for performance, scalability, and cost efficiency.
• Infrastructure as Code (IaC): Implement and manage infrastructure using IaC tools such as Terraform or CloudFormation.
• Security and Governance: Implement and maintain security and governance best practices for the Databricks platform.
• Monitoring and Troubleshooting: Monitor the health and performance of the Databricks infrastructure, and troubleshoot and resolve technical issues.
• Best Practices: Develop and document best practices for Databricks platform management.

Minimum Qualifications:

• Extensive hands-on experience with the Databricks Platform, including Delta Lake, Spark, and Databricks SQL.
• Proven experience in building and maintaining cloud-based data infrastructure, preferably on AWS.
• Strong understanding of data warehousing, data lake, and data engineering concepts.
• Demonstrated experience supporting Data Scientists, Data Engineers, and Analysts.
• Proficiency in Infrastructure as Code (IaC) tools. Preferably Terraform.
• Experience with data pipelines, ETL/ELT processes, and data modeling.
• Strong problem-solving and troubleshooting skills.
• Excellent communication and collaboration skills.

Technical Environment

We primarily use macOS and Google Workspace (Docs, Sheets, Slides). While our preferred platform is macOS, we support both macOS and Windows. Familiarity with or willingness to work within this environment is required.

Core Values

Our shared values are the driving force behind everything we do. Across all roles, we are looking for teammates who embody these values:

• Customer and partner-first
• Act with urgency and focus
• Integrity with our partners and data
• Accountability even when challenged
• Empowerment over hierarchy
• Growth over comfort

Compensation

At Cardlytics salary ranges are determined based on factors such as role, level, and location. Individual compensation may be determined by relevant skills, experience, education, training, and other role-specific criteria. This salary range will be narrowed during the interview process based on a number of the aforementioned factors.The base salary range provided below does not include bonuses and additional benefits.

The annual US base salary range for this role is:

$183,000 – $252,000

Benefits and Perks

• Flexible paid time off plus company holidays
• Medical, dental, and vision insurance begins on your first day
• 401(k) retirement plan with company match, plan also includes a student loan debt repayment option
• Employee Stock Purchase Plan
• Educational assistance for continuing education
• Lifestyle Spending Account for physical, emotional, and financial wellness (like gym memberships, home down payments, art classes, park passes, and more!)
• Complementary Calm app subscriptions to support employee mental health and wellbeing