Principal Data Engineer
Anaplan
Principal Data Engineer Overview
| Company Name | Anaplan |
| Job Role | Principal Data Engineer |
| Qualifications | Not Specified |
| Category | IT Jobs |
| Job Type | Full Time |
| Location | London |
At Anaplan, we are a team of forward-thinking innovators dedicated to enhancing business decision-making through our leading AI-infused scenario planning and analysis platform. Our platform enables our clientsâ??many of the world’s top Fortune 50 companies such as Coca-Cola, LinkedIn, Adobe, LVMH, and Bayerâ??to stay ahead of their competition and market trends. Our collective culture emphasizes diversity of thought, leadership regardless of titles, ambitious goal-setting, and celebrating successes both big and small. Guided by principles of strategic focus, core values, and disciplined execution, we foster an environment where employees are inspired, connected, and rewarded. We welcome your unique qualities and invite you to join us in shaping the future together.
About the Role
We are seeking a Principal Data Engineer capable of overseeing the entire spectrum of Anaplan’s data platform. This role involves setting the technical direction for how data is ingested, transformed, stored, served, and governed at scale. You will be responsible for building highly efficient and resilient data pipelines that process vast amounts of data in both real-time and batch modes. Your work will empower business users to utilize extensive datasets in their planning workflows and serve as the foundation for our advanced analytics and AI initiatives. The ideal candidate will possess deep expertise in distributed computing, data architecture, and software engineering to address complex, high-scale data challenges.
Your Impact
- Lead the architecture, design, and deployment of scalable, high-throughput Big Data systems into production environments.
- Design, deploy, and manage core data infrastructure such as vector databases, NoSQL, and document stores that support AI infrastructure.
- Develop comprehensive end-to-end data engineering solutions, including ETL/ELT pipelines, APIs, and data ingestion frameworks.
- Build storage and processing layers like data lakes, data warehouses, distributed file systems, and real-time streaming architectures to support analytics workloads.
- Create feature-rich data pipelines that process large-scale enterprise data, seamlessly integrating batch and streaming data processing.
- Optimize distributed queries and data transformations to ensure high performance and minimal latency for end users.
- Implement data quality frameworks to maintain data integrity, reliability, and governance across all assets.
- Collaborate with analytics, product, and platform teams to develop data models that accurately reflect customer metrics, hierarchies, and relationships.
- Stay updated with the latest developments in the data ecosystem, evaluating new tools and technologies for potential integration.
Your Skills
- Extensive hands-on experience in data engineering, with a proven history of delivering complex data solutions in demanding environments.
- Deep understanding of database ecosystems vital for AI and machine learning, including vector databases, NoSQL, and document stores.
- Practical experience in building, scaling, and maintaining large-scale data platforms in production.
- Strong familiarity with distributed data processing frameworks such as Apache Spark, Flink, or Hadoop.
- Experience working with message brokers and streaming platforms like Apache Kafka or Kinesis.
- Proficiency in developing data pipelines using workflow orchestration tools like Apache Airflow or Dagster.
- Hands-on experience with cloud data warehouses such as Snowflake, BigQuery, or Redshift, and data lake solutions like Databricks, Delta Lake, or Apache Iceberg.
- Advanced SQL skills and proficiency in Python for data engineering tasks.
- Solid understanding of modern software development practices including testing, code review, CI/CD, and Infrastructure as Code.
- Desirable: Experience leading technical projects, mentoring teams, working with cloud platforms (AWS, GCP, Azure), and implementing data observability frameworks.
- Familiarity with enterprise planning platforms like Anaplan is a plus.
Our Commitment to Diversity, Equity, Inclusion and Belonging (DEIB)
We believe that attracting diverse talent and fostering an inclusive environment enhances our business. DEIB initiatives improve our workforce, strengthen trust with clients and partners, and drive innovation. We are committed to creating a workplace where everyone is respected and valued, regardless of gender, ethnicity, age, disability, or any other characteristic. We ensure reasonable accommodations are provided for individuals with disabilities during the application and employment process. For any questions regarding accommodations, please contact us.
Important Notices
Beware of fraudulent job offers circulating online. Anaplan does not extend job offers without a thorough interview process involving our recruitment team and hiring managers, typically via video or in person. All official communications will come from an @anaplan.com email address. If you have doubts about any communication claiming to be from Anaplan, contact us at [email protected] before proceeding.
Candidate data collected during recruitment is handled in accordance with our Candidate Privacy Notice, which may include the use of AI or automated tools for evaluation.
Application Process
If interested, you can create a job alert to receive future opportunities or apply directly by submitting your application through the provided form. The application requires personal details, work authorization status, and the ability to specify if visa sponsorship is needed now or in the future.
Degree Requirement: Not Specified
Visa Sponsorship May be
To apply for this job please visit job-boards.greenhouse.io.