We are looking for a Senior Data Engineer to design, build and maintain scalable data pipelines and the APIs that expose core platform functions.
Required Skills
- Expert Python, PySpark, Databricks, Snowflake or similar platforms using Delta Lake or Iceberg: MERGE, schema evolution, time travel and transaction history, performance tuning on large tables
- Deep ETL and data engineering fundamentals: designing, building and maintaining scalable pipelines that hold up as data volume and complexity grow
- REST API development in a language of your choice: building and versioning authenticated APIs that expose core platform functions; a strong consumer of third-party APIs
- Strong software engineering foundations: object-oriented design, multi-language capability, shell scripting, Git-based CI/CD and DevSecOps, and infrastructure-as-code awareness
- Semantic model literacy: preparing Gold-layer tables for BI semantic models using advanced AI-based analytics tools
- AI-assisted development: proficient with AI coding tools such as Claude Code or Codex to accelerate delivery while maintaining code quality, testing and review discipline
Experience
- 4+ years of work experience with PySpark
- 4+ years of work experience with Python
- 7+ years of work experience with Azure Databricks