We are seeking a Data Engineering Consultant who will be responsible for advising on data strategy, designing scalable cloud-based data platforms, and implementing robust batch and real-time data pipelines. Translates complex business requirements into secure, high-performance data solutions, while ensuring strong governance, quality, and privacy controls. Works closely with stakeholders to modernize legacy systems, develop reusable data models, and promote engineering best practices, while mentoring teams and contributing to the growth of a modern data consulting practice.

Mandatory Skill(s)

• 10+ years of experience in data engineering, cloud infrastructure, or platform engineering;
• Strong expertise in system design, data modeling, data structures, and algorithms;
• Hands-on experience with cloud platforms (AWS, Azure, or GCP);
• Proficiency in distributed data technologies such as Spark and Hadoop;
• Strong programming skills in Python and Java or Scala, with advanced SQL;
• Experience building, monitoring, and optimizing batch and real-time data pipelines;
• Strong working experience with Databricks;
• Hands-on knowledge of ETL orchestration tools (Airflow, Azure Data Factory);
• Experience with DevOps and IaC tools (Docker, Git, Terraform) and CI/CD pipelines;
• Deep understanding of data governance, data quality, security, and privacy;
• Proven ability to translate business requirements into scalable technical solutions;
• Strong stakeholder communication, advisory, and mentoring capabilities.

Desirable Skill(s)

• Experience working in public sector, regulated, or large enterprise environments;
• Exposure to government-scale data platforms and multi-agency data integration;
• Strong understanding of enterprise data architecture and modernisation of legacy systems;
• Experience contributing to or defining data strategy, standards, and reference architectures;
• Familiarity with data visualisation, analytics, or downstream consumption tools;
• Experience conducting technical assessments, discovery workshops, and solution design.

Responsibilities

• Lead and advise stakeholders on data engineering strategy, architecture, and implementation;
• Translate complex business and data requirements into scalable technical solutions;
• Design, build, and maintain batch and real-time data ingestion pipelines from diverse sources;
• Architect and implement secure, cloud-based data platforms and access mechanisms;
• Monitor, troubleshoot, and optimise ETL pipelines and data systems for performance, reliability, and scalability;
• Develop reusable data models and maintain data catalogs with metadata and lineage;
• Collaborate with data stewards to enforce data governance, quality, security, and privacy policies;
• Guide teams through greenfield and brownfield data platform implementations;
• Conduct technical assessments, discovery activities, and solution design workshops;
• Define and promote standardised data engineering approaches and best practices;
• Champion modern data, cloud, and infrastructure practices across teams.

If you are interested in this role, click on the “Apply to this job” button below or you could also write in with your CV to Roshni Mishra at roshni.m@sciente.com quoting the job title.