We are looking for a Data Engineer with 4–7 years of experience to support government projects by building and maintaining scalable data platforms and pipelines. The role requires strong expertise in AWS services and Databricks (Spark, PySpark, Delta Lake), along with solid knowledge of ETL/ELT and data warehousing.

Mandatory Skill(s)

• Must have 4–7 years of Data Engineering experience; 
• Strong experience with AWS Cloud platform: (S3, Glue, Lambda, Redshift or similar services);
• Proven expertise in Databricks, including Spark, PySpark, and Delta Lake;
• Experience building and maintaining scalable data pipelines;
• Strong knowledge of ETL/ELT processes and data integration;
• Solid understanding of data warehousing concepts and best practices;
• Experience working in Agile/Scrum environments;
• Strong technical troubleshooting and analytical skills.

Desirable Skill(s)

• Experience working on government or large-scale enterprise data projects;
• Exposure to data platform architecture and collaboration with data architects;
• Strong understanding of data quality, performance tuning, and optimization;
• Experience with data modeling and downstream analytics enablement;
• Ability to work closely with cross-functional stakeholders (analysts, business teams);
• Familiarity with automation and monitoring of data pipelines.

Responsibilities

• Design, develop, and maintain data pipelines and data platforms on AWS;
• Build and optimize data ingestion, transformation, and processing workflows using Databricks;
• Work closely with data architects, analysts, and stakeholders to understand requirements;
• Implement data models, ETL/ELT processes, and data integrations;
• Troubleshoot and resolve data quality, performance, and pipeline issues;
• Participate in Agile ceremonies including sprint planning, stand-ups, and retrospectives.

If you are interested in this role, click on the “Apply to this job” button below or you could also write in with your CV to Subhashree Mallick at subhashree.m@sciente.com quoting the job title.