Data Engineer - Contract

About the job

My client is seeking a Senior Data Engineer with 5+ years' experience to join their Cork team on a 9-month contract. This role is ideal for someone who thrives on building scalable data solutions and making an immediate impact.

Responsibilities:

• Develop and manage modern data platforms using Databricks (Spark, Delta Lake, MLflow) and AWS services (S3, Glue, Lambda) to deliver reliable, high-performance pipelines.
  
  
• Design and implement ETL/ELT frameworks for batch and real-time processing, incorporating CI/CD and infrastructure automation (Terraform or CloudFormation).
  
  
• Tune Spark jobs and optimise workflows for performance, cost-efficiency, and observability with tools like Datadog or CloudWatch.
  
  
• Ensure security, governance, and compliance standards are applied across data workflows (IAM, GDPR, ISO).
  
  
• Collaborate with data engineers and cross-functional teams to drive technical excellence and deliver solutions rapidly.
  
  

Skills & Experience:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field, with 5+ years in data engineering.
  
  
• Hands-on experience with Databricks and AWS services (S3, Glue, Lambda, Step Functions) and deep Spark expertise.
  
  
• Proficiency in Python (PySpark), Scala, SQL, and experience in data modeling, warehousing, and integration.
  
  
• Strong experience with infrastructure-as-code (Terraform/CloudFormation) and modern CI/CD pipelines.
  
  
• Excellent communication skills, able to quickly understand requirements and deliver actionable solutions.
  
  

For more information, reach out today!