About the job
My client is seeking a Senior Data Engineer with 5+ years' experience to join their Cork team on a 9-month contract. This role is ideal for someone who thrives on building scalable data solutions and making an immediate impact.
Responsibilities:
- Develop and manage modern data platforms using Databricks (Spark, Delta Lake, MLflow) and AWS services (S3, Glue, Lambda) to deliver reliable, high-performance pipelines.
- Design and implement ETL/ELT frameworks for batch and real-time processing, incorporating CI/CD and infrastructure automation (Terraform or CloudFormation).
- Tune Spark jobs and optimise workflows for performance, cost-efficiency, and observability with tools like Datadog or CloudWatch.
- Ensure security, governance, and compliance standards are applied across data workflows (IAM, GDPR, ISO).
- Collaborate with data engineers and cross-functional teams to drive technical excellence and deliver solutions rapidly.
Skills & Experience:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field, with 5+ years in data engineering.
- Hands-on experience with Databricks and AWS services (S3, Glue, Lambda, Step Functions) and deep Spark expertise.
- Proficiency in Python (PySpark), Scala, SQL, and experience in data modeling, warehousing, and integration.
- Strong experience with infrastructure-as-code (Terraform/CloudFormation) and modern CI/CD pipelines.
- Excellent communication skills, able to quickly understand requirements and deliver actionable solutions.
For more information, reach out today!
