A leading client is seeking a Data Engineer with strong Databricks expertise to support a key data transformation iinitiative. This is a contract position running until the end of the year, with hybrid working (2-3 days onsite per week in Limerick). The role sits within a collaborative data team focused on enabling next-generation data solutions and analytics capabilities.
Key Responsibilities:
-
Develop and maintain scalable data pipelines using Databricks and Apache Spark
-
Collaborate with analysts and data scientists to deliver fit-for-purpose data solutions
-
Enhance existing ETL processes for improved performance and reliability
-
Implement robust data validation and quality checks
-
Work with large-scale datasets and Big Data technologies
-
Support data modeling and data warehouse design for analytics and reporting
-
Monitor and resolve performance issues in data pipelines
-
Contribute to code reviews and promote engineering best practices
-
Maintain documentation of data workflows, architecture, and processes
-
Keep up with emerging trends in data engineering and cloud technologies
Required Skills & Experience:
-
3+ years in data engineering or a similar role
-
Strong hands-on experience with Databricks and Apache Spark
-
Proficiency in SQL and scripting languages such as Python or Scala
-
Solid understanding of ETL concepts, data modeling, and data warehousing
-
Experience with cloud platforms, ideally Azure (AWS also considered)
-
Knowledge of data quality frameworks and governance principles
-
Strong problem-solving skills and attention to detail
-
Excellent communication and teamwork skills
Desirable:
-
Exposure to machine learning workflows and data science environments
-
Familiarity with modern data architectures (e.g., data lakes)
-
Experience with version control (Git) and CI/CD practices
