Job Overview
You will be deployed to our client who is a leading government technology agency driving digital transformation and innovation in the healthcare sector. They are seeking a software engineer who has extensive experience in ETL tools, data warehousing concepts and expertise in AWS Cloud services.
Responsibilities
- Design, develop, and implement integration solutions for applications migrating to the AWS Cloud platform
- Design and develop ETL processes to extract data from various sources (e.g., databases, flat files, APIs), transform as per business requirements and load it into data warehouse or other data storage systems
- Integrate data from multiple heterogeneous sources and ensure it is transformed and loaded correctly into the target system, maintaining data quality and integrity
- Write complex SQL queries and use transform logic to clean, aggregate, and transform data as per business requirements
- Ensure ETL processes are optimized for performance, scalability and reliability
- Implement data validation rules and perform data quality checks to ensure accuracy and completeness of data
- Troubleshooting and resolve issues related to data integration, loading failures, and performance bottlenecks in the ETL process
- Document ETL workflows, processes, logic and prepare reports as needed
- Prepare detailed migration plans, timelines, and risk mitigation strategies
- Collaborate with cross-functional teams to understand business requirements and implementeffective integration strategies
- Work closely with the migration team to execute the migration of applications to the AWS Cloud
- Conduct thorough testing to ensure functionality, performance, and data accuracy
- Provide documentation for troubleshooting and support purposes
Requirements
- Bachelor's Degree in Computer Science, Computer Engineering or equivalent.
- At least 5 years of experience in using Informatica PowerCenter tools for data integration and ETL processes.
- Prior hands on experience in Java
- Knowledge of Informatica Designer, Workflow Manager, and Repository Manager.
- Experience with creating and managing ETL mappings, sessions, and workflows.
- Proficiency in designing and developing data transformations.
- Strong SQL skills for database querying and manipulation.
- Understanding of relational database concepts and performance tuning. and also familiarity with data warehousing concepts, star schema, snowflake schema, and data marts.
- Ability to optimize ETL processes for performance and efficiency.
- Understanding of AWS Glue components like Crawlers, Jobs, Triggers, and Data Catalog.
- Experience in creating and managing ETL jobs using AWS Glue Studio.
- Proficiency in Python, especially with PySpark, for writing ETL scripts in AWS Glue.
- Familiarity with other AWS services like S3, Redshift, RDS, and Lambda for integration with AWSGlue.
- Understanding of IAM roles and permissions for secure access to AWS services.
- Skills in planning and executing data migration from Informatica to AWS Glue.
- Ability to translate Informatica workflows and mappings into AWS Glue jobs.
- Experience with AWS CodePipeline or similar tools for automating deployment and integration processes.
If you are interested in this role and would like to discuss the opportunity further please click apply now or email Chew Kai-Xinn at for more information.
Only shortlisted candidates will be responded to, therefore if you do not receive a reply within 14 days please accept this as notification that you have not been shortlisted.
Morgan McKinley Talent Solutions
Morgan McKinley Pte Ltd EA Licence No: 11C5502
EAP Registration No: R2196712
EAP Name: Chew Kai-Xinn
