AWS Data Engineer

Location:	Johannesburg
Type:	Contract
Reference:	#NG59270
Company:	E-Merge IT Recruitment

Join a leading company pioneering the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide. With a vision to provide next-generation insights by harnessing data through high-performance, interoperable, and simplified solutions, they are seeking an AWS Data Engineer to join their fast-paced, dynamic team.

Responsibilities:

• Design, build, and operationalize large-scale enterprise data solutions and applications.
• Re-architect and migrate on-premise data warehouses to AWS cloud platforms using native AWS services and Kafka CC.
• Build production-grade data pipelines from ingestion to consumption using Java, PySpark, Scala, and Kafka CC.
• Implement data engineering, ingestion, and curation functions on AWS cloud platforms using custom programming or AWS native tools.
• Assess existing data platforms and define optimal migration paths to AWS cloud.
• Develop and maintain analytical data infrastructure for large-scale datasets and high-performance computing.
• Collaborate with other tech teams to extract, transform, and load data from diverse sources using SQL, AWS big data technologies, and Kafka CC.
• Build and support real-time data pipelines using AWS services, including Glue, Lambda, Step Functions, PySpark, Athena, and Kafka CC.
• Stay updated on emerging big data and visualization technologies to enhance capabilities and efficiency.

Qualifications and experience:

• Bachelor's degree in computer science, information technology, or other relevant fields
• 5 – 8 years’ experience
• Has experience in any of the following AWS Athena and Glue Pyspark, DynamoDB, Redshift, Lambda, Step Functions and Kafka CC
• Proficient in AWS Redshift, S3, Glue, Athena, PySpark, Step Functions, Glue Workflows, Kafka CC, Delta.io
• Knowledge of software engineering best practices across the development lifecycle
• Experience with big data tools is a must: Delta.io, PySpark, Kafka, etc.
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift.

The reference number for this position is NG59270 which is a contract position based in Braamfontein, Johannesburg offering a salary of R900,000 to R1.1mil cost to company per annum negotiable on experience and ability. Contact Nokuthula at e-merge.co.za or call her on 011 463 3633 to discuss this and other opportunities.

 

Are you ready for a change of scenery? E-Merge IT Recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the E-Merge website www.e-merge.co.za for more great positions.

Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!

Posted on 14 Feb 11:34, Closing date 15 Apr