AWS Data Engineer
Location: | Johannesburg |
Remote work: | Some remote work allowed |
Type: | Permanent |
Reference: | #NG59270 |
Company: | E-Merge IT Recruitment |
Pioneers in harnessing the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision is to provide next generation actionable insights to every company, globally, by harnessing the value of data using high performance, interoperable and simplified solutions are currently looking for an AWS Data Engineer to join their fast-paced and dynamic team!
Responsibilities
- Design, build and operationalise large scale enterprise data solutions and applications
- Analyse, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services and Kafka CC.
- Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, PySpark, Scala, Kafka CC.
- Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
- Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.
- Design, implement and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS big data technologies and Kafka CC.
- Create and support real-time data pipelines built on AWS technologies including Glue, Lambda, Step Functions, PySpark, Athena and Kafka CC.
- Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency.
Qualifications and experience:
- Bachelor's degree in computer science, information technology, or other relevant fields
- 5 – 8 years’ experience
- Has experience in any of the following AWS Athena and Glue Pyspark, DynamoDB, Redshift, Lambda, Step Functions and Kafka CC
- Proficient in AWS Redshift, S3, Glue, Athena, PySpark, Step Functions, Glue Workflows, Kafka CC, Delta.io
- Knowledge of software engineering best practices across the development lifecycle
- Experience with big data tools is a must: Delta.io, PySpark, Kafka, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
Are you ready for a change of scenery? E-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the E-Merge website www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals
Posted on 30 Aug 13:24, Closing date 29 Oct
Or apply with your Biz CV
AWS Data Engineer
Pioneers in harnessing the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior Data Engineer - Azure
New work in at a leading innovator in the tech industry, dedicated to providing cutting-edge solutions that drive business success with clients Globally.
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior C# Full Stack Software Engineer - Node.js + Angular
New wirk in at an award-winning Biometrics and identity verification Tech shop at the forefront of fintech and software solutions! The current need is for a dynamic and...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior Software Engineer - Python and C#
This leading innovator in cloud-based solutions is currently seeking a senior python/C# software engineer to join their team.
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Site Reliability Engineer
Requirements: A bachelor’s degree in computer science, engineering or related field, or equivalent experienceProficient in one or more programming...
![The Skills Mine](https://biz-file.com/b/1905/968227-125x79.png?1)
Senior C# Full Stack Software Engineer
Join the excitement! Ever dreamed of diving into the finance, trading, and capital markets cosmos while coding your way to glory? Here's your chance!...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior C# Full Stack Software Engineer
New work in an award-winning Biometrics and identity verification tech shop at the forefront of fintech and software solutions! The current need is for a dynamic...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior Network Engineer
Overview: A leading organisation is seeking a highly skilled Senior Network Engineer to join their dynamic team in Johannesburg.
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior Network Design Engineer
Overview: An esteemed organisation in Johannesburg is seeking a highly skilled senior network design engineer.
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Audio Engineer - Commercial
Key purpose of the role To form part of the production department audio engineering Team with a focus on Commercial Client audio to ensure that all commercial client...
![Primedia Recruiter](https://biz-file.com/b/2312/2145542-125x35.png?2)
Data Engineer - Azure
A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior C# Full Stack Software Engineer
New work in at a major player in the Finance, Trading and Capital Markets space; focusing on securities, stocks and bonds and working with clients on a global scale! The...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Intermediate Software Engineer
We are currently searching for an Intermediate Software Engineer to join our fast-paced company that works with range of systems within the environment with integration...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Java Software Engineer
We are looking for a Java Software Engineer to join our fast-paced environment we stand at the forefront of innovation, integrating seamlessly with our host network at...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Intermediate Java Software Engineer
Currently in search for an Intermediate Java Software Engineer to join our company that offers end-to-end technology services and solutions, collaborating with customers...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior Java Software Engineer
A company that offers end-to-end technology services and solutions, collaborating with customers to help them go from good to great is currently searching for a Senior...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior Software Engineer
Looking for a Senior Software Engineer to join a team within the Central Services Risk and Compliance division.
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Intermediate Software Engineer
We are currently searching for an intermediate software engineer to join our fast-paced company that works with range of systems within the environment with integration...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Python Django Software Engineer
Looking for an opportunity with a company that is putting digital insurance in the hands of more people.
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Engineering Delivery Lead
A health tech company seeking to lower the cost of quality care to improve access are looking for an engineering delivery lead.
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior Software Engineer
A health tech company seeking to lower the cost of quality care to improve access are looking for a senior software engineer (Python).
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior C# Full Stack Software Engineer
New work in at a major player in the finance, trading and capital markets space; focusing on securities, stocks and bonds and working with clients on a global scale! The...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior Data Development Engineer
A diversified healthcare company with a focus on health administration has a role for a data development engineer.
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
AWS Data Engineer
Pioneers in harnessing the power of artificial intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior Azure Data Engineer
A long serving bank known as Africa's biggest lender of assets and financial services group committed to providing banking insurance and asset management services have...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
CA User Data Engineer
A Global company with a focus on innovation topics as well as comprehensive IT solutions such as Development and Operations is looking for a CA User Data Engineer.
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
AWS Data Engineer
A diversified financial services group, listed on the Johannesburg Stock Exchange and is one of South Africa’s leading direct distributors of financial service...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
AWS Data Engineer
Pioneers in harnessing the power of artificial intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision...
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Senior Data Development Engineer
A diversified healthcare company with a focus on health administration has a role for a Data Development Engineer.
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
Data Engineer
Join a dynamic team at a major telecommunications company in Johannesburg as a data engineer.
![e-Merge IT Recruitment](https://biz-file.com/b/2205/28188-125x37.png?2)
![](/res/img/s.gif)