Senior Data Engineer - Azure
Location: | Johannesburg |
Remote work: | Only remote work |
Type: | Permanent |
Reference: | #NG59096 |
Company: | E-Merge IT Recruitment |
A technology and analytics-driven consulting company empowering clients by solving real-world business challenges that deliver tangible value, with core capabilities spanning data science, data engineering, and software engineering, is seeking a Senior Azure Data Engineer. This role will involve developing best practices and driving improvements in data engineering across various industries such as mining, telecoms, retail, and financial services.
Responsibilities:
- Analyse and organise raw data
- Design data engineering solutions to meet business requirements
- Build scalable data pipelines that clean, transform, and aggregate data from different sources using appropriate tools and technologies
- Collaborate with data scientists to prepare datasets for analytical modelling
- Identify ways to enhance data quality and reliability
- Manage the technical delivery of projects
- Mentor junior data engineers
- Graduate or postgraduate degree in computer science, information technology, statistics, engineering, or a related technical field
- Two to six years of experience with relational SQL databases
- Solid understanding of Apache Spark as a distributed data processing framework
- Experience in designing, implementing, and performance-tuning solutions in Apache Spark
- Experience in complex data warehouse and data lake design
- Experience in building, optimising, and managing data pipelines for large and complex datasets
- Experience with Azure Storage/Data Lake, Azure SQL Database, Azure Data Factory, Azure Databricks, and Azure Synapse Analytics to implement data pipelines and analytical solutions
- Experience in Python would be beneficial
Are you ready for a change of scenery? E-Merge IT Recruitment is a niche recruitment agency that offers candidates options to successfully place the right people with the right companies, in the right roles. Check out the E-Merge IT website at www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!
Posted on 04 Oct 14:01, Closing date 3 Dec
Machine Learning Engineer
A group providing value-conscious mass-marketing to customers in Southern Africa and leaders in providing innovative financial services have an opportunity for a machine...
Senior C# Software Engineer
Are you ready to explore the future of identity verification software? My dynamic client in the heart of Johannesburg is seeking a Senior C# Software Engineer who is...
Senior C# Software Engineer
Ready to dive into the world of next-gen identity verification software? Our vibrant team in the heart of Johannesburg is on the hunt for a Senior C# Software Engineer...
Senior C# Full Stack Software Engineer
New work in at an award-winning biometrics and identity verification tech shop at the forefront of fintech and software solutions! The current need is for a dynamic and...
Python ETL AWS Software Engineer
Are you ready to pursue a fulfilling career in software development? A prominent player in the field of telecoms big data, invites you to join our Platform Team, the...
Data Engineer - Azure and Fabric
An IT solutions company dedicated to transforming data into actionable insights that drive business decisions is looking for a talented data engineer to join its dynamic...
Senior Data Engineer - Azure
A technology and analytics-driven consulting company empowering clients by solving real-world business challenges that deliver tangible value, with core capabilities...
Electrical Engineer
A company based in Pretoria East is hiring an electrical engineer to work on a diverse range of projects in the public and private sectors.
Senior C# Software Engineer
Ready to dive into the world of next-gen identity verification software? Our vibrant team in the heart of Johannesburg is on the hunt for a Senior C# Software Engineer...
Senior DevOps Engineer
We design for the shapeshifters and deliver products and services that make us incredibly proud of the people who make it happen.
Structural Engineer/Technologist
We are looking for a skilled structural engineer /technologist to provide comprehensive civil and structural engineering services.
Quality Engineer - Software Test Specialist
We are seeking an experienced and self-motivated seasoned Quality Assurance Engineer to join our Agile Team.
Python AWS Software Engineer
Are you ready to pursue a fulfilling career in software development? A prominent player in the field of telecoms big data invites you to join our platform team, the team...
Fullstack Java DevOps Engineer
We focus on innovation topics as well as comprehensive IT solutions such as development and operations for ERP, JAVA, Azure and Cloud solutions.
Machine Learning Engineer
A group providing value-conscious mass-marketing to customers in Southern Africa and leaders in providing innovative financial services have an opportunity for a Machine...
Process Engineer
Job purpose The purpose of this role is for the centre of excellence specialist to oversee the implementation of business analysis standards and practices.
Senior Azure Data Engineer
An autonomous Namibian bank, providing superior financial services to individual and corporate clients, as well as international banking services by liaising directly...
Data Analyst/Engineer
A group with an in-house system that runs all their businesses from life insurance to unit trusts including bringing impact farming to utilities management.
Data Engineer - Azure
A leading telecommunications company, with innovative solutions from designing, building, deploying, and managing high performance computing infrastructure and an...
Senior C# Software Engineer
Ready to dive into the world of next-gen identity verification software? Our vibrant team in the heart of Johannesburg is on the hunt for a Senior C# Software Engineer...
Sound Engineer
Are you passionate about creating unforgettable audio experiences? Do you thrive in high-energy environments and love the thrill of live events? If so, we want...
Senior Data Engineer - Azure
A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core...
Azure Data Engineer
A long serving bank known as Africa's biggest lender of assets and financial services group committed to providing banking insurance and asset management services have...
Senior Software Engineer - Python
A health tech company seeking to lower the cost of quality care to improve access are looking for a Senior Software Engineer (Python).
AWS Data Engineer
Our valued client, a leader in African capital markets and a powerhouse in the automotive industry, is renowned for its diverse product offerings and global reach.
ERP System Software and Hardware Engineer
Our client in the commercial automotive industry is looking for an ERP system software and hardware engineer to join their company in the East Rand area.
Senior Azure Data Engineer
A long serving bank known as Africa's biggest lender of assets and financial services group committed to providing banking insurance and asset management services have...
Junior Data Engineer - Power BI
As a junior data engineer, you will contribute to the development of their revolutionary compliance service platform, the engineer will play a crucial role in...
Senior Cloud Engineer / Developer (C# / Azure)
New work at an African digital tech hub with a core focus on user experience design, web and mobile tech as well as machine learning.
AWS Data Engineer
Pioneers in harnessing the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision...