AWS Data Engineer

An IT South Africa hub delivering cutting-edge IT solutions to a global group, specialising in innovative and comprehensive IT services, including development and operations for SAP, Java, Azure, and cloud, is looking for an AWS data engineer. This role ensures deep integration with compliance, IT methodology, and quality standards.

Responsibilities

• Design, build, and maintain big data pipelines.
• Ensure data sharing follows information classification policies and need-to-know principles.
• Stay updated on the latest data engineering tools, technologies, and trends.
• Identify opportunities for process improvement and automation.
• Drive innovation by exploring new data engineering approaches.
• Mentor, train, and upskill team members.

• Relevant IT, business, or engineering degree.

Preferred certifications:

• AWS Certified Cloud Practitioner.
• AWS Certified SysOps Associate.
• AWS Certified Developer Associate.
• AWS Certified Architect Associate.
• AWS Certified Architect Professional.
• HashiCorp Certified Terraform Associate.

Technical skills and knowledge:

• Experience using enterprise collaboration tools (e.g., Confluence, JIRA).
• Developing technical documentation and artefacts.
• Knowledge of data formats (Parquet, AVRO, JSON, XML, CSV).
• Experience with data quality tools (e.g., Great Expectations).
• Developing and working with REST APIs (bonus).
• Proficiency in Terraform, Python 3x, SQL (Oracle/PostgreSQL), PySpark, Boto3, ETL, and Docker.
• Knowledge of Linux/Unix, big data, PowerShell.
• Experience with AWS services, including Glue, CloudWatch, SNS, Athena, S3, Kinesis Streams (Kinesis, Kinesis Firehose), Lambda, DynamoDB, Step Functions, Parameter Store, Secrets Manager, Kafka, AWS EMR, and Redshift.

The reference number for this position is NG60223. This is a contract position based in Johannesburg, offering a salary of R530 up to R630 per hour, negotiable based on experience.

To apply, email Nokuthula at az.oc.egrem-e@galuhtukon or call 011 463 3633 to discuss this and other opportunities.

Are you ready for a change of scenery? E-Merge IT Recruitment is a niche recruitment agency. We offer our candidates options to successfully place the right people with the right companies, in the right roles.

Check out the E-Merge IT website at www.e-merge.co.za for more great positions.

Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!

Posted on 28 Feb 12:24, Closing date 29 Apr