SayPro Data Engineer – AWS

Data Engineer – AWS | Email | Print |  PDF   

A fast-paced and innovative financial nistitution seeks the technical expertise of a data engineer with strong AWS whose core focus will be to empower data consumers. You will contribute to the design and development of new cloud workloads for Platform & Product teams while maintaining and managing the existing cloud data environments. The ideal candidate must possess a Bachelor’s Degree in IT or IT related field, have 3 – 5 years proven Computer Programming and Data Engineering experience and proven experience in AWS data stack (AWS Glue, AWS Redshift, AWS S3, AWS Lake Formation), Python, PySpark/Scala, operationalizing Batch and/or Realtime data pipelines, Git, CI/CD and any Infrastructure as Code tool such as Terraform.Duties:Contribute to the design and development of new cloud workloads for platform and product teams, to empower data consumers using data platforms to deliver client value.Maintain and manage the existing cloud data environments and enable data producers to easily contribute to these environments.Contribute to evolving the data platforms through sharing of knowledge, contributing new data features, and enhancing/streamlining existing processes e.g., improved re-use of code.RequirementsQualifications –Bachelor’s degree in information technology or information technology – programming.Honours degree in information technology – computer science or information technology – Systems Engineering (Preferred).Experience/Skills -At least three years’ proven experience in Computer Programming and Data Engineering, together with a relevant 3-year tertiary qualification OR At least 4 – 5 years’ proven experience in Computer Programming and Data Engineering.Proven experience in:AWS data stack (AWS Glue, AWS Redshift, AWS S3, AWS Lake Formation).Operationalizing Batch and/or Realtime data pipelines.Python, PySpark, or Scala.Version control in git, and CI/CD deployment.Any Infrastructure as Code tool.Relational database management systems.Provisioning cloud resources using Infrastructure as Code (Terraform).Core AWS services (S3, EC2, VPC, IAM).Cloud data lake and warehouse concepts.Software Testing practices.Basic Terminal/bash usage.Structured vs Unstructured data.Clear criminal and credit record.Ideal to have –At least three years’ proven experience in cloud data engineering, particularly in AWS, together with a relevant 3-year tertiary qualification ORAt least 4-5 years’ proven experience in cloud data engineering, particularly in AWS.Proven experience in:Apache Spark, Hudi, Presto.Distributed Systems (Apache Hadoop, Amazon EMR).Advanced Shell Scripting.Infrastructure as Code (Terraform).AWS serverless services (Step Functions, Lambda, EventBridge, API Gateway).AWS data lake and warehousing services (Glue, Lake Formation, EMR).Data lake and warehouse architecture.AWS Well-Architected Framework.Collaboration tools (JIRA, Confluence, Draw.io).Trusted insights into Data Governance, Data Management, Data Quality, Data Security and Master Data Management.Solid understanding of:Banking systems environmentBanking business modelAttributes:Analytical.Communications skillsInterpersonal & Relationship Management skills.Problem-solving skills.While we would really like to respond to every application, should you not be contacted for this position within 10 working days please consider your application unsuccessful.Comments:When applying for jobs, ensure that you have the minimum job requirements. Only SA Citizens will be considered for this role. If you are not in the mentioned location of any of the jobs, please note your relocation plans in all applications for jobs and correspondence. Please e-mail a word copy of your CV to target=”_blank and mention the reference numbers of the jobs. We have a list of jobs on . Datafin IT Recruitment – Cape Town Jobs.Posted on 03 Oct 14:46, Closing date 2 Nov