About the role
As a senior data engineer, you will play a key role in both development and team support. You will work closely with Tech Leads and Architects, contribute actively to the codebase, and help shape technical solutions across the data engineering team.
Key responsibilities
- Designing and developing data solutions for one of the world’s largest corporations involved in the marketing and distribution of food products
- Implementing distributed and highly available data processing applications that scale for enterprise demands
- Adhering to Continuous Integration and Continuous Delivery of solutions
- Ensuring high code quality by following software engineering best practices
- Working collaboratively in a cross-functional team in an Agile delivery environment
- Adhering to DevOps principles and being involved in projects throughout their full software lifecycle: from development, QA, and deployment to post-production support
What we look for
- A Bachelor’s Degree in Computer Science or equivalent, and 3-5 years of experience in developing enterprise grade data processing applications
- A strong programming background in data ops (Python, Shell, SQL)
- Experience in processing large volumes of data
- Hands-on experience in working with relational/NoSQL databases and distributed storage engines (HDFS, S3, Redshift)
- Hands-on experience in ETL design and development using ETL tools (Preferably Informatica and cloud tools such as AWS Data Pipelines, Glue, Lambda, EMR, Spark, Hive)
- Experience in working with streaming data (using tools such as Kenisis, Kafka, Storm, Spark) will be an added advantage
- Experience in API development and user interfaces and related tools (NodeJS, AngularJS, HTML) will be an added advantage
- Working experience in a Scrum Agile delivery environment and with DevOps practices
- Experience in code management and CI/CD tools such as Github, Gitlab, Jenkins
- Experience in an agile environment and aligning Pod members on technical vision and path to implementation
- A strong desire to continue to grow your skillset
- Strong communication skills that are influential and convincing