Software Engineer
London
- Data Pipeline
- ETL/ELT
- Data Lake
- CI/CD
We are looking for a Software Engineer with 6+ years of experience
Responsibilities
- Ability to evaluate business requirements and map to the technical stories & tasks
- Should possess good communication skills and be able to articulate thoughts clearly to business and team
- Should be detail oriented with an analytical mind set
Requirements
- Software Engineer with extensive experience of developing data pipelines using core Python
- In-depth knowledge of Business Intelligence concepts like Data Lake, Data Warehouse, Data Mart, etc.
- Experience of working on multiple Data Platforms like Teradata, Snowflake
- Extensive exposure to ELT/ETL with good level SQL skills is required
- Experience of working with at least one of the ETL tool like AWS Glue, Fivetran, Matillion, etc.
- Good to have experience with Apache Airflow
- Should have strong Test Process orientation and familiarity with use case identification
- Should have hands-on experience in Agile, Jira, and Test management tools
- Good to have exposure of developing an automation framework to validate data
- Good understanding of CI/CD process
- Good exposure to AWS Services like AWS Lambda, AWS Glue, S3, IAM, Cloudwatch, SQS, etc.