- AWS Glue, AWS Redshift/Spectrum, S3, API Gateway, Athena, Step and Lambda functions
• Solid knowledge on Databricks
• Experience in Extract Transform Load (ETL) and Extract Load & Transform (ELT) data integration pattern.
• Experience in designing and building data pipelines.
• Development experience in one or more object-oriented programming languages, preferably Python
• Advanced SQL knowledge/Robust SQL
• Experience designing and implementing large-scale distributed systems
• Maintains and improves CI / CD pipeline Role & responsibilities
- - - Domain: Oil and gas