Experience: 6+ Years
Location: Remote
Shift: 11:00 AM – 7:00 PM IST / 12:00 PM – 8:00 PM IST
Employment Type: Contract
Role Summary
We are looking for an experienced Data Engineer to develop and enhance data solutions using Treasure Data, Python, SQL, and AWS. The ideal candidate should be capable of independently troubleshooting ETL workflows, developing API-based data feeds, designing data solutions, and collaborating with globally distributed Agile teams and business stakeholders.
Key Responsibilities
- Develop and maintain data feeds using source APIs.
- Build and enhance Treasure Data workflows and Python-based data solutions.
- Analyze, troubleshoot, and optimize ETL tasks with minimal supervision.
- Design data transformations and propose solutions for complex data challenges.
- Understand data model diagrams and translate business requirements into technical solutions.
- Design and maintain data architecture aligned with business needs.
- Develop QA strategies, test plans, and perform data validation.
- Collaborate with engineering teams and business stakeholders to refine requirements.
- Perform data analysis and support reporting requirements.
- Conduct QA reviews for other team members.
- Document technical solutions, workflows, and implementation approaches.
- Work effectively within Scrum/Kanban environments using Jira and Confluence.
Required Skills & Experience
- 6+ years of experience in Data Engineering.
- Strong hands-on experience with SQL and Python.
- Experience with Presto/Trino.
- Robust database experience with PostgreSQL and AWS Redshift.
- Hands-on experience with Treasure Data, including workflow creation and management.
- Experience with AWS services including:
- S3
- Redshift
- Redshift Spectrum
- Lambda
- Glue
- EC2
- Experience developing and troubleshooting ETL/data pipelines.
- Strong understanding of data models, transformations, data architecture, and data quality.
- Experience working in Scrum/Kanban environments.
- Hands-on experience with Jira, Confluence, Git/Bitbucket.
- Strong analytical and problem-solving skills.
- Ability to work independently and collaborate with globally distributed teams.
Preferred Skills
- Experience with Power BI or other BI tools.
- Knowledge of Object-Oriented Programming and system design.
- Experience supporting marketing/customer data, including Salesforce or Eloqua datasets.
- Experience with Apache Airflow.
- Experience working with Customer Data Platforms.
- Experience developing API-driven data integrations.