- Design, develop, and maintain robust and scalable data pipelines that ingest, transform, and load data from various sources into data warehouse.
- Collaborate with business stakeholders to understand data requirements and translate them into technical solutions.
- Implement data quality checks and monitoring to ensure data accuracy and integrity.
- Optimize data pipelines for performance and efficiency.
- Troubleshoot and resolve data pipeline issues.
- Stay up-to-date with emerging technologies and trends in data engineering.
Qualifications
- Bachelor s or Master s degree in Computer Science, Engineering, or a related field.
- 7+ years of experience in data engineering or a similar role.
- Robust proficiency in SQL and at least one programming language (e.g., Python, Java).
- Experience with data pipeline tools and frameworks
- Experience with cloud-based data warehousing solutions (Snowflake).
- Experience with AWS Kinesis, SNS, SQS
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills.
Desired Skills & Experience:
- Data pipeline architecture
- Data warehousing
- ETL (Extract, Transform, Load)
- Data modeling
- SQL
- Python or Java or Go
- Cloud computing
- Business intelligence