20 Aug
|
Impetus
|
Hyderabad
Indore / Bangalore / Pune / Hyderabad
Top of Form
Job Description
Key Responsibilities
- Design and develop scalable data engineering solutions using Python, Spark, and SQL to support high‑volume data processing needs.
- Architect and optimize end‑to‑end data pipelines on AWS, ensuring reliability, performance, and cost efficiency.
- Collaborate with stakeholders to translate BFSI domain requirements into technical architectures and data models.
- Lead the development of frameworks/project, ensuring strong governance and best practices.
- Conduct code reviews, performance tuning, and solution validation for data engineering components.
- Provide architectural guidance and support for Databricks‑based processing (good to have).
- Exp of AI/ML components, including feature engineering and model deployment support.
- Ensure solutions align with security, compliance, and data quality standards—critical for BFSI environments.
- Mentor junior engineers and contribute to technical roadmaps, documentation, and design reviews.
- Troubleshoot complex issues across data pipelines,
AWS services, and distributed systems.
Required Skills & Experience
- 12-15 years of strong experience as a Data Engineer or in a similar technical role with exposure to solution design/architecture.
- Hands‑on expertise in Python for building robust data pipelines and reusable engineering components.
- Advanced experience with Apache Spark (PySpark preferred), including performance tuning and optimization.
- Strong SQL expertise—query optimization, transformations, and working with structured/semi‑structured data.
- Solid experience with AWS services such as S3, Glue, Lambda, EMR, EC2, RDS, IAM, CloudWatch, airflow, step functions etc.
- Robust understanding of observability platforms and their role in monitoring distributed systems.
- Hands‑on experience with cloud observability tools, specifically AWS CloudWatch and AWS CloudTrail
- Experience in designing data workflows in Databricks (good to
📌 Technical Architect-AWS Architect (Hyderabad)
🏢 Impetus
📍 Hyderabad