Exp : 8 to 15 Years
Location : Banaglore/Hyderabad
Notice period : Immediate/15 Days
JD:
10+ years total experience in Data Engineering, Big Data, or Cloud Data Platforms
5+ years hands-on experience with Databricks (PySpark/Scala, Delta Lake, Lakehouse architecture)
4+ years' experience in AWS Glue (Glue ETL jobs, Workflows, Crawlers, Glue Catalog).
5+ years' experience with Azure ADLS Gen2 (RBAC, ACLs, hierarchical namespaces).
3+ years' experience designing data ingestion and transformation pipelines using Spark-based frameworks.

Responsibilities:

Solution Development

Develop optimized Spark jobs (PySpark/Scala) with robust performance tuning practices.
Implement ETL/ELT pipelines using Databricks notebooks, Workflows, and Glue Jobs.
Integrate data from multiple sources into ADLS / S3 with appropriate security and metadata management.




Build CI/CD pipelines using Azure DevOps / GitHub Actions.

Cloud Infrastructure & Security

Define IAM roles, managed identities, ACLs, and storage permissions for secure operations.
Work with Terraform/CloudFormation for infrastructure automation (preferred).
Monitor cloud resource utilization and optimize cost.

Cross-Functional Collaboration

Interact with stakeholders, analysts, architects, and business teams to translate requirements into technical designs.
Present architectural recommendations and solution proposals to leadership.
Coordinate with DevOps and Cloud Engineering for deployment and operational readiness.

📌 AWS Data Engineer- Databricks (Bengaluru)
🏢 WinWire
📍 Bengaluru