An AWS Databricks Developer designs, develops, and maintains scalable data engineering and analytics solutions on AWS using Databricks. The role focuses on building high-performance ETL/ELT pipelines, processing large-scale data, optimizing Spark workloads, and enabling advanced analytics and machine learning while ensuring data quality, security, and reliability.

Key Responsibilities:
- Design, develop, and maintain data pipelines using Databricks on AWS.
- Build scalable ETL/ELT workflows using Apache Spark (PySpark/Scala/Spark SQL).
- Process and transform structured, semi-structured, and unstructured data from multiple sources.
- Develop and optimize Delta Lake tables for reliable and productive data processing.
- Integrate Databricks with AWS services such as S3, Glue, Lambda, Redshift, RDS, and EMR.




- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Implement data quality checks, monitoring, and error handling.
- Develop reusable notebooks, workflows, and job schedules within Databricks.
- Collaborate with data architects, analysts, data scientists, and business stakeholders.
- Implement security best practices, including IAM roles, encryption, and access controls.
- Support CI/CD and Infrastructure as Code (Terraform/CloudFormation) for data platform deployments.
- Troubleshoot production issues and provide ongoing support for data pipelines.

📌 AWS Databricks Developer (Indore)
🏢 Elabs Infotech
📍 Indore