We are looking for a skilled AWS Databricks Engineer to design, build, and optimize scalable data pipelines and analytics solutions on cloud platforms. The ideal candidate should have solid hands-on experience with Databricks, Spark, and AWS services.
Responsibilities
- Design and develop scalable data pipelines using Databricks and Apache Spark
- Build ETL/ELT workflows using Python, SQL, and PySpark
- Integrate data from multiple sources (structured & unstructured)
- Optimize data processing and performance on Databricks clusters
- Work with AWS services like S3, Glue, Redshift, Lambda, EC2, and RDS
- Implement data governance, security, and best practices
- Collaborate with data engineers, analysts, and business stakeholders