22 Aug
|
Advance Career Solutions
|
Pune
22 Aug
Advance Career Solutions
Pune
AWS Glue / Databricks Data Engineer
We are looking for an experienced Data Engineer with strong hands-on expertise in AWS Glue and Databricks to design, develop, and maintain scalable data pipelines and data processing solutions.
Key Responsibilities:
- Develop and maintain scalable ETL /ELT pipelines using AWS Glue, Databricks, and PySpark.
- Build data ingestion and transformation workflows using Python and SQL.
- Work with AWS S3, Data Lake, Spark, and Delta Lake for large-scale data processing.
- Optimize data pipelines for performance, scalability, reliability, and cost.
- Perform data validation, troubleshooting, and production support.
- Collaborate with data architects, analysts, and other engineering teams to deliver data solutions.
- Follow best practices for data quality, security, monitoring,
and deployment.
Required Skills:
- Strong hands-on experience with AWS Glue and Databricks.
- Good experience with PySpark, Python, and SQL.
- Robust understanding of Apache Spark and distributed data processing.
- Experience with AWS S3 and cloud-based data lakes.
- Experience developing and supporting production-grade data pipelines.
- Knowledge of Delta Lake and data warehousing concepts is preferred.
- Familiarity with Git, CI/CD, and Agile methodologies is a plus.
Primary Skills: AWS Glue, Databricks, PySpark, Python, SQL, AWS S3, Apache Spark
📌 AWS Data Engineer (Pune)
🏢 Advance Career Solutions
📍 Pune