23 Aug
|
Advance Career Solutions
|
Pune
23 Aug
Advance Career Solutions
Pune
AWS Glue / Databricks Data Engineer
We are looking for an experienced Data Engineer with strong hands-on expertise in AWS Glue and Databricks to design, develop, and maintain scalable data pipelines and data processing solutions.
Key Responsibilities:
Develop and maintain scalable ETL /ELT pipelines using AWS Glue, Databricks, and PySpark.
Build data ingestion and transformation workflows using Python and SQL.
Work with AWS S3, Data Lake, Spark, and Delta Lake for large-scale data processing.
Optimize data pipelines for performance, scalability, reliability, and cost.
Perform data validation, troubleshooting, and production support.
Collaborate with data architects, analysts, and other engineering teams to deliver data solutions.
Follow best practices for data quality, security, monitoring,
and deployment.
Required Skills:
Robust hands-on experience with AWS Glue and Databricks.
Valuable experience with PySpark, Python, and SQL.
Robust understanding of Apache Spark and distributed data processing.
Experience with AWS S3 and cloud-based data lakes.
Experience developing and supporting production-grade data pipelines.
Knowledge of Delta Lake and data warehousing concepts is preferred.
Familiarity with Git, CI/CD, and Agile methodologies is a plus.
Primary Skills: AWS Glue, Databricks, PySpark, Python, SQL, AWS S3, Apache Spark
📌 Aws Data Engineer Pune
🏢 Advance Career Solutions
📍 Pune