02 Oct
|
Vericence
|
Aurangabad
02 Oct
Vericence
Aurangabad
Job Summary
We are looking for a Senior Data Engineer to design, develop, and maintain scalable data pipelines and modern data solutions. The ideal candidate should have strong experience with Databricks, Snowflake, SQL, Python, ETL, and cloud platforms.
Key Responsibilities
Design and develop scalable ETL/ELT data pipelines.
Build and optimize data processing solutions using Databricks and PySpark.
Develop and manage data solutions using Snowflake.
Develop complex data transformations using Python and SQL.
Build and maintain data warehouses, data lakes, and lakehouse solutions.
Perform data integration, transformation, cleansing, and validation.
Optimize queries, pipelines, and data processing performance.
Work with cloud platforms such as AWS, Azure, or GCP.
Ensure data quality, security, reliability, and governance.
Collaborate with Data Architects, Analysts, Developers, and business teams.
Troubleshoot data pipeline and production issues.
Mentor junior engineers and contribute to technical design decisions.
Required Skills
7+ years of experience in Data Engineering.
Robust hands-on experience with Databricks.
Solid experience with Snowflake.
Advanced SQL and Python skills.
Experience with PySpark / Apache Spark.
Strong experience with ETL/ELT and data pipeline development.
Solid understanding of Data Warehousing and Data Modeling.
Experience with AWS, Azure, or GCP.
Experience with Git and CI/CD.
Valuable understanding of data integration, data quality, and performance optimization.
Preferred Skills
Apache Kafka / Streaming
Apache Airflow
Terraform
AWS Glue / Azure Data Factory
Delta Lake
Cloud-native data engineering
Data governance and security
📌 Senior Data Engineer Aurangabad
🏢 Vericence
📍 Aurangabad