30 Sep
|
Vericence
|
India
Job Summary
We are looking for a Senior Data Engineer to design, develop, and maintain scalable data pipelines and modern data solutions. The ideal candidate should have strong experience with Databricks, Snowflake, SQL, Python, ETL, and cloud platforms.
Key Responsibilities
- Design and develop scalable ETL/ELT data pipelines.
- Build and optimize data processing solutions using Databricks and PySpark.
- Develop and manage data solutions using Snowflake.
- Develop complex data transformations using Python and SQL.
- Build and maintain data warehouses, data lakes, and lakehouse solutions.
- Perform data integration, transformation, cleansing, and validation.
- Optimize queries, pipelines, and data processing performance.
- Work with cloud platforms such as AWS, Azure, or GCP.
- Ensure data quality, security, reliability, and governance.
- Collaborate with Data Architects, Analysts, Developers, and business teams.
- Troubleshoot data pipeline and production issues.
- Mentor junior engineers and contribute to technical design decisions.
Required Skills
- 7+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks.
- Strong experience with Snowflake.
- Advanced SQL and Python skills.
- Experience with PySpark / Apache Spark.
- Strong experience with ETL/ELT and data pipeline development.
- Strong understanding of Data Warehousing and Data Modeling.
- Experience with AWS, Azure, or GCP.
- Experience with Git and CI/CD.
- Valuable understanding of data integration, data quality, and performance optimization.
Preferred Skills
- Apache Kafka / Streaming
- Apache Airflow
- Terraform
- AWS Glue / Azure Data Factory
- Delta Lake
- Cloud-native data engineering
- Data governance and security
📌 Senior Data Engineer (India)
🏢 Vericence
📍 India