01 Oct
|
Vericence
|
Tirupati
01 Oct
Vericence
Tirupati
Job Summary
We are looking for a Senior Data Engineer to design, develop, and maintain scalable data pipelines and up-to-date data solutions. The ideal candidate should have strong experience with Databricks, Snowflake, SQL, Python, ETL, and cloud platforms.
Key Responsibilities
- Design and develop scalable ETL/ELT data pipelines.
- Build and optimize data processing solutions using Databricks and PySpark.
- Develop and manage data solutions using Snowflake.
- Develop complex data transformations using Python and SQL.
- Build and maintain data warehouses, data lakes, and lakehouse solutions.
- Perform data integration, transformation, cleansing, and validation.
- Optimize queries, pipelines, and data processing performance.
- Work with cloud platforms such as AWS, Azure, or GCP.
- Ensure data quality, security, reliability, and governance.
- Collaborate with Data Architects, Analysts, Developers, and business teams.
- Troubleshoot data pipeline and production issues.
- Mentor junior engineers and contribute to technical design decisions.
Required Skills
- 7+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks.
- Strong experience with Snowflake.
- Advanced SQL and Python skills.
- Experience with PySpark / Apache Spark.
- Strong experience with ETL/ELT and data pipeline development.
- Strong understanding of Data Warehousing and Data Modeling.
- Experience with AWS, Azure, or GCP.
- Experience with Git and CI/CD.
- Good understanding of data integration, data quality, and performance optimization.
Preferred Skills
- Apache Kafka / Streaming
- Apache Airflow
- Terraform
- AWS Glue / Azure Data Factory
- Delta Lake
- Cloud-native data engineering
- Data governance and security
📌 Senior Data Engineer (Tirupati)
🏢 Vericence
📍 Tirupati