26 Oct
|
Cepoch
|
Hyderabad
We are looking for an experienced Data migration Engineer / Senior Data Engineer with solid hands-on expertise in SSIS, PySpark, SQL, Databricks, and ETL development. The ideal candidate should have experience in data migration, data pipeline development, performance optimization, and modernizing legacy ETL processes.
Hands-on SSIS experience is mandatory. Candidates should also have practical experience working with Databricks and PySpark to build, maintain, and optimize scalable data engineering solutions.
Key Responsibilities
- Design, develop, and maintain robust ETL/ELT pipelines using SSIS, PySpark, SQL, and Databricks.
- Develop and optimize data processing workflows using Databricks Workflows and Delta Live Tables (DLT).
- Perform SSIS migration and modernization of existing ETL processes to modern data platforms.
- Write and optimize Spark SQL queries for large-scale data processing.
- Develop and maintain data integration solutions, including legacy ColdFusion ETL processes where applicable.
- Implement data transformation, validation, reconciliation, and quality checks.
- Troubleshoot performance bottlenecks and optimize data pipelines, SQL queries, and Spark jobs.
- Schedule and orchestrate data pipelines using Airflow and Databricks Workflows.
- Implement CI/CD practices for data engineering workflows and deployments.
- Collaborate with business analysts, architects, QA teams, and other stakeholders to deliver reliable data solutions.
Mandatory Skills
- 5+ years of overall experience in data engineering, ETL development, or related roles.
- Strong hands-on experience with SSIS (SQL Server Integration Services) – mandatory.
- Strong proficiency in SQL and query optimization.
- Hands-on experience with PySpark and Apache Spark.
- Practical experience with Databricks and data pipeline development.
- Experience in ETL development, data migration, and performance tuning.
Pay: ₹510,000.00 - ₹1,700,000.00 per year
Benefits
- Paid time off
Application Question(s):
- 1. How many years of hands-on experience do you have with SSIS (SQL Server Integration Services)?
- Do you have hands-on experience developing and maintaining SSIS packages?
- How many years of hands-on experience do you have with PySpark?
- Have you worked on SSIS migration or modernization of legacy ETL pipelines?
- Are you immediate joiner ?
- What is your ctc and expected ctc ?
Work Location: In person
📌 Data Migration Engineer (Hyderabad)
🏢 Cepoch
📍 Hyderabad