19 Nov
|
ALOIS Solutions
|
Jamnagar
19 Nov
ALOIS Solutions
Jamnagar
Job highlights
- The ideal candidate should possess strong hands-on experience in Python,PySpark,Informatica,and modern cloud-based data platforms including Databricks,Snowflake,Azure Data Factory (ADF),AWS Glue,and related ETL technologies. .
- Cloud Data Lakes. Batch and Streaming Data Processing
- Experience with BFSI domain projects is preferred. . .
Role Summary We are seeking an experienced ETL Lead with 8-10 years of expertise in designing, developing, and leading enterprise-scale data integration and data modernization initiatives. The ideal candidate should possess strong hands-on experience in Python, PySpark, Informatica, and modern cloud-based data platforms including Databricks, Snowflake, Azure Data Factory (ADF), AWS Glue, and related ETL technologies.
The candidate will be responsible for leading ETL development teams, driving data migration and modernization programs, establishing best practices, ensuring data quality, and delivering scalable data solutions across cloud and on-premises environments.
Key Responsibilities
- Lead end-to-end ETL and Data Engineering projects from requirements gathering through deployment and production support.
- Architect and develop scalable ETL/ELT pipelines using Python, PySpark, Informatica, Databricks, Snowflake, ADF, AWS Glue, and related technologies.
- Collaborate with business stakeholders, architects, and product teams to understand data integration requirements.
- Design and implement reusable frameworks for data ingestion, transformation, validation, and reconciliation.
- Lead cloud migration and data modernization initiatives involving on-premise and cloud ecosystems.
- Drive performance tuning and optimization of ETL jobs, Spark workloads, and data pipelines.
- Establish data quality controls, governance standards, and operational monitoring processes.
- Mentor and guide ETL developers and data engineers through code reviews, design reviews, and technical leadership.
- Coordinate with cross-functional teams to ensure successful project delivery within agreed timelines.
- Troubleshoot complex production issues and provide root cause analysis and remediation plans.
- Support CI/CD implementation, release management, and DevOps best practices for data platforms.
- Mandatory Technical Skills
- Primary Skills
- Strong hands-on experience in:
- Python
- PySpark
- Informatica PowerCenter / IICS (Mandatory)
- Cloud & Contemporary Data Platforms
- Working experience with:
- Databricks
- Snowflake
- Azure Data Factory (ADF)
- AWS Glue
- Other ETL/Data Integration tools
- Database Skills
- SQL development and performance tuning.
- Experience with relational databases such as:
- SQL Server
- Oracle
- PostgreSQL
- Snowflake
- Big Data Technologies
- Apache Spark
- Delta Lake
- Cloud Data Lakes
- Batch and Streaming Data Processing
Desired Skills
- Experience in Data Warehouse modernization projects.
- Knowledge of Data Modeling concepts (Dimensional Modeling, Star Schema,
Snowflake Schema).
- Exposure to Data Governance and Data Quality frameworks.
- Experience working in Agile/Scrum environments.
- Understanding of DevOps, CI/CD pipelines, Git, Jenkins, Azure DevOps, or similar tools.
- Experience with BFSI domain projects is preferred.
- Leadership Expectations
- Lead a team of ETL Developers/Data Engineers.
- Drive technical solutioning and estimation activities.
- Manage project deliverables, risks, dependencies, and stakeholder communications.
- Ensure adherence to coding standards, architecture principles, and delivery excellence.
- Support resource planning, mentoring, and capability development within the team.
Educational Qualification
- Bachelors or Masters Degree in Computer Science, Information Technology, Engineering, or a related field.
- Ideal Candidate Profile
- 10+ years of experience in ETL/Data Engineering.
- Strong expertise in Python, PySpark, and Informatica.
- Demonstrated experience working with Databricks, Snowflake, ADF, AWS Glue, and cloud-native data platforms.
- Proven track record of delivering complex enterprise data integration and data migration programs.
- Excellent communication, stakeholder management, and leadership skills.
Preferred Industry Experience: BFSI, Fintech, Insurance, Healthcare, or large-scale Enterprise Data Platforms. Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 ETL Lead Engineer (Jamnagar)
🏢 ALOIS Solutions
📍 Jamnagar