Project Role: Data EngineerProject Role Description:
- Resource should have 5+ years of work experience.
- Robust data warehouse knowledge + Data Analytics in Banking Domain, along with hands-on SQL + Python Skills + DQ.
- Develop, optimize, and maintain complex SQL queries.
- Good understanding of data, users and should be able to write python code to generate reports.
- Build automated data pipelines using Python (Pandas, NumPy, SQLAlchemy, PySpark, etc.).
- Integrate data from multiple sources (APIs, flat files, cloud storage, third-party systems).
- Experience in Handling DWH & Cloud.
Must Have Skills:
- Python Frameworks
Good to Have Skills:
- Ab Initio
Minimum Experience Required:
- Minimum 2 years of experience is required.
Educational Qualification:
- 15 years full-time education.
Summary:
As a Data Engineer, a typical day involves managing and enhancing data infrastructure to support business analytics and reporting needs. The role includes designing and maintaining data pipelines that efficiently collect, process, and integrate data from diverse sources. Collaboration with various teams to understand data requirements and ensure data quality is a key part of daily activities. The position demands continuous monitoring and optimization of data workflows to support timely and accurate data delivery, enabling informed decision-making across the organization.
Roles & Responsibilities:
- Expected to perform independently and become an SME.
- Required active participation/contribution in team discussions.
- Contribute in providing solutions to work-related problems.
- Collaborate with cross-functional teams to gather and analyze data requirements.
- Ensure data pipelines are reliable, scalable, and maintainable to support business needs.
- Assist junior team members by sharing knowledge and providing guidance on best practices.
Professional & Technical Skills:
- Must To Have Skills: Proficiency in Python Frameworks, Ab Initio.
- Experience in developing and optimizing complex data pipelines using Python libraries such as Pandas and NumPy.
- Strong knowledge of data warehousing concepts and ability to work with large datasets.
- Familiarity with integrating data from multiple sources including APIs, flat files, and cloud storage.
- Ability to write efficient SQL queries and work with relational databases.
- Understanding of data quality principles and techniques to ensure data accuracy and consistency.
Additional Information:
- The candidate should have a minimum of 2 years of experience in Python Frameworks.
- This position is based at our PDC3C - SEZ location.
- A 15 years full-time education is required.