13 Oct
|
VY SYSTEMS PRIVATE
|
Bengaluru
13 Oct
VY SYSTEMS PRIVATE
Bengaluru
Hiring: ETL Developer – Hadoop & PySpark
Location: Bangalore
Experience: 6–10 Years
Budget: 25–30 LPA
Work Mode: Weekdays
Job Description
We are looking for an experienced ETL Developer with robust expertise in Hadoop, PySpark, Python, and SQL to design, develop, and optimize data processing and transformation solutions. The ideal candidate should have hands-on experience working with big data technologies, building scalable ETL pipelines, and managing data for data warehousing and analytics.
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines for large-scale data processing.
- Develop data transformation workflows using PySpark and Python.
- Work with Hadoop and other big data technologies to process and manage large datasets.
- Write complex SQL queries for data extraction, transformation, validation, and analysis.
- Implement data cleansing, data quality checks, and data validation processes.
- Develop and optimize data integration workflows for data warehousing solutions.
- Troubleshoot ETL failures, performance issues, and data discrepancies.
- Optimize PySpark jobs and SQL queries for performance and scalability.
- Collaborate with data engineers, architects, analysts,
and other stakeholders to deliver reliable data solutions.
- Ensure data accuracy, consistency, and adherence to established data governance standards.
Mandatory Skills
- Strong hands-on experience in ETL development.
- Good experience with Hadoop and big data technologies.
- Proficiency in PySpark and Python programming.
- Strong SQL skills, including complex queries and data manipulation.
- Experience in data processing, data transformation, and data integration.
- Understanding of data warehousing concepts and architecture.
- Experience in developing, debugging, and optimizing ETL pipelines.
Required Experience
- 6–10 years of relevant experience in ETL development and data engineering.
- Practical experience handling large datasets using Hadoop and PySpark.
- Strong analytical, problem-solving, and troubleshooting skills.
- Ability to work independently and collaborate effectively within a team.
Interested candidates can share their updated resumes along with current CTC, expected CTC, notice period, and total relevant experience.
Skills:- ETL, ETL Development, Python and PySpark
📌 ETL Developer (Bengaluru)
🏢 VY SYSTEMS PRIVATE
📍 Bengaluru