22 Aug
|
Revolite Infotech
|
India
22 Aug
Revolite Infotech
India
Data Engineer – Data Engineering
Job Title: Data Engineer – Data Engineering
Experience: 4+ Years
Job Type: Full-Time
Location: Remote / As per business requirement
Job Summary
We are looking for an experienced Data Engineer with 4+ years of hands-on experience in designing and developing scalable data engineering solutions. The ideal candidate should have strong expertise in Python, PySpark, Apache Spark, AWS, and Azure, along with experience handling large and complex datasets.
The candidate will be responsible for developing complex ETL/data transformation pipelines, working with cloud data engineering services, supporting data modeling initiatives, and independently leading data engineering projects.
Key Responsibilities
- Handle large, complex, multi-dimensional datasets, including structured, unstructured, and real-time data.
- Design and develop complex data transformation and ETL pipelines using Python, PySpark, and Apache Spark.
- Work extensively with AWS and Azure cloud services within the data engineering ecosystem.
- Design, develop, and maintain scalable, reliable, and high-performance data pipelines.
- Work with on-premises and cloud-based data warehouses and understand their architecture.
- Develop and maintain data models based on business and technical requirements.
- Independently lead and deliver data engineering projects from requirements through implementation.
- Troubleshoot and resolve data engineering, performance, scalability, and pipeline-related issues.
- Ensure data pipelines and processes meet required standards for scalability, reliability, efficiency, and data quality.
- Stay updated with emerging data engineering tools, technologies, and industry best practices.
- Collaborate with Data Scientists, Data Analysts, Business Stakeholders,
and other technical teams to understand requirements and deliver effective solutions.
- Prepare and maintain technical specifications, architecture/design documents, and technical best practices.
- Communicate complex technical and design concepts effectively to technical and non-technical stakeholders.
- Contribute to team objectives and collaborate effectively to deliver project requirements.
Required Skills
- 4+ years of experience in Data Engineering
- Strong hands-on experience with Python
- Strong experience with PySpark and Apache Spark
- Experience developing ETL/ELT and data transformation pipelines
- Hands-on experience with AWS and Azure
- Strong understanding of cloud-based data engineering services
- Experience with AWS Glue, EMR, Azure Data Factory, or similar services
- Strong understanding of Data Warehousing
- Experience with On-Premise and Cloud Data Warehouse environments
- Knowledge of Data Modeling concepts and principles
- Robust analytical, problem-solving, and troubleshooting skills
- Excellent communication and stakeholder-management skills
Good to Have
Experience or knowledge of the following will be an added advantage:
- Snowflake
- Dataiku
- Alteryx
- Other modern cloud data engineering technologies and platforms
Qualification
- Bachelor's Degree in Computer Science, Information Technology, Engineering, or a related discipline.
- Equivalent practical experience may also be considered.
What We're Looking For
- Ability to work independently and take ownership of projects.
- Strong technical leadership and decision-making capabilities.
- Ability to translate complex business requirements into scalable data engineering solutions.
- Strong communication skills with the ability to explain complex technical concepts clearly.
- Passion for learning emerging data engineering technologies and best practices.
Pay: Up to ₹100,000.00 per year
Work Location: Remote
📌 Sr. Data Engineer (India)
🏢 Revolite Infotech
📍 India