Job Summary
We are looking for a skilled Data Engineer to design, develop, and maintain scalable data pipelines and data infrastructure. The ideal candidate will have experience in data integration, ETL/ELT processes, database management, and cloud-based data engineering solutions.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines for processing structured and unstructured data.
- Build and optimize ETL/ELT workflows for data extraction, transformation, and loading.
- Develop and maintain data warehouses, data lakes, and data models.
- Write efficient SQL queries and optimize database performance.
- Work with large datasets using Python, SQL, and relevant data processing frameworks.
- Integrate data from multiple sources, including APIs, databases, and external systems.
- Implement data quality checks, validation, and monitoring processes.
- Collaborate with data analysts, data scientists, software engineers, and business teams.
- Ensure data security, integrity, reliability, and availability.
- Troubleshoot data pipeline failures and improve overall system performance.
- Work with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP).
- Maintain technical documentation for data pipelines, workflows, and infrastructure.
Required Skills
- Strong proficiency in SQL and Python.
- Hands-on experience with ETL/ELT tools and data pipeline development.
- Experience with relational databases such as PostgreSQL, MySQL, or SQL Server.
- Knowledge of data warehousing concepts and dimensional data modeling.
- Experience with cloud platforms such as AWS, Azure, or GCP.
- Familiarity with Apache Spark, PySpark, or similar big data technologies.
- Understanding of data integration, transformation, and data quality practices.
- Knowledge of Git, version control, and CI/CD practices.
- Solid analytical, problem-solving, and communication skills.
📌 Data Engineer (India)
🏢 Jenvyqo
📍 India