30 Sep
|
Bahwan Cybertek
|
India
30 Sep
Bahwan Cybertek
India
We are seeking an experienced Data Engineer with 5-8 years of experience in designing, developing, and maintaining scalable data pipelines and data platforms. The ideal candidate should have robust expertise in data integration, ETL/ELT processes, cloud data services, and database technologies. The role involves working closely with business stakeholders, data analysts, and data scientists to deliver reliable and high-quality data solutions.
Key Responsibilities
- Design, develop, and optimize scalable data pipelines and workflows. Build and maintain ETL/ELT processes for structured and unstructured data.
- Develop and manage data integration solutions across multiple source systems. Implement data quality, validation, and governance standards.
- Work with large-scale datasets in cloud and on-premises environments. Optimize database performance and data storage solutions.
- Collaborate with Data Scientists and Business Analysts to support analytics and reporting requirements.
- Monitor, troubleshoot, and resolve data pipeline issues. Implement security and compliance requirements for data platforms.
- Participate in code reviews and follow best practices for development.
Required Skills Strong proficiency in SQL and database concepts.
- Experience with ETL/ELT tools and data integration platforms. Hands-on experience with Azure Data Factory, Databricks, Synapse Analytics, or similar cloud technologies.
- Strong knowledge of Python, PySpark, or Scala.
Experience with data warehousing concepts and dimensional modeling.
- Knowledge of Big Data technologies such as Spark and Hadoop.
Experience with Azure Cloud, AWS, or GCP. Understanding of CI/CD, Git, and DevOps practices. Strong analytical and problem-solving skills.
Skills
- Preferred Skills Experience with Snowflake, Delta Lake, or Lakehouse architecture.
- Exposure to AI/ML data preparation and feature engineering.
- Knowledge of data governance and data security standards.
- Relevant cloud certifications (Azure Data Engineer Associate, AWS Data Analytics, etc.).
Qualifications Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. 5-8 years of experience in Data Engineering and Data Integration.
📌 Data Engineer (India)
🏢 Bahwan Cybertek
📍 India