13 Nov
|
IBS Software Services
|
Kochi
13 Nov
IBS Software Services
Kochi
Job highlights
- . Data Engineering & Architecture: Strong understanding of data engineering patterns and modern architectures such as Data Mesh,Data Fabric,Data Lake,and Data Warehouse . . Big Data & Cloud: Proficiency in Amazon EMR,AWS Glue,Data Lake,and technologies for processing large datasets
- Version Control: Experience with Git and modern development practices
Job Title Lead Data Engineer Location (s) Cochin Years of Experience 5-10yrs
Lead Data Engineer
What You ll Do
- Lead the design, development, and maintenance of scalable ETL/ELT pipelines and data products in multi-cloud, multi-region, distributed environments.
- Define and apply appropriate data engineering patterns and architectures based on business and technical requirements.
- Drive technical investigations and resolve complex data, operational, and production issues .
- Design scalable, flexible, efficient, and supportable solutions using appropriate technologies and disciplined development practices.
- Provide technical leadership, guidance, and mentorship to data engineering teams.
- Collaborate with architects, engineering teams, and business stakeholders to deliver robust data solutions.
Key Skills
- Data Engineering & Architecture: Solid understanding of data engineering patterns and modern architectures such as Data Mesh, Data Fabric, Data Lake, and Data Warehouse .
- Big Data & Cloud: Proficiency in Amazon EMR, AWS Glue, Data Lake , and technologies for processing large datasets.
- Programming: Strong proficiency in Python, Java, or Scala , with solid OOP expertise.
- Data Warehousing: Strong knowledge of data warehousing solutions, preferably Snowflake .
- ETL/ELT & Orchestration:
Hands-on experience with ETL/ELT pipelines and data orchestration tools .
- Databases: Strong expertise in relational and NoSQL databases .
- Data Modelling: Experience designing efficient OLAP and OLTP data models .
- Streaming: Knowledge of streaming data technologies and architectures .
- Version Control: Experience with Git and modern development practices.
- Containers & Orchestration: Understanding of Docker and Kubernetes .
- Data Security: Knowledge of encryption, access control, data privacy, and compliance .
- Monitoring & Logging: Experience implementing monitoring, logging, alerting, and observability for data pipelines. Role & Responsibilities
- Lead Data Engineer
- What You ll Do
- Lead the design, development, and maintenance of scalable ETL/ELT pipelines and data products in multi-cloud, multi-region, distributed environments.
- Define and apply appropriate data engineering patterns and architectures based on business and technical requirements.
- Drive technical investigations and resolve complex data, operational, and production issues .
- Design scalable, flexible, efficient, and supportable solutions using appropriate technologies and disciplined development practices.
- Provide technical leadership, guidance, and mentorship to data engineering teams.
- Collaborate with architects,
engineering teams, and business stakeholders to deliver robust data solutions.
- Key Skills
- Data Engineering & Architecture: Strong understanding of data engineering patterns and modern architectures such as Data Mesh, Data Fabric, Data Lake, and Data Warehouse .
- Big Data & Cloud: Proficiency in Amazon EMR, AWS Glue, Data Lake , and technologies for processing large datasets.
- Programming: Strong proficiency in Python, Java, or Scala , with solid OOP expertise.
- Data Warehousing: Robust knowledge of data warehousing solutions, preferably Snowflake .
- ETL/ELT & Orchestration: Hands-on experience with ETL/ELT pipelines and data orchestration tools .
- Databases: Strong expertise in relational and NoSQL databases .
- Data Modelling: Experience designing efficient OLAP and OLTP data models .
- Streaming: Knowledge of streaming data technologies and architectures .
- Version Control: Experience with Git and modern development practices.
- Containers & Orchestration: Understanding of Docker and Kubernetes .
- Data Security: Knowledge of encryption, access control, data privacy, and compliance .
- Monitoring & Logging: Experience implementing monitoring, logging, alerting, and observability for data pipelines.
Technical Qualifications Python + AWS EMR + AWS Glue + Snowflake + ETL/ELT + Data Engineering + Data Architecture + Big Data + SQL
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Data Engineer (Kochi)
🏢 IBS Software Services
📍 Kochi