16 Aug
|
Intelligence India.com
|
Bengaluru
16 Aug
Intelligence India.com
Bengaluru
Data Engineer Job Description
Role: Data Engineer
Experience: 5+ Years
Employment Type: Full-Time/C2H
Location: As per project requirement
Role Summary
We are looking for an experienced Data Engineer to design, develop, and maintain scalable data pipelines and data processing solutions. The ideal candidate will have robust experience in data engineering, ETL/ELT, SQL, Python, cloud platforms, and data warehousing.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines for batch and real-time data processing.
- Develop and optimize ETL/ELT workflows to ingest, transform, and load data from multiple sources.
- Work with structured and unstructured data from databases, APIs, files, and enterprise applications.
- Develop efficient and complex SQL queries for data extraction, transformation, and analysis.
- Build data solutions using Python and other relevant data engineering technologies.
- Design and maintain data warehouses, data lakes, and data models.
- Implement data quality, validation, monitoring, and error-handling processes.
- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
- Collaborate with Data Scientists, Analysts, Architects, Developers, and business stakeholders.
- Troubleshoot production data issues and ensure timely resolution.
- Implement CI/CD and version-control practices for data engineering solutions.
- Prepare technical documentation and maintain data pipeline specifications.
- Follow data security, governance, and engineering best practices.
Mandatory Skills
- Data Engineering
- Python
- SQL
- ETL / ELT
- Data Warehousing / Data Lakes
Good to Have
- AWS / Azure / GCP
- Spark / PySpark
- Databricks
- Snowflake
- Kafka
- Airflow
- Azure Data Factory / AWS Glue
- Docker / Kubernetes
- Git and CI/CD
- Data Governance and Data Quality
Candidate Profile
- 5+ years of hands-on experience in Data Engineering.
- Strong programming experience with Python.
- Excellent SQL and database know
📌 Data Engineer (Bengaluru)
🏢 Intelligence India.com
📍 Bengaluru