06 Sep
|
TekIT Software Solutions (India & USA
|
Bengaluru
06 Sep
TekIT Software Solutions (India & USA
Bengaluru
Job Description
Data Engineer – Data Platform
nLocation: Bangalore
nExperience: 5+ Years
n
nRole Overview
nWe are looking for a hands-on Data Engineer to design, develop, and optimize scalable data platforms and data pipelines. The ideal candidate will have strong expertise in Python, SQL, PySpark/Spark, Databricks, and modern data engineering practices.
nCandidates should have hands-on experience with at least one cloud platform – AWS, Azure, or GCP. Experience with BigQuery, Lakehouse architecture, Delta Lake, Airflow, Kafka, and CDC will be highly valued.
nKey Responsibilities
n
- n
- Design, develop, and maintain scalable ETL/ELT data pipelines using Python, SQL, PySpark, and Apache Spark.n
- Build and optimize data processing solutions using Databricks and cloud-native data services.n
- Develop batch and real-time data ingestion pipelines using technologies such as Airflow, Kafka, CDC, and other streaming/integration frameworks.n
- Implement up-to-date Lakehouse and Medallion Architecture using Delta Lake or similar technologies.n
- Develop reliable data pipelines for structured and semi-structured data from multiple sources.n
- Implement data quality, validation, reconciliation, monitoring, logging, and error-handling mechanisms.n
- Optimize Spark jobs and data pipelines for performance, scalability, reliability, and cloud cost efficiency.n
- Work with cloud storage, compute, databases, and data services across AWS, Azure, or GCP.n
- Implement engineering best practices including Git, CI/CD, unit testing, integration testing, and code reviews.n
- Troubleshoot data pipeline failures and resolve performance and data-quality issues.n
- Collaborate with Data Architects, Solution Architects, Analysts, Developers, and Business Stakeholders to understand requirements and deliver scalable data solutions.n
- Contribute to technical design, documentation, coding standards, and continuous improvement of the data platform.n
nMust-Have Skills
n
- n
-
📌 Sr. Data Engineer (Bengaluru)
🏢 TekIT Software Solutions (India & USA
📍 Bengaluru