17 Sep
|
Insight Global
|
Bengaluru
17 Sep
Insight Global
Bengaluru
JOB DESCRIPTION
We are seeking a highly hands-on Core Data Engineer with strong software engineering fundamentals and deep expertise in building scalable data solutions. This is not a traditional ETL-focused role. The ideal candidate will have a strong coding background and experience developing business logic, optimizing large-scale data processing systems, and building high-performance data applications on GCP. You will be responsible for developing and maintaining Spark jobs, enhancing business logic within data pipelines, integrating with Kafka and BigQuery, and improving the performance and scalability of our data platform.
REQUIRED SKILLS AND EXPERIENCE
5+ years of experience in Data Engineering and Backend Software Engineering Strong programming expertise in Scala (preferred), Java, or Python Deep hands-on experience developing and optimizing Apache Spark applications Experience building and maintaining Kafka-based data pipelines Robust experience working with BigQuery and large-scale analytical datasets Advanced SQL skills with experience tuning complex queries
NICE TO HAVE SKILLS AND EXPERIENCE
Experience with Apache Airflow Experience working within Google Cloud Platform (GCP)
📌 Data Engineer (Bengaluru)
🏢 Insight Global
📍 Bengaluru