We are seeking a highly hands-on Core Data Engineer with solid software engineering fundamentals and deep expertise in building scalable data solutions. This is not a traditional ETL-focused role. The ideal candidate will have a strong coding background and experience developing business logic, optimizing large-scale data processing systems, and building high-performance data applications on GCP. You will be responsible for developing and maintaining Spark jobs, enhancing business logic within data pipelines, integrating with Kafka and BigQuery, and improving the performance and scalability of our data platform.
REQUIRED SKILLS AND EXPERIENCE
5+ years of experience in Data Engineering and Backend Software Engineering Strong programming expertise in Scala (preferred), Java, or Python Deep hands-on experience developing and optimizing Apache Spark applications Experience building and maintaining Kafka-based data pipelines Strong experience working with BigQuery and large-scale analytical datasets Advanced SQL skills with experience tuning complex queries
NICE TO HAVE SKILLS AND EXPERIENCE
Experience with Apache Airflow Experience working within Google Cloud Platform (GCP)
📌 Data Engineer (Bengaluru)
🏢 Insight Global
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.