Role Overview:
We are seeking a passionate and detail-oriented Senior Data Engineer with hands-on experience in GCP and Big Data technologies. In this role, you will be responsible for designing and developing scalable, high-performance data processing systems and cloud-based data pipelines.
You will work closely with cross-functional teams including Data Scientists, Analysts, and Cloud Engineers to build robust data solutions that drive business insights and decision-making.
Key Responsibilities:
Design, build, and maintain scalable ETL/ELT pipelines using Google Cloud Platform services such as Big Query, Dataflow, Pub/Sub, and Cloud Storage
Develop and optimize data processing applications using Java for high-volume, low-latency environments
Leverage Apache Spark / Py Spark for distributed data processing and transformation
Write complex and optimized SQL queries for large datasets ensuring performance and efficiency
Work with structured and unstructured data, ensuring data quality, validation, and governance




Collaborate with business stakeholders to understand data requirements and translate them into technical solutions
Perform performance tuning, debugging, and troubleshooting of data pipelines and applications
Contribute to CI/CD pipelines , version control, and deployment automation in cloud environments
Ensure adherence to best practices in data engineering, security, and scalability
Stay updated with emerging trends in Big Data, Cloud, and AI technologies
Primary Skills (Must Have):
Hands-on experience with Google Cloud Platform (GCP) (Big Query, Dataflow, Pub/Sub, Cloud Storage, etc.)
Solid understanding of Big Data ecosystem (Hadoop, Spark, distributed computing concepts)
Proficiency in SQL for data querying and transformation
Experience with Apache Spark / Py Spark
Working knowledge of Python for scripting and data processing
Positive to Have Skills:
Exposure to Generative AI (Gen AI) concepts, tools, or use cases
Familiarity with machine learning pipelines

📌 Senior data engineer (Chennai)
🏢 Impetus
📍 Chennai