08 Oct
|
LATENTVIEW ANALYTICS
|
Chennai
08 Oct
LATENTVIEW ANALYTICS
Chennai
Job Summary
We are looking for a Data Engineer / Senior Data Engineer with 4–6 years of overall experience and solid hands-on development experience in Python, SQL, and Google Cloud Platform (GCP). The candidate will be responsible for designing, developing, and maintaining scalable, distributed, and fault-tolerant data pipelines and data applications.
The ideal candidate should have practical experience with BigQuery, Dataflow, Google Cloud Storage (GCS), PostgreSQL, and cloud-based/traditional data warehouses. Experience with Spark, Kafka, Hadoop, Cloud Composer, Pub/Sub, Cloud Functions, and Cloud SQL will be an added advantage.
Job Responsibilities
• Design, develop, and maintain scalable and fault-tolerant data pipelines from scratch.
• Build and optimize data solutions using Python and SQL.
• Develop data pipelines and applications using GCP services, including BigQuery, Dataflow, GCS, and PostgreSQL.
• Work with both relational and non-relational databases to support data integration and analytics requirements.
• Develop and maintain data-focused applications across cloud and traditional data warehouse environments.
• Ensure data pipelines are reliable, scalable, performant, and highly available.
• Troubleshoot data pipeline, application, and production issues and implement appropriate solutions.
• Collaborate with engineering, analytics, and business teams to understand requirements and deliver data solutions.
• Work with big-data technologies such as Apache Spark, Hadoop, and Kafka where required.
• Explore and adopt new tools, technologies, and techniques to improve data engineering processes.
• Provide technical guidance and support to new team members/joiners.
• Contribute to code reviews, documentation, testing, and best practices.
• Work effectively in a dynamic environment where requirements and problems may not always be clearly defined.
• Required Skills
• 4–6 years of Data Engineering experience
• Python & SQL – 3+ years
• GCP – BigQuery, Datafl
📌 Senior Data Engineer (Chennai)
🏢 LATENTVIEW ANALYTICS
📍 Chennai