02 Oct
|
Tredence Analytics Solutions
|
India
02 Oct
Tredence Analytics Solutions
India
Required Skills - Mentioned in table below.
Must Have Good to Have Remark # of rounds of interview Option 1 GCP(BQ) Scala Spark SQL Kafka Highest priority to interviews and offers 1 Flocareer + 1 Tredence + 1 Client interview Option 2 Scala, Spark SQL Any Cloud Kafka 2nd Priority Roles and responsibilities -
Tredence is looking for a Data Engineer to design, build, and scale high-performance data platforms and pipelines. The ideal candidate will have strong expertise in Spark, Scala + GCP cloud, with experience leading engineering teams and delivering enterprise-grade data solutions. Exposure to any cloud platform is a plus.
Key Responsibilities
Lead the design and development of scalable, fault-tolerant data pipelines and streaming architectures.
Build and maintain real-time and batch data processing systems using Kafka, Spark, and Scala.
Architect large-scale data solutions ensuring performance, reliability, and security.
Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.
Mentor and guide junior engineers; drive best practices in coding, design, and deployment.
Optimize data workflows and improve system efficiency and scalability.
Implement monitoring, logging, and alerting mechanisms for data platforms.
Drive adoption of up-to-date data engineering practices (CI/CD, data quality frameworks, etc.).
Mandatory Skills
Solid hands-on experience with:
o Apache Kafka (streaming, producers/consumers, topic management)
o Apache Spark (batch & streaming)
o Scala (advanced programming expertise)
Solid understanding of data engineering concepts, distributed systems, and big data architectures
Experience working with large-scale data processing and pipeline development.
Excellent comm skills
Solid problem-solving and leadership skills.
Good to Have (Optional Skills)
Experience with any cloud platform: AWS / Azure / GCP
Knowledge of data lakes, lakehouse architectures (Delta Lake, Iceberg, etc.)
Familiarity with containerization tools (Docker, Kubernetes)
Experience with orchestration tools (Airflow, etc.)
📌 Data Engineer + Scala +spark +sql +gcp Big Query Bengaluru (India)
🏢 Tredence Analytics Solutions
📍 India