01 Oct
|
Tredence Analytics Solutions
|
Bengaluru
01 Oct
Tredence Analytics Solutions
Bengaluru
Required Skills - Mentioned in table below
Must Have Good to Have Remark # of rounds of interview Option 1 GCP(BQ) Scala Spark SQL Kafka Highest priority to interviews and offers 1 Flocareer + 1 Tredence + 1 Client interview
Option 2 Scala, Spark SQL Any Cloud Kafka 2nd Priority Roles and responsibilities -
Tredence is looking for a Data Engineer to design, build, and scale high-performance data platforms and pipelines. The ideal candidate will have strong expertise in Spark, Scala + GCP cloud, with experience leading engineering teams and delivering enterprise-grade data solutions. Exposure to any cloud platform is a plus.
Key Responsibilities
- Lead the design and development of scalable, fault-tolerant data pipelines and streaming architectures.
- Build and maintain real-time and batch data processing systems using Kafka, Spark, and Scala.
- Architect large-scale data solutions ensuring performance, reliability, and security.
- Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.
- Mentor and guide junior engineers; drive best practices in coding, design, and deployment.
- Optimize data workflows and improve system efficiency and scalability.
- Implement monitoring, logging, and alerting mechanisms for data platforms.
- Drive adoption of modern data engineering practices (CI/CD, data quality frameworks, etc.).
________________________________________
Mandatory Skills
Strong hands-on experience with:
o Apache Kafka (streaming, producers/consumers, topic management)
o Apache Spark (batch & streaming)
o Scala (advanced programming expertise)
Solid understanding of data engineering concepts, distributed systems, and big data architectures
Experience working with large-scale data processing and pipeline development.
Excellent comm skills
Solid problem-solving and leadership skills.
________________________________________
Good to Have (Optional Skills)
Experience with any cloud platform: AWS / Azure / GCP
Knowledge of data lakes, lakehouse architectures (Delta Lake, Iceberg, etc.)
Familiarity with containerization tools (Docker, Kubernetes)
Experience with orchestration tools (Airflow, etc.)
📌 Data engineer + Scala +Spark +SQL +GCP Big query (Bengaluru)
🏢 Tredence Analytics Solutions
📍 Bengaluru