01 Sep
|
Publicis Sapient
|
Bengaluru
01 Sep
Publicis Sapient
Bengaluru
Senior Data Engineer (Scala + Azure)
Location: Bangalore
Role Summary
The Senior Associate L2 in Data Engineering will translate client requirements into technical
designs and implement scalable data engineering solutions. The role requires robust hands-on
experience with Scala as the primary programming language and building enterprise-grade data
platforms on Azure. You will independently drive design discussions to ensure platform
reliability, performance, and scalability.
Your Impact
• Data ingestion, integration, and transformation
• Data storage and computation frameworks, performance optimization
• Analytics and visualizations enablement
• Infrastructure and cloud computing on Azure
• Data management platforms
• Build ingestion pipelines from multiple heterogeneous sources in batch and real-time
• Build scalable functionality for data analytics, search, and aggregation
Your Skills & Experience
• Overall experience of 4–9 years with minimum 2 years in Big Data/Data Engineering
• Strong hands-on experience with Scala (primary) and Spark ecosystem
• Strong working knowledge of Azure services such as ADLS Gen2, Databricks, Synapse,
ADF, Event Hubs
• Hands-on experience with Hadoop stack – HDFS, Sqoop, Kafka, Pulsar, Ni Fi, Spark, Spark
Streaming, Flink, Storm, Hive, Oozie, Airflow
• Experience building real-time data pipelines is a strong advantage
• Working knowledge of No SQL and MPP platforms like HBase, Mongo DB, Cassandra, Azure
Synapse, Cosmos DB
• Bachelor’s degree or equivalent practical experience
Set Yourself Apart With
• Experience with traditional ETL tools (Informatica, Talend, etc.) and relational databases
(Oracle, My SQL, SQL Server, Postgres)
• Knowledge of data governance processes (security, lineage, catalog) and tools like Collibra,
Alation
• Knowledge of distributed messaging frameworks like Active MQ / Rabbit MQ / Solace and
microservices architectures
• Performance tuning and optimization of large-scale data pipelines
• Azure cloud or big da
📌 Senior data engineer (Bengaluru)
🏢 Publicis Sapient
📍 Bengaluru