Senior Big Data Engineer Databricks (AWS/Azure)

Position: Senior Big Data Engineer

Employment Type: Full-Time (FTE)

Experience: 8+ Years

Work Mode: Hybrid Client Location (2 3 days/week)

Immediate to 15 Days Preferred

Python

Databricks (AWS Databricks or Azure Databricks) Mandatory

AWS or Azure Cloud

Design, develop, and implement scalable Big Data solutions.

Build high-performance data pipelines using Apache Spark and Python.

Develop and optimize ETL processes for large-scale data processing.

Integrate data from multiple sources including RDBMS, ERP systems, and files.

Optimize Spark jobs for performance and scalability.

Work with cloud-based data platforms using AWS Databricks or Azure Databricks.

Collaborate with cross-functional teams following Agile methodologies.

Required Skills & Experience
8+ years of experience in Big Data and Data Engineering technologies.
Expert-level experience with Apache Spark.
Hands-on programming experience in Python.
Experience with stream processing technologies such as Spark Streaming or Apache Storm.




Experience with messaging platforms like Kafka or RabbitMQ.
Experience integrating data from SQL Server, Oracle, ERP systems, and other enterprise data sources.
Solid SQL skills including joins, stored procedures, and relational database concepts.
Experience with NoSQL databases such as HBase, Cassandra, or MongoDB.
Robust understanding of ETL frameworks and best practices.
Experience in Spark performance tuning.
Hands-on experience with Azure Databricks or AWS Databricks.
Ability to lead technical teams and deliver end-to-end Big Data solutions.
Experience working in Agile development environments.

Chance to work on large-scale global projects.

Continuous learning through online training, knowledge-sharing sessions, and external certifications.

Opportunities for short-term and long-term relocation to global offices.

Individual career development and growth plans.

Health & Medical Insurance

Retirement Benefits

Paid Time Off

Adaptable Benefits Program

~

📌 Senior Big Data Engineer Hybrid Bengaluru
🏢 Cortex Consultants
📍 Bengaluru