Senior Big Data Engineer Databricks (AWS/Azure)

Position: Senior Big Data Engineer

Employment Type: Full-Time (FTE)

Experience: 8+ Years

Work Mode: Hybrid Client Location (2 3 days/week)

Immediate to 15 Days Preferred

Python

Databricks (AWS Databricks or Azure Databricks) Mandatory

AWS or Azure Cloud

Design, develop, and implement scalable Big Data solutions.

Build high-performance data pipelines using Apache Spark and Python.

Develop and optimize ETL processes for large-scale data processing.

Integrate data from multiple sources including RDBMS, ERP systems, and files.

Optimize Spark jobs for performance and scalability.

Work with cloud-based data platforms using AWS Databricks or Azure Databricks.

Collaborate with cross-functional teams following Agile methodologies.

Required Skills & Experience

- 8+ years of experience in Big Data and Data Engineering technologies.
- Expert-level experience with Apache Spark.
- Hands-on programming experience in Python.
- Experience with stream processing technologies such as Spark Streaming or Apache Storm.




- Experience with messaging platforms like Kafka or RabbitMQ.
- Experience integrating data from SQL Server, Oracle, ERP systems, and other enterprise data sources.
- Solid SQL skills including joins, stored procedures, and relational database concepts.
- Experience with NoSQL databases such as HBase, Cassandra, or MongoDB.
- Strong understanding of ETL frameworks and best practices.
- Experience in Spark performance tuning.
- Hands-on experience with Azure Databricks or AWS Databricks.
- Ability to lead technical teams and deliver end-to-end Big Data solutions.
- Experience working in Agile development environments.

Opportunity to work on large-scale global projects.

Continuous learning through online training, knowledge-sharing sessions, and external certifications.

Opportunities for short-term and long-term relocation to global offices.

Individual career development and growth plans.

Health & Medical Insurance

Retirement Benefits

Paid Time Off

Adaptable Benefits Program

~

📌 Senior Big Data Engineer (hybrid) (Bengaluru)
🏢 Cortex Consultants
📍 Bengaluru