Senior Engineer- Python Pyspark (Bengaluru)

Senior Engineer- Python Pyspark (Bengaluru)

13 Aug
|
Thales India Private
|
Bengaluru

13 Aug

Thales India Private

Bengaluru

Thales people architect solutions that enable two-thirds of planes to take off and land safely. We create in-flight entertainment systems that engross 50 million fliers every year and we develop the avionics that control the world's largest commercial aircrafts. Our simulators train the next generation of pilots for fighter jets, transporters and search and rescue helicopters. And, together, each and every member of our aerospace team makes a difference.Present in India since 1953, Thales is headquartered in Noida, Uttar Pradesh, and has operational offices and sites spread across Bengaluru, Delhi, Gurugram, Hyderabad, Mumbai, Pune among others. Over 1800 employees are working with Thales and its joint ventures in India. Since the beginning, Thales has been playing an essential role in India's growth story by sharing its technologies and expertise in Defence, Transport, Aerospace and Digital Identity and Security markets.Essential Functions / Key Areas of Responsibility
- Expert in Python, with knowledge of PySpark
- Writing distributed data processing code with PySpark




- Optimizing Spark jobs using DataFrames API and RDDs
- Working with Spark SQL for querying large datasets (structured sql/mysql database)
- Implementing UDFs (User Defined Functions) for custom transformations
- Performance tuning (caching, partitioning, broadcast joins, threading, multiprocessing, Predicate Pushdown)
- ETL development using Databricks workflows and Delta Live Tables
- Data pipelines with Databricks Jobs
- Streaming data processing with Structured Streaming ( event hub or AWS SQS)
- Non structured file processing like parquet , columnar data format
- Responsible for writing reusable, testable and effective code — ensuring the application's performance, security and scalability.
- Excellent problem-solving ability with solid communication and collaboration skills.
- Provide technical documentation for system, features, and components
- Follow and support agile methodologies and pract

📌 Senior Engineer- Python Pyspark (Bengaluru)
🏢 Thales India Private
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior engineer- python pyspark (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: senior engineer- python pyspark (bengaluru) / bengaluru