Lead Data Engineer055 (Bengaluru)

Lead Data Engineer055 (Bengaluru)

16 Nov
|
brillio-2
|
Bengaluru

16 Nov

brillio-2

Bengaluru

Lead Data Engineer
Primary Skills

GCP, Big Query, Python, Airflow, SQL, DBT
Job requirements

About the Role
We are seeking aSenior Data Engineerwith deep expertise inGoogle Cloud Platform (GCP)andBigQueryto lead cloud modernization initiatives, develop scalable data pipelines, and enable real-time data processing for enterprise-level systems. This is a high-impact role focused on driving the transformation of legacy infrastructure into a robust, cloud-native data ecosystem.

Key Responsibilities
1.Data Migration & Cloud Modernization
Analyze legacy on-premises and hybrid cloud data warehouse environments (e.g., SQL Server).
Lead the migration of large-scale datasets toGoogle BigQuery.
Design and implement data migration strategies ensuring dataquality,integrity, andperformance.
2.Data Integration & Streaming
Integrate data from various structured and unstructured sources, includingAPIs,relational databases, andIoT devices.
Buildreal-time streaming pipelinesfor large-scale ingestion and processing of IoT and telemetry data.
3.ETL / Data Pipeline Development
Modernize and refactor legacySSIS packagesintocloud-native ETL pipelines.
Develop scalable, reliable workflows usingApache Airflow,Python,Spark, andGCP-native tools.
Ensure high-performance data transformation and loading intoBigQueryfor analytical use cases.
4.Programming & Query Optimization
Write and optimize complexSQL queries, stored procedures, and scheduled jobs within BigQuery.
Developmodular,reusable transformation scriptsusingPython,Java,Spark, and SQL.
Continuously monitor and optimizequery performanceandcost efficiencyin the cloud data workplace.





Required Skills & Experience
5+ years inData Engineeringwith a strong focus on cloud and big data technologies.
Minimum2+ years of hands-on experience with GCP, specificallyBigQuery.
Proven experience migrating on-premise data systems to thecloud.
Strong development experience withApache Airflow,Python, andApache Spark.
Expertise instreaming data ingestion, particularly inIoT or sensor dataenvironments.
StrongSQLdevelopment skills; experience withBigQuery performance tuning.
Solid understanding ofcloud architecture,data modeling, anddata warehouse design.
Familiarity withGitand CI/CD practices for managing data pipelines.

Preferred Qualifications
GCP Professional Data Engineercertification.
Experience with modern data stack tools likedbt,Kafka, orTerraform.
Exposure toML pipelines,analytics engineering, orDataOps/DevOpsmethodologies.

Why Join Us?
Work with cutting-edge technologies in a fast-paced, collaborative environment.
Lead cloud transformation initiatives at scale.
Competitive compensation and benefits.
Remote flexibility and growth opportunities.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

📌 Lead Data Engineer055 (Bengaluru)
🏢 brillio-2
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead data engineer055 (bengaluru) / bengaluru