Data Engineer with Python (Hubballi)

Data Engineer with Python (Hubballi)

19 Nov
|
ALOIS Solutions
|
Hubballi

19 Nov

ALOIS Solutions

Hubballi

Job highlights

- Required Skills and Qualifications

Job Summary

We are seeking a highly skilled Senior Data Engineer to design, build, and optimize robust data pipelines. You will bridge multiple cloud ecosystems, focusing on Microsoft Azure and Google Cloud Platform (GCP). In this role, you will leverage Python, Azure Data Factory, Databricks, and Google Data Engineering tools to transform raw data into actionable enterprise insights.

Key Responsibilities

- Pipeline Development: Design, build, and maintain scalable ETL/ELT workflows using Azure Data Factory (ADF) and Google Cloud Dataflow/Dataproc. [

- Big Data Processing: Write high-performance Python, PySpark, and SQL code within Databricks to process massive datasets.

- Data Architecture: Build and optimize Lakehouse architectures (Delta Lake) for structured and unstructured data storage.

- Cloud Migration: Implement cross-cloud data ingestion and synchronization strategies between Azure and GCP environments.

- Performance Tuning: Optimize slow-running queries, monitor pipeline execution costs, and manage cluster resources efficiently.

- CI/CD Automation: Deploy and manage infrastructure as code (IaC)



and automated data pipelines using Git, Azure DevOps, or GCP Cloud Build.

Required Skills and Qualifications

- Programming: Advanced proficiency in Python and PySpark for data manipulation and automation.

- Azure Ecosystem: Deep hands-on experience with Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), and Azure Key Vault.

- Databricks: Solid expertise in Delta Lake, Databricks Workflows, Unity Catalog, and cluster optimization.

- Google Cloud: Proficient with Google Data Engineering tools including BigQuery, Cloud Composer (Apache Airflow), Pub/Sub, and Cloud Storage.

- Data Modeling: Strong understanding of relational databases, NoSQL, data warehousing concepts (Star/Snowflake schemas), and modern Lakehouse design.

- DevOps: Experience with version control (Git) and CI/CD deployment pipelines.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Data Engineer with Python (Hubballi)
🏢 ALOIS Solutions
📍 Hubballi

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data engineer with python (hubballi) / hubballi

Subscribe to this job alert:

Get the latest job offers by email for: data engineer with python (hubballi) / hubballi