17 Nov
|
V Edge Ai Business Consulting
|
Visakhapatnam
17 Nov
V Edge Ai Business Consulting
Visakhapatnam
Role & responsibilities
We are looking for skilled Data Engineers with strong hands-on experience in Databricks, Microsoft Fabric, Azure Data Factory (ADF), or Snowflake, along with Power BI expertise.
The ideal candidate should have strong Python, PySpark, and SQL skills with experience designing, developing, and optimizing scalable ETL/ELT pipelines, cloud data platforms, and contemporary data architectures.
Preferred candidate profile
- Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks, Microsoft Fabric, ADF, or Snowflake.
- Develop data processing and transformation solutions using Python, PySpark, and SQL.
- Implement Medallion Architecture (Bronze, Silver, Gold).
- Build and manage Data Lakes, Data Warehouses, and Lakehouse architectures.
- Develop and optimize Power BI dashboards, reports, data models, and DAX calculations.
- Work with Microsoft Fabric Dataflow Gen2 for data ingestion and transformation.
- Optimize data pipelines for performance, scalability, and cost efficiency.
- Handle data migration projects from legacy platforms to modern cloud data platforms.
- Implement data quality, governance, security, and lineage standards.
- Work with CI/CD, Git, and DevOps practices for data engineering deployments.
- Monitor, troubleshoot, and optimize data pipelines and reporting solutions.
- Collaborate with business stakeholders and cross-functional teams.
Mandatory Technical Skills
- Databricks / Microsoft Fabric / Azure Data Factory / Snowflake
- Python Programming
- PySpark / Apache Spark
- Advanced SQL
- ETL / ELT Development
- Data Warehousing and Data Lakes
- Medallion Architecture
- Data Modeling Star Schema and Dimensional Modeling
- Power BI DAX, Data Modeling, Dashboards and Reports
- Cloud Platforms – Azure / AWS / GCP
Preferred Skills
- Microsoft Fabric Dataflow Gen2
- Delta Lake and Azure Synapse Analytics
- Snowflake Performance Optimization
- Kafka / Azure Event Hubs / AWS Kinesis
- CI/CD, Git, and DevOps
- Data Migration – Informatica to Fabric, SSIS to ADF, Legacy to Databricks/Fabric
- Machine Learning Pipelines and GenAI Data Workloads
- Data Governance, Data Lineage, and Security
Perks and benefits
📌 Data Engineer (Visakhapatnam)
🏢 V Edge Ai Business Consulting
📍 Visakhapatnam