Data Engineer

Experience:
3–4 Years

Location:
In office

Employment Type:
Full-Time

About BSY Consulting

BSY Consulting
is a technology and IT consulting company focused on helping businesses leverage contemporary technologies to build scalable, secure, and data-driven solutions. We work with cloud platforms, data engineering technologies, and enterprise solutions to help organizations turn complex data into meaningful business insights.

Job Description

We are looking for a
Data Engineer
with
3–4 years of hands-on experience
to design, develop, and optimize scalable data pipelines and data platforms.

The ideal candidate will have strong experience with
Azure cloud services, Apache Spark, Python, and SQL
, along with exposure to real-time data processing and enterprise ETL technologies. The candidate will work closely with cross-functional teams to build reliable, high-performance data solutions.

Key Responsibilities
Design, develop, and maintain scalable data pipelines using
Azure Databricks
and
Apache Spark
Develop ETL/ELT processes using PySpark,



Python, and SQL
Work with structured and unstructured data from multiple sources
Implement real-time and batch data processing using Kafka
Develop, monitor, and optimize data workflows on Azure Cloud
Collaborate with data analysts, data scientists, developers, and business stakeholders
Ensure data quality, reliability, scalability, and performance across data pipelines
Use Bitbucket
for source control and follow best practices for code management
Create and maintain technical documentation, workflows, and processes using
Confluence
Support data ingestion and transformation using tools such as Informatica
Troubleshoot, analyze, and resolve data-related issues in production environments
Contribute to continuous improvement of data engineering processes and solution.

Required Skills & Qualifications
3–4 years of professional experience
as a Data Engineer
Solid hands-on experience with:
Azure D

📌 Data Engineer Bhopal
🏢 BSY Consulting
📍 Bhopal