Data Engineer

Experience:
3–4 Years

Location:
On-Site

Employment Type:
Full-Time

About BSY Consulting

BSY Consulting
is a technology and IT consulting company focused on helping businesses leverage contemporary technologies to build scalable, secure, and data-driven solutions. We work with cloud platforms, data engineering technologies, and enterprise solutions to help organizations turn complex data into meaningful business insights.

Job Description

We are looking for a
Data Engineer
with
3–4 years of hands-on experience
to design, develop, and optimize scalable data pipelines and data platforms.

The ideal candidate will have strong experience with
Azure cloud services, Apache Spark, Python, and SQL
, along with exposure to real-time data processing and enterprise ETL technologies. The candidate will work closely with cross-functional teams to build reliable, high-performance data solutions.

Key Responsibilities
- Design, develop, and maintain scalable data pipelines using
Azure Databricks
and
Apache Spark
- Develop ETL/ELT processes using PySpark, Python,



and SQL
- Work with structured and unstructured data from multiple sources
- Implement real-time and batch data processing using Kafka
- Develop, monitor, and optimize data workflows on Azure Cloud
- Collaborate with data analysts, data scientists, developers, and business stakeholders
- Ensure data quality, reliability, scalability, and performance across data pipelines
- Use Bitbucket
for source control and follow best practices for code management
- Create and maintain technical documentation, workflows, and processes using
Confluence
- Support data ingestion and transformation using tools such as Informatica
- Troubleshoot, analyze, and resolve data-related issues in production environments
- Contribute to continuous improvement of data engineering processes and solution.

Required Skills & Qualifications
- 3–4 years of professional experience
as a Data Engineer
- Strong hands-on experience with:
- Azure D

📌 Data Engineer (Bhopal)
🏢 BSY Consulting
📍 Bhopal