Data Engineer

Experience: 3–4 Years

Location: On-Site

Employment Type: Full-Time

About BSY Consulting

BSY Consulting is a technology and IT consulting company focused on helping businesses leverage up-to-date technologies to build scalable, secure, and data-driven solutions. We work with cloud platforms, data engineering technologies, and enterprise solutions to help organizations turn complex data into meaningful business insights.

We are looking for a Data Engineer with 3–4 years of hands-on experience to design, develop, and optimize scalable data pipelines and data platforms.

The ideal candidate will have strong experience with Azure cloud services, Apache Spark, Python, and SQL , along with exposure to real-time data processing and enterprise ETL technologies. The candidate will work closely with cross-functional teams to build reliable, high-performance data solutions.

Key Responsibilities

- Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark
- Develop ETL/ELT processes using PySpark, Python, and SQL
- Work with structured and unstructured data from multiple sources
- Implement real-time and batch data processing using Kafka
- Develop, monitor, and optimize data workflows on Azure Cloud
- Collaborate with data analysts, data scientists, developers, and business stakeholders
- Ensure data quality, reliability, scalability, and performance across data pipelines
- Use Bitbucket for source control and follow best practices for code management
- Create and maintain technical documentation, workflows, and processes using Confluence
- Support data ingestion and transformation using tools such as Informatica
- Troubleshoot, analyze,



and resolve data-related issues in production environments
- Contribute to continuous improvement of data engineering processes and solution.

Required Skills & Qualifications
- 3–4 years of professional experience as a Data Engineer
- Strong hands-on experience with:
- Azure Databricks
- Apache Spark / PySpark
- Python
- SQL
- Good understanding of Azure Cloud services , including:
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS)
- Azure Synapse Analytics – preferred
- Hands-on experience with Kafka for real-time data streaming
- Knowledge of Informatica for ETL/data integration
- Experience using Bitbucket for version control
- Familiarity with Confluence for technical documentation
- Strong understanding of data modeling, ETL/ELT design, and performance tuning
- Good analytical, problem-solving, and communication skills

Preferred Qualifications
- Experience working in Agile/Scrum environments
- Exposure to data warehousing and big data architectures
- Understanding of CI/CD pipelines for data engineering workflows
- Experience working with large-scale datasets
- Knowledge of cloud-based data engineering best practices

What We Offer
- Prospect to work with modern cloud, data, and big data technologies
- Collaborative and learning-focused work environment
- Competitive compensation and benefits
- Career growth and continuous upskilling opportunities
- Exposure to challenging enterprise data engineering projects

Join BSY Consulting If you're passionate about data engineering, cloud technologies, and building scalable data solutions , we'd love to hear from you.

- Apply now and take the next step in your Data Engineering career with BSY Consulting.

📌 Data Engineer (Bhopal)
🏢 BSY Consulting
📍 Bhopal