09 Sep
|
Exillar Infotech Private
|
Ahmedabad
09 Sep
Exillar Infotech Private
Ahmedabad
Job Title: Data Engineer Location: Ahmedabad, India (On-site)
Experience: 2+ Years
About
Exillar is an Ahmedabad-based technology company specializing in Business Intelligence, Data Engineering, and AI-powered solutions. We partner with businesses to build scalable data infrastructure, modern data pipelines, and intelligent systems that turn raw data into a strategic advantage.
Role Overview
We are looking for a skilled and self-driven Data Engineer to join our engineering team. In this role, you will design, build, and maintain the data infrastructure that powers analytics, reporting, and AI/ML workloads - working extensively with SQL, PySpark, Databricks, and modern data warehousing platforms. You will collaborate closely with BI Developers, AI/ML Engineers, and business stakeholders to ensure data is accurate, accessible, and pipeline-ready always.
This role is ideal for someone who enjoys solving complex data movement and transformation challenges at scale, and who takes pride in building systems that others can rely on.
Key Responsibilities
- Design, build, and maintain robust, scalable data pipelines (batch and streaming) for ingestion, transformation, and delivery
- Develop and manage ETL/ELT workflows using tools such as Databricks, Apache Airflow, dbt, or Azure Data Factory
- Write and optimize complex SQL queries for large-scale data transformations and performance tuning
- Build and optimize distributed data processing jobs using PySpark
- Architect and maintain data warehouse and data lake/lakehouse structures optimized for performance and cost
- Ensure data quality, consistency,
and integrity across all pipelines and storage layers
- Collaborate with BI Developers to deliver clean, well-modeled, query-ready data
- Work with AI/ML Engineers to prepare, version, and serve feature-ready datasets
- Monitor, troubleshoot, and optimize pipeline performance and reliability
- Implement and enforce data governance practices - lineage, cataloging, access controls, and documentation Evaluate and recommend tools, technologies, and architectural improvements as data needs evolve
Required Skills & Qualifications
- 2+ years of hands-on experience in data engineering or a closely related role
- Strong command of SQL - complex transformations, performance optimization, and database management
- Hands-on experience with PySpark for large-scale data processing
- Working experience with Databricks (or strong ability to ramp up quickly)
- Strong proficiency in Python for data processing, pipeline development, and automation
- Experience with ETL/ELT tools such as Apache Airflow, dbt, Azure Data Factory, or similar
- Solid understanding of data warehousing solutions - Azure Synapse, Snowflake, BigQuery, or Redshift
- Hands-on experience with cloud data platforms - Microsoft Azure (preferred),
AWS, or GCP
- Understanding of data modeling concepts - normalized, dimensional, and lakehouse architectures
- Experience with version control (Git) and team-oriented development practices
- Bachelor's degree in computer science, Information Technology, or a related field
Good to Have
- Exposure to real-time or streaming data pipelines (Kafka, Azure Event Hubs, or similar)
- Experience with containerization and orchestration - Docker, Kubernetes
- Familiarity with infrastructure-as-code or CI/CD practices in data environments
- Knowledge of data quality frameworks or tools (Great Expectations, Monte Carlo, etc.)
- Basic understanding of ML pipelines and feature stores
- Experience working in Agile or sprint-based delivery teams
Who Will Thrive in This Role Someone who is obsessed with reliability, thinks upstream before downstream, and finds satisfaction in building pipelines that simply never break. If you treat data as a product - not just a byproduct - this role is built for you.
What We Offer
- Work on diverse, complex, real-world data engineering challenges across industries
- Direct collaboration with BI, AI/ML, and product teams in an integrated data environment Structured growth path within a fast-scaling technology company
- A culture that values engineering excellence, ownership, and continuous learning
Pay: ₹700,000.00 - ₹1,100,000.00 per year
Benefits
- Flexible schedule
- Health insurance
- Paid sick time
- Work from home
Work Location: In person
📌 Data Engineer (Ahmedabad)
🏢 Exillar Infotech Private
📍 Ahmedabad