Job Description
Responsibilities: - Design, develop, and maintain scalable data pipelines using modern orchestration frameworks (Apache Airflow, Apache Spark, Kafka). - Build data ingestion solutions from diverse sources, including ERP systems (SAP, Oracle), CRM platforms (Salesforce, Workday), and cloud data warehouses. - Implement data quality frameworks, validation rules, and monitoring to ensure high-quality data across all applications. - Optimise data processing workflows for performance, reliability, and cost-efficiency in cloud-native environments. - Collaborate with BI Engineers and Data Modellers to ensure seamless data flow from source systems to analytical dashboards. - Write clean, reusable, and well-tested code following software engineering best practices (code reviews, unit testing, CI/CD). Requirements: - 5-12 years of proven experience in building production-grade data pipelines and ETL/ELT solutions. - Robust proficiency in Python for data engineering (pandas, PySpark, SQLAlchemy, data processing libraries). - Advanced SQL skills, including complex joins,



window functions, query optimisation, and performance tuning. - Hands-on experience with cloud platforms (AWS, Azure, or GCP) and cloud-native data services. - Familiarity with orchestration frameworks such as Apache Airflow, Apache Spark, Kafka, or similar tools. - Experience with modern data warehouses (Snowflake, Databricks, BigQuery, Redshift), including data modelling and optimisation. - Knowledge of ERP/CRM systems integration (SAP, Oracle, Salesforce, Workday) - extracting data via APIs, connectors, or database access. - Strong understanding of data quality principles, testing frameworks, and validation methodologies. - Experience in leveraging or critically thinking about how to integrate AI into work processes, decision-making, or problem-solving. - Experience with AI-powered productivity tools (Cursor, Windsurf, Claude, GitHub Copilot) for accelerated development. - Hands-on Java experi

📌 Data Engineer (Bengaluru East)
🏢 HuntingCube
📍 Bengaluru East