16 Nov
|
HCL Technologies
|
India
16 Nov
HCL Technologies
India
Job Summary
- 10+ years overall/relevant experience, with substantial Data Engineering experience as we look for Engineer IV
- Robust hands-on Azure Data Engineering
- Strong Azure Data Factory
- Python
- PySpark/Spark
- Advanced SQL
- Data modelling
- ETL/ELT and data pipeline engineering
- Strong database engineering experience
- Evidence of handling senior/complex engineering responsibilities, not just executing predefined development tasks
Key Responsibilities
- Strongly preferred
- PostgreSQL
- Azure-native data services beyond ADF
- Designing scalable data pipelines and data platforms
- Performance optimisation
- CI/CD and engineering practices for data workloads
- Architecture/design ownership
Skill RequirementsArea
What the evaluator appears to expect | Importance | |---------------------------------------------------------------|------------------| | Experience | 10+ years relevant Data Engineering experience | Critical | | Cloud | Strong Microsoft Azure Data Engineering background | Critical | | Data integration | Azure Data Factory (ADF) | Critical | | Big-data engineering | PySpark / Spark | High | | Programming | Strong Python | High | | Database | PostgreSQL / relational database engineering / SQL | High | | Data modelling | Strong data modelling and database design fundamentals | High | | ETL/ELT | Hands-on building and designing enterprise-grade data pipelines | High | | Azure ecosystem | Broader Azure services around data engineering,
not just exposure to ADF | High | | Architecture / seniority | Ability to demonstrate technical depth appropriate to Engineer IV | Critical | | Snowflake / dbt | Useful, but not sufficient as the core skill set | Secondary | | AWS / S3 | Useful additional experience, but does not compensate for lack of Azure | Secondary |
Other Requirements
- Design and implement normalized/dimensional data models (3NF, star/snowflake schemas) on PostgreSQL for transactional and analytical workloads
- Write and optimize complex SQL (queries, stored procedures, indexing strategies, partitioning) for performance at scale
- Build and maintain CI/CD pipelines for database schema changes, migrations, and deployments (e.g., using Git, Jenkins/GitHub Actions, Flyway/Liquibase)
- Containerize and manage database and data-pipeline services using Docker/Kubernetes; support infrastructure-as-code (Terraform/Ansible) for environment provisioning
- Monitor database health, automate backups/recovery, and manage environment promotion (dev QA prod)
- Data modeling and PostgreSQL administration/development
- Strong SQL and schema design skills (normalization, indexing, query optimization)
- Hands-on DevOps experience: CI/CD, containerization (Docker), version control (Git), scripting (Bash/Python)
- Working knowledge of cloud platforms (Azure/AWS/GCP) for hosting and pipeline automation
- Exposure to Power BI (data modeling, DAX basics, Power Query) is a strong plus (Nice to Have)
📌 Senior Technical Specialist (India)
🏢 HCL Technologies
📍 India