05 Aug
|
HCL Technologies
|
Secunderabad
05 Aug
HCL Technologies
Secunderabad
Senior Administrator - Microsoft Forefront Identity Manager
Experience: Not Available to Not Available years
Location: Hyderabad, India
Skills: SQL, dbt (Data Build Tool), Python, Spark, AWS, AWS Glue, PySpark, S3, Athena, IAM permissions, CI/CD, Microsoft Identity Manager, Active Directory, Incident Management, Microsoft Certified: Identity and Access Administrator Associate, Oracle Identity Manager Certification
Job Summary
Job Title: CDI Senior Analytics Engineer
Team: BP technology Customer Data & Intelligence
Contract Type: Immediate Start / Contractor or Permanent
Focus: Code Stabilization, Refactoring, and Data Quality Automation
The Mission
We are looking for a hands-on engineering heavy-hitter to join our Customer Data & Intelligence (CDI) function immediately. We have a rich dataset covering multiple global markets, but our legacy codebase (monolithic SQL and Python scripts) is fragile. Your immediate mission is to triage, refactor, and stabilize our critical data pipelines. You will take "God Queries" and break them down into modular, testable, and performant dbt models.
Immediate Deliverables (First 30-60 Days)
1. The "Code Rescue": Audit and patch critical queries currently causing data corruptions. Fix logic errors.
2. Modularization Pilot: Implement dbt (Data Build Tool) within our AWS/Databricks environment. Migrate the most critical reporting tables from stored procedures/scripts into dbt models.
3. Automated Quality Gates: Deploy automated tests (using dbt tests or Great Expectations) to check for identity uniqueness and any data errors on critical columns. Stop bad data before it hits the dashboard.
Key Responsibilities
• Refactoring: Rewrite inefficient legacy SQL to improve performance and readability.
• Pipeline Repair: Fix error handling in existing AWS Glue/PySpark jobs.
• Standardization: Establish the "Gold Standard" for what good code looks like. Create the Pull Request template and SQL linting rules that the rest of the team must follow.
• Mentorship: Act as the "Bar Raiser" in code reviews, establishing standards and teaching the existing team how to write modular, defensive code.
Technical Requirements (Must Have)
• Expert SQL: You can read a multi thousand-line spaghetti query, understand the intent, and rewrite it into 5 clean,
modular steps without losing logic.
• dbt (Data Build Tool): Proven experience setting up dbt from scratch. You know how to structure a project (Staging -> Intermediate -> Marts).
• Python & Spark: Ability to read and fix PySpark syntax errors and optimize Spark execution plans (Databricks/AWS Glue).
• AWS Ecosystem: Comfortable with S3, Athena, and IAM permissions.
• CI/CD: Experience setting up and running tests automatically on commit.
Why You?
• You hate "Toil." You refuse to check data manually; you write scripts to check it for you.
• You are not afraid of legacy codes. You see a messy codebase as a puzzle to be solved, not a reason to run away.
• You care about Truth. You understand that "mostly correct" data is useless to a business.
Key Responsibilities
Job Title: CDI Senior Analytics Engineer
Team: BP technology Customer Data & Intelligence
Contract Type: Immediate Start / Contractor or Permanent
Focus: Code Stabilization, Refactoring, and Data Quality Automation
The Mission
We are looking for a hands-on engineering heavy-hitter to join our Customer Data & Intelligence (CDI) function immediately. We have a rich dataset covering multiple global markets, but our legacy codebase (monolithic SQL and Python scripts) is fragile. Your immediate mission is to triage, refactor, and stabilize our critical data pipelines. You will take "God Queries" and break them down into modular, testable, and performant dbt models.
Immediate Deliverables (First 30-60 Days)
1. The "Code Rescue": Audit and patch critical queries currently causing data corruptions. Fix logic errors.
2. Modularization Pilot: Implement dbt (Data Build Tool) within our AWS/Databricks environment. Migrate the most critical reporting tables from stored procedures/scripts into dbt models.
3. Automated Quality Gates: Deploy automated tests (using dbt tests or Great Expectations)
to check for identity uniqueness and any data errors on critical columns. Stop bad data before it hits the dashboard.
Key Responsibilities
• Refactoring: Rewrite inefficient legacy SQL to improve performance and readability.
• Pipeline Repair: Fix error handling in existing AWS Glue/PySpark jobs.
• Standardization: Establish the "Gold Standard" for what good code looks like. Create the Pull Request template and SQL linting rules that the rest of the team must follow.
• Mentorship: Act as the "Bar Raiser" in code reviews, establishing standards and teaching the existing team how to write modular, defensive code.
Technical Requirements (Must Have)
• Expert SQL: You can read a multi thousand-line spaghetti query, understand the intent, and rewrite it into 5 clean, modular steps without losing logic.
• dbt (Data Build Tool): Proven experience setting up dbt from scratch. You know how to structure a project (Staging -> Intermediate -> Marts).
• Python & Spark: Ability to read and fix PySpark syntax errors and optimize Spark execution plans (Databricks/AWS Glue).
• AWS Ecosystem: Comfortable with S3, Athena, and IAM permissions.
• CI/CD: Experience setting up and running tests automatically on commit.
Why You?
• You hate "Toil." You refuse to check data manually; you write scripts to check it for you.
• You are not afraid of legacy codes. You see a messy codebase as a puzzle to be solved, not a reason to run away.
• You care about Truth. You understand that "mostly correct" data is useless to a business.
Skill Requirements
1. Proficient In Microsoft Identity Manager And Active Directory, Demonstrating Solid Technical Understanding And Practical Application Of These Technologies.
2. Solid Problem-Solving Skills And The Ability To Perform Root Cause Analysis On Complex Technical Issues.
3. Familiarity With Incident Management Processes And Tools, Ensuring Compliance With Quality Standards And Regulatory Requirements.
4. Excellent Communication And Collaboration Skills For Effective Teamwork And Customer Interaction.
Other Requirements
1. Microsoft Certified: Identity And Access Administrator Associate (Optional But Valuable).
2. Oracle Identity Manager Certification (Optional But Valuable).
📌 Senior Administrator Microsoft Forefront Identity Manager (Secunderabad)
🏢 HCL Technologies
📍 Secunderabad