02 Sep
|
GlobalLogic
|
Hyderabad
02 Sep
GlobalLogic
Hyderabad
Description
- Build & Maintain Pipelines: Design and deploy robust ELT/ETL pipelines using Python and SQL to ingest data from internal applications, third-party APIs, and production databases.
- Data Modeling with dbt: Architect, write, and maintain modular, well-tested dbt models to transform raw data into structured analytics layers.
- Manage Cloud Infrastructure: Leverage the AWS ecosystem to store, process, and orchestrate large-scale datasets efficiently and securely.
- Optimize Performance: Monitor and tune complex SQL queries, dbt runs, and warehouse configurations to keep compute costs down and pipeline speeds high.
- Ensure Data Quality: Implement automated testing, documentation, and data validation rules (via dbt tests or custom scripts) to catch data anomalies before they impact the business.
- Cross-Functional Collaboration: Partner with Data Analysts, Product Managers, and Software Engineers to understand data requirements and deliver optimized schemas.
Requirements
- Experience: 4+ years of qualified data engineering experience in a production environment.
- Expert SQL: Mastery of advanced SQL (CTEs, window functions, complex joins) and a deep understanding of data warehousing principles (e.g., Star Schema, Kimball methodology).
- Strong Python: Proficient in writing clean, reusable Python code for data extraction, manipulation, and pipeline orchestration.
- dbt Proficiency: Hands-on experience using dbt (Core or Cloud) for managing data transformations, testing frameworks, and documentation.
- AWS Cloud Stack: Practical experience with key AWS services, such as S3, Redshift (or Snowflake/Athena on AWS), Lambda, and EC2.
- Orchestration & Tools: Familiarity with data workflow tools (like Apache Airflow, Prefect, or Dagster) and robust version control using Git.
Job responsibilities
Key Responsibilities:
- Pipeline Development: Design, build, and maintain scalable, robust ELT/ETL pipelines using Python and SQL.
- Data Modeling & Transformation: A
📌 Python Data Engineer – DBT, Python, AWS, and SQL0 (Hyderabad)
🏢 GlobalLogic
📍 Hyderabad