03 Sep
|
GlobalLogic
|
Hyderabad
03 Sep
GlobalLogic
Hyderabad
Description
Build & Maintain Pipelines: Design and deploy robust ELT/ETL pipelines using Python and SQL to ingest data from internal applications, third-party APIs, and production databases.
Data Modeling with dbt: Architect, write, and maintain modular, well-tested dbt models to transform raw data into structured analytics layers.
Manage Cloud Infrastructure: Leverage the AWS ecosystem to store, process, and orchestrate large-scale datasets efficiently and securely.
Optimize Performance: Monitor and tune complex SQL queries, dbt runs, and warehouse configurations to keep compute costs down and pipeline speeds high.
Ensure Data Quality: Implement automated testing, documentation, and data validation rules (via dbt tests or custom scripts) to catch data anomalies before they impact the business.
Cross-Functional Collaboration: Partner with Data Analysts, Product Managers, and Software Engineers to understand data requirements and deliver optimized schemas.
Requirements
Experience: 4+ years of qualified data engineering experience in a production setting.
Expert SQL: Mastery of advanced SQL (CTEs, window functions, complex joins) and a deep understanding of data warehousing principles (e.g., Star Schema, Kimball methodology).
Robust Python: Proficient in writing clean, reusable Python code for data extraction, manipulation, and pipeline orchestration.
dbt Proficiency: Hands-on experience using dbt (Core or Cloud) for managing data transformations, testing frameworks, and documentation.
AWS Cloud Stack: Practical experience with key AWS services, such as S3, Redshift (or Snowflake/Athena on AWS), Lambda, and EC2.
Orchestration & Tools: Familiarity with data workflow tools (like Apache Airflow, Prefect, or Dagster) and robust version control using Git.
Job responsibilities
Key Responsibilities:
Pipeline Development: Design, build, and maintain scalable, robust ELT/ETL pipelines using Python and SQL.
Data Modeling & Transformation: A
📌 Python Data Engineer – Dbt, Python, Aws, And Hyderabad
🏢 GlobalLogic
📍 Hyderabad