13 Nov
|
People Prime Worldwide
|
Hyderabad
13 Nov
People Prime Worldwide
Hyderabad
Experience: 4 - 9 years Max Experience: 9 Role Overview We are seeking an experienced Senior Data Engineer to join our team on a contract basis. You will be responsible for designing, building, and optimizing scalable data pipelines and cloud data infrastructure to support enterprise analytics, product features, and AI/ML workloads. As a senior contractor, you will hit the ground running to deliver high-impact data solutions, enforce engineering standards, and collaborate closely with cross-functional stakeholders. Key Responsibilities Pipeline Architecture & Development. Design, build, and maintain robust batch and real-time ETL/ELT data pipelines to ingest, transform, and process large-scale datasets. Data Modeling & Warehousing. Architect dimensional data models (star/snowflake schemas) and optimize cloud data warehouses and data lakes for analytical and operational use. Performance & Cost Optimization. Tune complex SQL queries, storage formats, and compute clusters to maximize throughput and reduce cloud infrastructure costs. Data Quality & Observability. Implement automated testing, validation rules, monitoring, alerting, and data lineage frameworks to ensure high data reliability and integrity. Security & Governance. Enforce data governance policies, access controls, and compliance standards across all data assets. Cross-Functional Collaboration. Partner with data scientists, analysts, product managers,
and backend engineers to translate business requirements into technical specifications and production-ready data products. Documentation & Handover. Maintain comprehensive architectural documentation, runbooks, and code standards to ensure seamless knowledge transfer to internal teams. Required Qualifications & Skills Experience. 5+ years of hands-on experience in data engineering, with a proven track record of delivering production data pipelines at scale. Programming & Querying. Advanced proficiency in SQL (window functions, complex joins, query tuning) and Python (or Scala) for data processing and automation. Big Data & Processing Frameworks. Strong experience with distributed processing engines such as Apache Spark / PySpark, and streaming technologies like Apache Kafka or Kinesis. Cloud & Data Platforms. Hands-on expertise in at least one major cloud ecosystem (AWS, Azure, or GCP) and up-to-date data platforms such as Snowflake, Databricks, BigQuery, or Redshift. Orchestration & DevOps. Experience with workflow orchestration tools (e.g., Apache Airflow, dbt, Azure Data Factory) and CI/CD practices using Git. Data Formats & Modeling. Deep understanding of dimensional modeling and columnar storage formats (Parquet, Iceberg, Delta Lake)
Skills: snowflake , Devops, Spark, Kafka, Gcp, Sql, Azure, Aws, Python
Experience: 4.00-9.00 Years
📌 Contract Position-Senior Data Engineer (Hyderabad)
🏢 People Prime Worldwide
📍 Hyderabad