22 Aug
|
Purview Services
|
Hyderabad
22 Aug
Purview Services
Hyderabad
Job Title: Platform Data Engineer Specialist Engineering
Experience: 6+ Years
Role Overview
We are seeking a highly skilled Platform Data Engineer to design, build, and maintain scalable data platforms and pipelines. The ideal candidate will have robust experience in modern data engineering tools, cloud infrastructure (preferably Azure), and analytics platforms, along with a solid foundation in Linux system administration.
Key Responsibilities
Design, develop, and optimize data pipelines for ingestion, transformation, and processing of large-scale datasets.
Build and maintain data platforms using tools like Databricks, Azure Data Factory, Apache NiFi, and Kafka.
Manage and support cloud-based infrastructure, primarily on the Azure platform.
Collaborate with data scientists, analysts, and business teams to enable data-driven solutions.
Ensure high availability, reliability, and performance of data systems.
Implement monitoring, logging, and troubleshooting mechanisms across data platforms.
Work with Linux systems (RHEL/Ubuntu) for deployment, configuration, and maintenance.
Maintain data security, governance,
and compliance standards.
Required Skills & Qualifications
6+ years of experience in data engineering / platform engineering roles.
Solid expertise in:
Databricks
Azure Data Factory
Apache NiFi
Apache Kafka
Experience with Azure platform services (e.g., Azure Functions, storage, compute).
Solid knowledge of Linux system administration (RHEL/Ubuntu).
Proficiency in scripting/programming (Python, SQL, or similar).
Experience in building scalable and fault-tolerant data pipelines.
Preferred Qualifications
Experience with cloud-based SIEM and SOAR technologies.
Relevant Azure and Databricks certifications.
Exposure to DevOps practices and CI/CD pipelines.
Strong problem-solving and analytical skills.
Soft Skills
Excellent communication and collaboration skills
Ability to work in a fast-paced, agile workplace
Strong ownership and accountability
Nice to Have
Experience with real-time streaming architectures
Knowledge of data governance and security frameworks
📌 Data Platform Engineer Hyderabad
🏢 Purview Services
📍 Hyderabad