10 Aug
|
IndusGuru Network Partners
|
India
10 Aug
IndusGuru Network Partners
India
Job Description
A Senior Data Engineer Extraodinaire is a visionary leader in crafting scalable, efficient
solutions for data processing and analysis. They possess advanced expertise in database
management, ETL processes, and data modeling, designing robust pipelines with cutting-
edge technologies like Apache Spark and Hadoop. With deep proficiency in cloud
platforms such as AWS, Azure, or Google Cloud, they architect resilient, scalable data
ecosystems. Collaborating closely with cross-functional teams, they translate business
requirements into data solutions that align with organizational goals. Through their
leadership, technical acumen, and innovation, they drive data-driven insights that
empower organizations to excel in the digital age.
Key Responsibilities
• Lead the design and development of scalable data pipeline architectures and ETL
processes using PySpark, SQL, and cloud-based big data technologies to drive
optimal performance.
• Spearhead the implementation of advanced analytics tools and data products,
delivering actionable insights through cloud platforms.
• Innovate and solve complex data engineering challenges by leveraging the latest
advancements in big data and cloud technologies.
• Establish and enforce best practices for data engineering, including optimizing
PySpark jobs, SQL queries, cloud resource utilization, and data security within cloud
environments.
• Translate business requirements into scalable, cloud-based data solutions and
serve as a key technical liaison.
• Mentor and lead a team of data engineers, fostering their expertise in Python,
PySpark, SQL, and cloud technologies.
• Evaluate and recommend current technologies to enhance the organization's data
engineering capabilities, with a focus on cost and performance optimization.
• Represent the company at industry conferences, sharing insights on cloud-based
data engineering, PySpark, and big data technologies.
• Collaborate in a dynamic, cross-functional environment to drive innovatio
📌 Sr. Azure Data Engineer | 8+ YoE | Contract 3-6 months | Remote | Full time | Immediate Joiners (India)
🏢 IndusGuru Network Partners
📍 India