09 Sep
|
VARITE
|
Bengaluru
Company Name: VARITE India Private Limited
About The Client
Visionet is a premier digital technology solutions company built on the premise of disruptive innovation. For over 27 years, our innovation-centric and engineering-first approach has unlocked digital-driven success to over 350+ global enterprises across Client, Retail, Banking & Financial Services, Food & Beverage, Manufacturing & Distribution, and Life Sciences industries. Our strategic technological alliances with Microsoft, Google, Salesforce, Adobe and AWS, as well as accolades like Microsoft Partner of the Year 2021 and EY Entrepreneur of the Year 2021, are a testament to our expertise in delivering seamless digital transition.
With a talent pool of more than 9,500 passionate engineers and digital consultants across 14 distinct locations around the world, we engineer agility and provide innovation-driven value to our clients.
About The Job:
- We are seeking an experienced Senior Data Engineer with 6+ years of strong expertise in building and optimizing large-scale data pipelines using AWS Glue.
- The ideal candidate will have deep knowledge of AWS Glue Data Catalogue, AWS Glue Data Quality, and Data Quality Frameworks (AWS DQ), combined with hands-on experience in Python, PySpark, and PyDQ.
- This role requires a strategic thinker capable of leading data quality initiatives and ensuring robust data governance across complex data ecosystems.
Essential Job Functions:
- Lead the design, development, and optimization of scalable ETL pipelines using AWS Glue and PySpark in a cloud environment.
- Architect and manage AWS Glue Data Catalogue to enable effective metadata management and data discovery.
- Drive the implementation and enhancement of data quality frameworks leveraging AWS Glue Data Quality and AWS DQ tools.
- Utilize PyDQ extensively to define, monitor, and enforce comprehensive data quality checks and validation rules.
- Mentor junior engineers and collaborate cross-functionally to establish best practices around data quality, governance, and pipeline automation.
- Identify bottlenecks, troubleshoot complex issues, and optimize workflows to ensure high availability and performance.
- Partner with data analytics, data science, and business teams to align data infrastructure with organizational goals.
Qualifications
Required Skills & Experience:
- 6+ years of experience in data engineering, with a focus on cloud-based ETL and data pipeline development.
- Expert-level proficiency with AWS Glue Data Catalogue and AWS Glue Data Quality services.
- Strong hands-on experience implementing Data Quality Frameworks (AWS DQ) in production environments.
- Deep understanding and practical expertise in PyDQ for data validation and quality assurance.
- Advanced programming skills in Python and PySpark for large-scale data processing.
- Proven ability to lead technical initiatives, mentor teams, and drive best practices.
- Experience working in agile environments and with modern data engineering tools and practices.
How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
0-2 years
INR 5,000
2-6 years
INR 7,500
6+ years
INR 10,000
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
📌 Senior Data Engineer – AWS Glue & Data Quality (Bengaluru)
🏢 VARITE
📍 Bengaluru