02 Aug
|
Cigres Technologies
|
India
02 Aug
Cigres Technologies
India
Required Skills:
- ETL Development
- AWS Data Services
- PySpark
- Python
- SQL & Cloud DWH
- Terraform
- AWS Networking & IAM
- CI/CD & Version Control
Nice to Have:
- Data Lake & Governance
- CloudWatch
RESPONSIBILITIES: This is a strong technology and solution delivery role, accountable for the successful design, development, and delivery of ETL solutions on the corporate Data Platform. • Responsible for the delivery of the development activities he/she owns including ETL standards, patterns and best practices. • Work with team to ensure standards and patterns are followed. • Determines organizational strategies for data integrity validation processes. • Establishes policies and best practices for optimizing ETL data throughput/accessibility • Identifies opportunities for new initiatives; makes recommendations on the increasing scalability and robustness of ETL platforms and solutions. • Partner with the Data modelers to drive improvements and enhancements to the current data landscape and future strategy. • Remain current on new ETL techniques and methodologies and communicate trends and opportunities to management and other developers as needed. • Identify opportunities for uses of those technologies to enhance current or anticipated information systems and business goals • Evaluates existing applications that could address client requirements and makes recommendations from complex projects. • Identifies opportunities for solution sharing and reuse. • Assists in the development of ETL-related Service Level Agreements. • Communicates risks and ensures understanding of these risks. QUALIFICATIONS:B.E or B TECH or MASTERS IN COMPUTER SCIENCE, ELECTRONICS, RELEVANT TECHNICAL CERTIFICATION Experience(in years) :
5 Skill Set Required Technology Skills and Project Experience: - 5 years of experience in ETL design, development and business system designs. - Good understanding of AWS networking concepts: VPC, subnets, routing, NAT gateways, security groups. - Proficiency in IAM concepts: roles, policies, assume-role, and cross-account access. - Hands-on experience in AWS services including but not limited to: S3, KMS, Lambda, Glue (or Spark), SQS, EventBridge. - Hand on experience in writing clean, modular, testable, and maintainable code using functional or OOP principles. - Positive experience in at least one programming language such as Python, Scala, Java etc. - Willingness to learn Python/PySpark if not already experienced. - Good understanding of Spark architecture, execution plans, and performance tuning. - Strong SQL skills and experience with Redshift and/or Athena, or any other distributed computer engines. - Experience in writing and maintaining Terraform scripts. - Familiarity with Git, GitHub workflows, and CI/CD tools like Jenkins. - Exposure to data lake architectures and data governance practices. - Familiarity with monitoring and logging tools (e.g., CloudWatch). Business / Soft Skills: - Must have solid presentation, communication (on complex technical solutions) and interpersonal skills. - Ability to work effectively with globally dispersed stakeholders from business. - Ability to manage multiple priorities in a fast-paced environment. - A data-driven mindset, ability to clearly communicate complex business problems and technical solutions. - Ability to manage and make decisions about competing priorities and resources. - Ability to delegate where appropriate - Must be a strong team player
📌 Intel DS Next Data ingestion - AWS ETL Developer - S N (India)
🏢 Cigres Technologies
📍 India