3M has a long-standing reputation as a company committed to innovation. We provide the freedom to explore and encourage curiosity and creativity. We gain current insight from diverse thinking, and take risks on new ideas. Here, you can apply your talent in bold ways that matter.
Job Description
Associate Developer (AWS) - Data Engineering (Bangalore)
Associate Developer - Data Engineering is a part of the Data & Analytics function to work on designing, developing, testing, and supporting Digital Data Core pipelines and complex data models development in Amazon Web Services (AWS), Databricks and deliver insights to the business.
Primary Responsibilities include but are not limited to the following:
• Designs, develops, and maintains scalable data pipelines with delta mechanism in AWS Lake using AWS services and PySpark.
• Analyzes, designs, develops, tests, deploys and supports Data models in AWS S3 using Spark SQL based on extracts from various sources based on functional design specifications
• Stay up to date with industry trends and best practices in data engineering, AWS services,
AWS Lake, PySpark and Athena
• Reviews business requirements, helps to create functional design, and develops technical design documents and data lineage, data dictionaries, and metadata management.
• Understands the functionality of business processes and data that will be required to build, test and implementation.
• Performs SQL scripting.
• Participates actively in local and global teams.
• Databricks expertise in managing the Platform Engineering tasks
• Most recent experience in Databricks building Data Ingestion Frameworks, PySpark SQL, Admin work.
Requirements:
• Bachelor’s degree in computer science, Engineering or Technology from an accredited university
• A minimum of 2-4 years of solid experience in data warehousing including data pipelines and data modeling particularly on AWS and Databricks platform
• 2-4 of years strong experience in Python, PySpark with SQL scripting
• 2
📌 Associate Developer (Bengaluru)
🏢 3M
📍 Bengaluru