02 Sep
|
Persistent Systems
|
Pune
02 Sep
Persistent Systems
Pune
Job Description
About Position:
n
nExperienced AWS Architect with expertise in building scalable data pipelines, processing large datasets, and developing cloud-based data solutions using Databricks, PySpark, Python, SQL, and AWS technologies. Skilled in ETL/ELT development, data transformation, performance optimization, and cloud data architecture. Relevant enterprise profiles and resumes show experience in Databricks-based data processing, PySpark transformations, SQL development, and AWS cloud services.
n
n
n
Role: AWS Architectn
Location: All Persistent Locationn
Experience: 12+ yearsn
Job Type: Full time Employmentn
n
nWhat You'll Do:
n
n
n
Design, develop, and maintain scalable ETL/ELT data pipelines.n
Process and transform large volumes of structured and unstructured data using PySpark and Databricks.n
Develop effective data solutions using Python and SQL.n
Build and manage cloud-native data platforms on AWS (S3, EC2, Lambda, etc.).n
Optimize data workflows, Spark jobs, and database performance.n
Collaborate with business stakeholders to understand requirements and deliver analytics-ready datasets.n
Implement data quality, governance, monitoring, and performance best practices.n
Support data warehousing, reporting, and advanced analytics initiatives.n
n
nExpertise You'll Bring:
n
n
n
Solid hands-on experience with Databricks for data engineering and large-scale data processing.n
Advanced proficiency in PySpark for distributed data transformation and analytics.n
Solid programming skills in Python for automation, data pipelines, and backend processing.n
Expertise in SQL for data modeling, query optimization, and reporting.n
Experience with AWS services such as S3, EC2, Lambda, and cloud-based data architectures.n
Knowledge of Spark optimization, Delta Lake, ETL frameworks, and data lake concepts.n
Ability to build reliable, high-performance, and scalable data platforms.n
St
📌 Aws Architect Pune
🏢 Persistent Systems
📍 Pune