Project Role : Custom Software Engineer

Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.

Must have skills : PySpark

Good to have skills : NA

Minimum 3 year(s) of experience is required

Educational Qualification : 15 years full time education

Summary

As a Custom Software Engineer, a typical day involves leading the design, development, and configuration of software applications. This role requires taking ownership of the project s technical direction and serving as the main liaison for all application-related activities. The position demands close collaboration with various stakeholders to ensure that the solutions meet business needs while maintaining high standards of quality and performance.

The engineer actively manages the application lifecycle, from initial concept through deployment and ongoing support, ensuring seamless integration and functionality within the broader system environment.

Roles & Responsibilities:

ETL/ELT development

Data modeling

Data warehousing concepts

Lakehouse architecture

Batch and streaming pipelines

Performance Optimization

Query optimization

Execution plan analysis

Adaptive Query Execution (AQE)

Join optimization

Partition pruning

Broadcast joins

Skew handling

Caching strategies

File optimization

Cluster resource tuning

Storage Formats

Delta Lake

Apache Iceberg

Parquet

ORC

CI/CD & DevOps

Git

CI/CD pipeline

Docker/Kubernetes (preferred)

Preferred Qualifications

Experience with Databricks, IoMete, EMR, Synapse, or Microsoft Fabric.

Knowledge of Kafka or event-driven architectures.





Experience building data products for AI/ML workloads.

Familiarity with data governance and metadata management.

Experience

5–10 years in Data Engineering.

3+ years of hands-on experience with PySpark and distributed computing.

Proven experience processing large-scale datasets (multi-TB/PB).

Strong track record in Spark performance tuning, query optimization, and building enterprise-grade data products.

Professional & Technical Skills:

- Must To Have Skills: Proficiency in PySpark.
- Strong knowledge of distributed computing principles and big data processing frameworks.
- Experience in writing efficient, reusable, and maintainable code for large-scale data processing.
- Familiarity with data integration techniques and working with various data sources.
- Ability to troubleshoot and optimize complex data workflows and pipelines.
- Understanding of software development lifecycle and version control systems.

Additional Information

Key Competencies

PySpark development

Spark performance tuning

High-volume data processing

Complex SQL optimization

Distributed systems engineering

Data product engineering

Data modeling

Lakehouse architecture

Cloud data engineering

Production support and troubleshooting

Performance benchmarking and scalability optimization

15 years full time educationAbout Accenture





Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with robust ecosystem relationships.

We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.Visit us at www.accenture.com

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.

📌 Custom Software Engineer (Bengaluru)
🏢 Accenture
📍 Bengaluru