Software Engineer

Responsibilities:

• Build and scale distributed data pipelines for large-scale time series, log data, and high-volume event streams.
• Design and maintain reliable, high-performance Spark and Python workflows to support model training datasets.
• Analyze and resolve performance bottlenecks related to latency, memory utilization, data skew, and throughput.

Required Qualifications and Skills:

• 5+ years of software engineering experience.
• Strong proficiency in Python.
• Hands-on experience with Apache Spark (PySpark or Scala).

Internal Responsibilities:

• Attend regular internal practice community meetings.
• Collaborate with your itD practice team on industry thought leadership.
• Complete client case studies and learning material (blogs, media material).