Senior Data Engineer

We are seeking an experienced and driven Senior Data Engineer to join our expanding Data Engineering team.

In this role, you will be a key member of one of our established Platform Teams, designing, developing, and scaling data pipelines in Databricks with PySpark on Microsoft Azure for the AI Factory team. This is an exciting opportunity to work at the intersection of big data and cloud engineering, delivering reliable, scalable, and high-performance data platforms that drive innovation across our organization.

Responsibilities

Design cloud-native analytical solutions using Big Data and NoSQL technologies

Build and optimize scalable data pipelines in Databricks with PySpark on Azure

Develop and maintain data lakes and data warehouses to ensure reliability and performance

Design and implement ETL/ELT workflows to collect, clean, and structure data

Implement data quality, lineage, and monitoring frameworks

Collaborate with ML and analytics teams to deliver clean, production-ready datasets

Conduct code reviews to uphold technical standards and best practices

Mentor junior engineers and foster a high-performance, collaborative culture

Integrate CI/CD methodologies into data engineering workflows using tools such as Jenkins or GitLab CI/CD

Support requirements gathering and deliver solutions in alignment with architects, technical leads, and cross-functional teams

Engage with stakeholders to understand business processes, model input data, and ensure deliverables meet requirements

Requirements

4+ years of experience in Data Engineering or a related field

Proficiency in Python and PySpark

Hands-on experience with Databricks and Microsoft Azure cloud services

Familiarity with software version control tools (e.g., GitHub, Git)

Experience with CI/CD frameworks such as Jenkins, Concourse, or GitLab CI/CD

Proven ability to build scalable, robust, and highly available data solutions

Strong problem-solving, analytical, and stakeholder engagement skills

Nice to have

Experience with additional programming languages such as Java, SQL, or Scala

Knowledge of SAP BTP or similar enterprise data platforms

Familiarity with agile development methodologies

We offer/Benefits

Opportunity to Engineer your Future and to drive the world’s digital transformation with top industry clients

Personal development program that will allow you to be valued for your strengths

Wide range of professional trainings and workshops

Being part of a collaborative, fast-growing, and innovative design team

Established and accelerated growth toward different career paths, competencies, and roles

Broad projects variety and possible mobility between projects over the time

Collaboration in a multicultural environment and exchange of best practices with colleagues around the world

Varied social benefits, Sports, Transportation and Health programs

Work-life balance and flexible schedule, team buildings and sport opportunities

Modern office/collaboration spaces (incl. new Infinity Tower business center, Sofia)

Hybrid By Design – we provide you with the best productivity options from the 2 worlds. Meet, socialize and enjoy F2F time with your colleagues, while working from the modern EPAM’s office for a few days per week and benefit from the EPAM’s virtual working environment – making you able to be productive and work from remote for the rest of the week