Senior/Lead Big Data Engineer (Databricks)

Das ist der Job

SoftServe is an equal opportunity employer.

Darum lohnt es sich

ABOUT THE ROLE In this role, you will build and optimize scalable data solutions on the Databricks platform, working with large-scale datasets and modern cloud-based data architectures.

You will develop reliable data pipelines, support analytics and data transformation initiatives, and collaborate with cross-functional teams to deliver production-ready data solutions throughout the project lifecycle.

RESPONSIBILITIES Design, develop, and maintain scalable data pipelines using Databricks, Python, SQL, and dbt Build and optimize data transformation workflows for large datasets, ensuring performance, reliability, and maintainability Develop and optimize SQL queries to support complex transformations, analytics, and reporting workloads Create and maintain data models using dbt, including testing, documentation, and data quality validation Implement orchestration, monitoring, and CI/CD practices for data engineering workflows Collaborate with technical and business stakeholders to understand requirements and deliver effective data solutions Participate in data platform optimization, troubleshooting, and continuous improvement initiatives Contribute throughout the full project lifecycle, from solution design to production deployment REQUIREMENTS 5+ years of experience in Data Engineering or related fields Hands-on production experience with Databricks for developing and maintaining data engineering solutions Strong SQL skills, including writing, optimizing, and debugging complex queries across large datasets Production experience with Python for data engineering, automation, or analytics workflows Experience designing and maintaining scalable data pipelines and cloud-based data platforms Familiarity with orchestration frameworks, data quality validation, and CI/CD practices for data workflows Strong communication and collaboration skills with technical and business stakeholders Practical experience with dbt, including data transformation, modeling, testing, and documentation (as a plus) Intermediate strong or higher level of English BENEFITS Work from home, from the office, or in a hybrid format that supports focus and collaboration.

Approachable leaders who communicate openly, keep teams close to the strategy, and support long-term planning. Competitive, market-based pay, benchmarked by role and location - plus health coverage, paid time off, wellness support, and learning opportunities.

Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law. #J-18808-Ljbffr