Big Data Engineer Jobs

EPAM Anywhere is looking for Big Data Engineers.

Competitive compensation

We back all payments and operate in compliance with country-specific labor regulations. Your annual paycheck can range from $15k to $200k.

Numerous benefits

Make use of 1,500+ online and location-specific benefits across 30+ countries that also include healthcare and sports programs for you and your family.

Limitless career growth opportunities

Get access to a large-scale ecosystem that consists of educational and career development services created for your growth. A personal skill advisor will support you on each step of this journey.

senior data software engineer

Data Software Engineering

Big Data, Python, Amazon Web Services

40 hrs/week

12+ months

Poland

We are looking for a Senior Data Software Engineer to join our team, working with one of the largest pharmaceutical companies in the world.

We are looking for a Senior Data Software Engineer to join our remote team, working with one of the largest pharmaceutical companies in the world. Consistently ranked in the global top five, this company is committed to improving human health through innovation and research. As a Senior Data Software Engineer, you will be responsible for implementing data pipelines using Big Data technologies, ensuring that code is delivered on time and to a high standard of quality.

responsibilities

Implement data pipelines using Big Data technologies, ensuring that code is delivered on time and to a high standard of quality
Design and implement scalable and efficient data processing solutions
Contribute to the development and maintenance of data engineering best practices and standards
Collaborate with other engineers and stakeholders as required, contributing to the enhancement of user experiences and the improvement of data-driven decision-making processes
Review and ensure the quality control of data engineering deliverables to meet the highest standards
Provide assistance and support to other engineers during project discovery and ideation phases, contributing to innovative data solutions

requirements

Relevant experience is 3+ years in Data Software Engineering, with a focus on Big Data
Strong understanding of Big Data technologies, including Hadoop, Spark, and Hive
Proficiency in Python programming language, enabling you to write high-quality and efficient code
Experience working with Amazon Web Services and Databricks, allowing you to work with cloud-based Big Data solutions
Strong focus on teamwork and exceptional interpersonal skills, allowing you to collaborate effectively with cross-functional teams
Excellent communication skills in English, with a B2 level or higher, enabling you to effectively convey feedback and insights to cross-functional teams

nice to have

Experience in Machine Learning or Data Science, showcasing your broader perspective on data and its applications
Knowledge of SQL and NoSQL databases, enabling you to work with a variety of data storage solutions

senior data quality engineer (databricks, aws)

Data Software Engineering

Amazon Web Services, Databricks, Python

40 hrs/week

12+ months

Poland

We are looking for a remote Senior Data Quality Engineer with experience in DSE Python and AWS Databricks.

The successful candidate need have someone with strong analytical skills, excellent communication skills.

responsibilities

Ensure data quality and integrity across all platforms and systems
Collaborate with cross-functional teams to design and implement data management
Develop and execute test scenarios to validate data management systems
Provide technical guidance and mentorship to junior team members
Work directly with customers to validate data requirements and manage data quality issues

requirements

3+ years of experience in Data Software Engineering
Strong working knowledge of DSE Python, AWS Databricks and Apache Spark
Familiarity with testing methods (TDD, BDT, DDT)
Experience with data ingestion pipelines, data warehousing and data lakes
Understanding of CI/CD principles and best practices in data processing
Upper-intermediate English language skills (B2+)

nice to have

Familiarity with Amazon QuickSight, Microsoft PowerBI,
Experience with Big data technologies such as Apache Hadoop and Apache Hive

senior data engineer with python (databricks, aws)

Data Software Engineering

Amazon Web Services, Databricks, Python

40 hrs/week

12+ months

Poland

We are looking for an experienced remote Senior Data Engineer with Python, Databricks and AWS skills to join our team.

The right candidate enjoys working collaboratively to solve complex data engineering challenges that support our business needs.

responsibilities

Design, implement and maintain large-scale data pipelines using Python, Databricks
Work with cross-functional teams to integrate solutions that meet our data processing and analysis needs
Ensure performance, reliability, security and maintainability of data pipelines
Develop monitoring and alerting mechanisms to proactively identify and resolve issues
Continuously look for opportunities to improve data engineering processes and practices

requirements

Minimum of 3+ years with expertise in designing and maintaining large-scale data pipelines
Strong proficiency in Python and Databricks, (AWS) in production environments
Excellent understanding of Big Data technologies, primarily Spark
Strong understanding of data architecture and modelling concepts
Highly knowledgeable about data warehousing principles and practices
Upper-Intermediate level of English (B2+)

nice to have

Experience with Apache Hive

Big Data Engineer Jobs

Other skills