Data Engineer

Job description

We are looking for a Data Engineer for our end client – an international company.

• Job type: B2B, full time.
• Project duration: long term.
• Location: remote.
   

Responsibilities

• creating and maintaining optimal data pipeline architecture;
• identifying, designing and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.;
• building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL Big Data technologies;
• working with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and to support their data infrastructure needs;
• creating data tools for analytics and data scientist team members to assist them in building and optimizing our product into an innovative industry leader.
   

Requirements

• advanced working knowledge of SQL and experience in working with relational databases as well as practical familiarity with a variety of databases;
• experience in building and optimizing Big Data pipelines, architectures and data sets;
• experience in performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement;
• strong analytic skills in working with unstructured datasets;
• building processes supporting data transformation, data structures, metadata, dependency and workload management;
• working knowledge of message queuing, stream processing and highly scalable Big Data stores;
• experience with big data tools: Hadoop, Spark, Kafka, etc.;
• experience with relational SQL and NoSQL databases;
• experience with Snowflake;
• English B2/C1.