Data Engineer

About you
 

Our Data Engineer will be responsible for preparing the "Big Data" infrastructure to be consumed by data scientists and data analysts. As an essential part of the Data and Engineering Areas, and Data analysis process, the position needs to build and optimize the performance of the data ecosystem at Reworth. A successful Data Engineer should be a critical and analytical thinker, with the ability to work in team and communicate effectively.

Responsibilities
 
  • Build the infrastructure required for automated optimal extraction, transformation, and loading of data from a wide variety of data sources using Python, SQL and AWS tools.

  • Understand the data sources, develop an ETL strategy, perform data modeling to meet customers’ data needs.

  • Collaborate with Data Scientists, Enterprise Architect, Solution Architect and Technical leads  to implement advanced analytics algorithms that exploit our rich data sets for statistical analysis, prediction, clustering and machine learning.

  • Build flexible and streamlined data environments, automated pipelines and process flows using multiple open source tools.

Experience
 
  • 3+ Previous Experience as Data Engineer

  • 3+ years of experience using relational databases (such as PostgreSQL, MySQL) and NoSQL databases (MongoDB or Cassandra)

  • 3+ years of experience using Python and the tools named above.

Requirements
 
  • Knowledge of AWS services including S3, Redshift, EMR, Kinesis and RD.

  • Good written and verbal communication skills.

  • Strong attention to detail.

  • Knowledge of relational databases (such as PostgreSQL, MySQL) and NoSQL databases (MongoDB or Cassandra)

  • Knowledge of Python.

  • Intermediate / advanced English level

  • Managing Big Databases

  • Experience in ETL designing, coding, and tuning big data processes using Apache Spark or similar technologies.

  • Knowledge on Apache AIRFLOW or Luigi (nice to have)

  • Knowledge on Snowflake (nice to have)

Aplicar a la vacante

arrow&v
Cargar C.V.

Gracias por aplicar, nos pondremos en contacto contigo.