Posted 25 days ago

Data Engineer

  • Location
    Algeria
  • Reference
    DEG-ALG-001
  • Industries
  • Discipline
    Operations & Production

Mission

The Data Engineer is responsible for expanding and optimizing the current data and data pipeline architecture as well as optimizing data flow and data collection for various teams (Data Analytics, Software, IOT). The Data Engineer is an experienced data pipeline builder and data wrangler who can optimize data systems and be able to build them from the ground up.

The Data Engineer will support our software developers, database architects and data scientists on data initiatives and will ensure optimal data delivery architecture.

Data Engineers must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.

Main responsibilities

  • As and when required, design, build and maintain optimal data pipeline architecture, including for cloud applications.
  • Design scalable infrastructure for consuming and processing big data as and when required.
  • Manage large, complex data sets and ensure they meet functional / non-functional business requirements.
  • Identify, design and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
  • Develop and maintain data warehouse architecture, schematics and relational/non-relational databases for Analytics requirements.
  • Build the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources using SQL, XML and other technologies.
  • Work with stakeholders including the Business segments, Data Scientists and Software teams to assist with data-related technical issues and support their data infrastructure needs.
  • Work with Data Scientists to support key use cases for machine learning to improve functionality in our data systems.
  • Create data tools for analytics and data scientists that assist them in building and optimizing our product into an innovative design.
  • Examine data using descriptive analytics to answer questions.
  • Keep data secure using industry standards and strategies for security.
  • Manage data bases and data models as required.
  • Design and build data pipelines and data streams.
  • Design and build data services APIs.
  • Build dashboard and reports within BI/visualization tool to specification for data visualization.

Requirements

  • Bachelor’s or Masters degree in Applied Mathematics, Science, Engineering or equivalent experience
  • 5+ years in a Data Engineer position.
  • Experience with RDBMS including one of mysql, postgres, MS SQL, or Oracle.
  • Experience developing in NoSQL databases such as HBase, Cassandra, or Accumulo.
  • Experience with Cloud Platforms and with cloud data storage and processing techniques such as BigQuerry, GCS, Dataproc etc
  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with data pipeline and workflow management tools: Jenkins, GitLab, Airflow, etc.
  • Experience with Kubernetes, Docker, Jenkins
  • Experience in use of BI and visualization tools like Spotfire
  • Utilize Python, Java, C#, Scala, SQL, HiveQL and other Big Data tools for data operations
  • JSON, Delimited files, HL7
  • Conscious of data quality
  • Strong communication skills
  • Function independently and in a team
  • Provide creative and innovative solutions

Apply now

Please fill in the form below to apply for this position.

  • 1 Do you have experience in Algeria?
  • 2 Have you ever had a GIN number?
  • Accepted file types: pdf, doc, docx, jpg, png, odt, gif, docm, rtf, txt, wps.
    pdf,doc,docx

Latest jobs

Posted 2 days ago

Supervisor Mechanical Erection

France

We are currently looking for Electrical and Mechanical Supervisors for wind farm projects in Europe, with minimum 4-5 years experience in erecting of turbines and at least 1 year in a supervisor role.

As a Supervisor Mechanical Erection you are responsible for mainly, but not limited to, monitoring and controlling the mechanical work carried out by the subcontractor on site during mechanical erection of wind turbines.

Posted 2 days ago

Electrical Finishing Supervisor

France

We are currently looking for Electrical and Mechanical Supervisors for wind farm projects in Europe, with minimum 4-5 years experience in erecting of turbines and at least 1 year in a supervisor role. 

As a Supervisor Electrical finishing you are responsible for mainly, but not limited to, monitoring, and controlling the Electrical finishing work carried out by the subcontractor on site after mechanical erection of the wind turbines and before commissioning.

Contact us