Data Engineer

Data Engineer- 5+ years of experience as a Data Engineer or similar role, including technical leadership.

Description

Data Engineer

About the Role

Forwood’s Analytics and Benchmarking team are looking to introduce a Data Engineer into their industry-leading team. This role will be responsible for managing our existing datasets and analysis clients, as well as designing future data solutions and expanding our range of predictive analytics capabilities. Working with our delivery partner AWS, this role involves working on the cutting edge of cloud-based analytics and industry-leading insights.

This role reports to Leader – Analytics and Benchmarking, with links into Product and Architecture teams. Forwood Safety practices Agile methodology and this role sits within an Agile team utilising Kanban methods.

Main Responsibilities

  • Realize business objectives by designing and developing robust analyses and dashboards as directed by the Product Owner.
  • Apply technical expertise to challenging analytics and data design problems, including data modelling and dataset design.
  • Complete the migration to Forwood’s new data processing platform, including resolving bugs and supporting the platform in a client-facing Production environment.
  • Resolve defects/bugs during testing and quality assurance in both pre-Production and Production environments.
  • Mentor junior members of staff including code review, Knowledge Transfer sessions, and providing ad hoc support.
  • Work with the Technical Lead, Architect and Product Owners to continuously improve our data analytics service and architecture.
  • Work as a key member of an Agile development team.
  • Ensure that items being worked on in the Kanban Board are left with a status update and comment. Accountabilities
  • Understanding the technologies to help the Analytics and Benchmarking team deliver increments of deployable product for each item of work.
  • Produce readable, maintainable code that is reviewed and checked in to the repository regularly.
  • Understand and contribute to the design and the shape of the work as we roll out Forwood’s new data processing platform.
  • Demonstrate and live the values of the company. Candidate

Requirements: Essential

  • 3+ years of experience / strong proficiency in data management using AWS, including S3, Kinesis, Glue, Athena, and RDS/Aurora.
  • 5+ years of experience as a Data Engineer or similar role, including technical leadership.
  • Experience building modern Data lakes and Data Warehouses
  • Experience in working with large data sets with real-time streaming applications
  • Experience in relational database (PostgreSQL, Redshift)
  • Experience in AWS Cloud Services (S3, Glue, Athena, Redshift…)
  • Some experience writing Infrastructure-As-Code (e.g. Terraform)
  • Strong experience in SQL and Python
  • Good Experience in Pyspark
  • Experience with modern software engineering practices (CI/CD, Testing, Version Control…)
  • Experience in building and maintaining APIs in a Productive, client-led environment.

Desirable

  • Experience in microservices.
  • Experience in Jenkins.
  • Experience in managing datasets and analysis from the Health and Safety or Mining data.

Position

Data Engineer

Salary

12 – 15 Lakh/Year INR

Expertise

  • Python
  • SQL
  • PostgreSQL
  • AWS – 3 years
  • Jenkins
  • Data Engineer – 5 years
  • Data Warehouse

  • Payroll
  • Fully Remote
  • India

Originally Published At

Magento Developer
Share with
Share
Share

Subscribe For All Job Updates

%d bloggers like this: