Accessibility Links
  • Job reference: RMS0228816

IT Data Engineer

  • Sector: Oil & Gas
  • Location: London
  • Job type: Contract
  • Date posted: 18/11/2020
  • Duration: on going
  • Time left:
    d h m s
    (30/12/20)
Send jobs like this to my email    What's this?

The Role:
About role
Senior Data Engineer Data is a strong enabler for value capture. In order to leverage this and as a key player in the Energy Trading space, our clients Gas Trading desk has developed a Data & Analytics team, on the Data Platform that they hosts on Microsoft Azure.
The Gas Desk Analytics team is looking its Data Engineering capabilities by onboarding a senior Data Engineer. This role will be a contract based opportunity and will be for an on going duration
Overview of role
The Data Engineers will work alongside the Tech Lead to build and unit test Data pipelines, data scrapes, data models in data lakes, and data warehouse.
They shall:
* Work in development sprint teams under the direction of the Tech Lead
* Be responsible for development and unit testing of user stories that have been assigned to them
* Be responsible for developing robust data pipelines and data models
* Use Azure technologies for development e.g. Azure Data Factory, Azure Databricks, Azure Data Lake, Azure Synapse, Azure Analysis Service, SQL server.
* Support the creation and maintenance of the analytics infrastructure Inform the Tech Lead / Scrum Master of any risks, issues or blockers
* Participate in relevant sprint meetings e.g. daily stand-ups, retrospectives and sprint planning meetings * Maintain the required status on the chosen technology e.g. Jira * Provide SME input on technology and systems.
Roles and Responsibilities
* Manages one or more data engineering projects of moderate complexity.
* Leads or acts as key team member in defining and builds the data pipelines that will enable faster, better, data-informed decision-making within the business.
* Jointly designs and implements a new big data solution which supports high amounts and velocity of data and supports future growth.
* Identifies latest development, testing and deployment techniques to quickly deploy new releases to e.g. deploy new data pipelines and add data sources.
* Takes direct reports, when applicable, through Agile Framework and its respective tools. Influences stakeholders in adopting analyses / outcomes.
* Acts proactively to support the business to further professionalize their MI / Analytic reporting platform, using the ESSA approach. Opinions valued by business interface.
* Plays a prominent role in project related meetings etc. Utilises business partnering in order to gather, analyse and model data and key performance indicators of the highest complexity.
* Working as Data Engineering Lead to develop and deploy innovative big data platforms for advanced analytics and data processing.
* Works independently under broad managerial supervision.

Required competencies / Essential experience
* Microsoft Azure cloud services - Azure Databricks, Python, Spark
* Event Hubs, Azure Stream Analytics, Azure Data Factory, Azure Blob Storage
* Azure Data lake Store(ADLS Gen1 / Gen2), Azure Functions, Azure DevOps, Azure Sql Server
* Good communication skills Functional Experience: Energy Trading Domain; European Gas preferably.

About Fircroft:
Fircroft has been placing people in specialist technical industries for over 50 years, focusing on mid to senior level engineers for contract and permanent roles worldwide. By applying for this job you give consent for Fircroft to contact you, via email & telephone, to discuss your application along with future positions and Fircroft's services.

Fircroft is registered as a Data Controller with the Information Commissioner as required under the General Data Protection Regulation 2016/679. Fircroft will only process your personal data for the specific purposes of managing your application.

Similar jobs
Arran Garrens
Software Engineer Location London Duration 12 months The Role: Job Role: We are currently recruiting for a...
Jai Reynolds
Data Specialist Location Aberdeen Duration ongoing The Role: The Data Specialist is responsible for populating...

Back to Top

By clicking "Save" you consent to
receiving matching jobs based on the
job/page you are viewing by email from
Fircroft, as detailed in our privacy policy
Fircroft would like to keep you up to date with our latest company updates via email. Occasionally Fircrofts marketing may contain 3rd party or affiliate information, however we will not share your personal data with any 3rd parties without your consent. From time to time, we might contact you to get your views on the service you have received. To help you get the best out of Fircroft, we may personalise them based on your location and how you use fircroft.com
Fircroft would like to keep you up to date with the latest company updates and vacancies via SMS / Text messages
Your consent options above means that Fircroft cannot contact you about any new or alternative career vacancies. If you want Fircroft to only contact you about the role(s) you have applied for please continue, however if you would like to be considered for other positions please allow us to contact you by changing one or more of the above consent.