Accessibility Links
  • Job reference: RMS0176430

Data Manager

  • Sector: ICT
  • Location: Houston
  • Job type: Contract
  • Date posted: 20/02/2017
  • Duration: 12 months
  • Time left:
    d h m s
This vacancy has now expired.
Send jobs like this to my email
The Company:
Major O&G Company

The Role:
Employee will be responsible for the acquisition, management, and quality control of data to support the Next Gen Cyber security Analytics project and the ongoing work of the cyber security data science team. This individual will be a key member of the project team who is expected to take primary responsibility for adding ~2 dozen new data sources into a Hadoop data lake, creating proactive data QC processes, and ensuring that data is made accessible as required for the data science team to consume.
Key responsibilities include:
• Management, organization, acquisition of data in the cybersec data lake
• QC and data quality management
• Coordination between data owners, app support, and ETL developers to acquire new log sources required by the data scientists
• Collaborate with data scientists to identify and acquire auxiliary information (ie user data, asset inventories, 3rd party sources, etc)
• Design data acquisition, storage, and organization to be performant in a Hadoop environment
• Implement tools & processes to ensure high level of ongoing data quality needed to support cyber security operations
Required skills:
• Proficient in at least one of the following: python, perl, Java, Linux shell scripting
• Experienced Linux user
• Working knowledge of cybersecurity and networking concepts at a level sufficient to effectively QC data
• Past roles managing high volume technical data for scientific computing or big data applications
• Experienced with Hadoop platform and associated toolset (Hive/Impala, Pig, Spark)

Experience with Linux as a user/power user: 10+ years
Past work experiences involving management of technical data: 5-10 years
Linux shell scripting: 5-10 years
Python, perl, or Java programming: 5-10 years
Hadoop (including at a minimum Pig and Hive/Impala; Spark strongly preferred as well): 2-5 years

The following skills are desirable but not required:
• Data visualization with Spotfire
• ETL development experience

About Fircroft:
Fircroft has been placing people in specialist technical industries for approaching half a century, focusing on mid to senior level engineers for contract and permanent roles worldwide. By applying for this job you give consent for Fircroft to contact you, via email & telephone, to discuss your application along with future positions and Fircroft’s services.

For further information or to discuss any opportunities, Contact Hugh Nguyen at Fircroft on +1 713 235 8118
Similar jobs
Kate Walker
Machine Learning Engineer Location Derby, Derbyshire Duration permanent The Role: We are looking for people with bright minds that...
Automated Software Engineer Location London Duration permanent The Role: We are currently seeking an experienced...

Back to Top