Core Group Resources Company Profile

Senior Data Engineer at Core Group Resources (Houston, TX)

About the Employer

Job Description

Job titleSenior Data EngineerLocationHouston, TXPosition SummaryThe successful candidate will be responsible for leading the design and development of the company data pipeline.Qualifications Bachelors degree Masters degree in Computer Science or a related field preferred 6+ years professional software development 2+ years experience in building and optimizing big data pipelines, architectures and data sets 2+ years' experience with one or more of: Java, Scala, or Python 2+ years experience with Apache Spark and NoSQL (HBase, Cassandra, etc.) 2+ years' experience with stream-processing systems such as Kafka, Spark-streaming, etc. 2+ years' experience with Azure or AWS cloud services 2+ years' experience with Linux/Unix, scripting, and administration 2+ years' experience with Docker 2+ years' experience with SQL and experience working with RDBMSs (Postgres/PostGIS, SQL Server, etc.) 2+ years' experience with source control systems (Git), branching & merging, CI, etc. 3+ years' experience in Data Engineer role Knowledge of the maritime industry Ability to work efficiently with large spatio-temporal data sets strongly desired GIS experience a plus Experience with Kubernetes Experience with Event Driven development Experience with Log Management systems like Splunk, Logstash, etc. Experience with CI/CD pipelines (e.g. Jenkins, etc.) Experience with Machine Learning is a plus Experience working within Scrum methodology Must be a US Citizen or Green card holder only Working conditions Work at an office location