Ciklum Company Profile

Senior Data Engineer for Seeking Alpha

Ciklum

Munkaköri leírás

On behalf of Seeking Alpha, Ciklum is looking for a Senior Data Engineer to join Kyiv team on full-time basis.

Responsibilities

  • Solve challenging problems in a fast-paced and evolving environment while maintaining uncompromising quality
  • Contribute to the core design of data architecture, data models and schemas, and implementation plan
  • Design, build and maintain optimal data pipeline architecture for extraction, transformation, and loading of data from a wide variety of data sources, including external APIs, data streams, and data stores
  • Design, build, and maintain the infrastructure for ingesting data into our data lake and data warehouse and providing frameworks and services for operating on that data
  • Design, build, and maintain the infrastructure for real-time streaming analytics, big data analytics, and machine learning analytics capabilities
  • Implement data privacy and data security requirements to ensure solutions stay compliant with security standards and frameworks
  • Enhance the team’s dev-ops capabilities

Requirements

  • Bsc in CS/Mathematics/Statistics/Physics/EE or equivalent experience
  • 5+ years of proven experience developing large-scale software using an object-oriented or a functional language
  • Outstanding Software Engineering skills
  • Proven experience with cloud-based data pipeline/Back End services, using AWS
  • Proficient with relational and non-relational data modeling
  • Proficient with stream processing using the current industry standards (e.g. Akka, AWS Kinesis, Kafka, Spark, Flink, etc.)
  • Familiarity with a variety of big data frameworks and tools, including EMR, Athena, Glue, Airflow, etc.
  • High-level English – a must
  • A team player with excellent collaboration skills

Desirable

  • Experience with containerized (Docker, ECS, Kubernetes) or serverless (Lambda) deployment
  • Experience with building Machine Learning models
  • Experience with Data Lineage
  • Deep knowledge of Spark internals (tuning, query optimization)

What's in it for you

  • Very close cooperation with the client
  • Possibility to propose solutions on a project
  • Dynamic and challenging tasks
  • Ability to influence project technologies
  • Team of professionals: learn from colleagues and gain recognition of your skills
  • Low bureaucracy, European management style