Kaltura Company Profile

Data Engineer

Kaltura

Opis pracy

Kaltura’s mission is to power any video experience and deployed globally in thousands of companies and educational institutions and engages hundreds of millions of viewers at home, at work, and in school. Kaltura is a recognized leader in the Online Video Platform (Educational institutions and Enterprise companies such as Harvard, Yale, SAP, Oracle Etc.) and Cloud TV (Vodafone, Cellcom TV etc).

Our core values are openness, flexibility, and collaboration, and we are the initiator and backer of the world's leading open-source video management project, which is home to more than 150,000 community members.

We like to think of ourselves as a cool, fun and talented group of professionals looking to create cutting-edge technology. Kaltura is a fast-paced environment where standards are high, and initiative is always encouraged.

Kaltura currently have approx. 500 employees across offices in New York, London, Sao Paolo, Singapore, and Tel Aviv. We are growing rapidly including positions all over the world.

We promote: a flexible work environment that encourages work-life-balance, internal mobility and relocation, community involvement, LGBTQ rights, refer-a-friend program and a newly launched paternity leave policy.

REQUIREMENTS

  • Develop and support ETL pipelines with robust monitoring and alarming.
  • Develop data models that are optimised for business understandability and usability.
  • Develop and optimise data tables using best practices for partitioning, compression, parallelisation, etc.
  • Develop and maintain metadata, data catalog, and documentation for internal business customers.
  • Help internal business customers troubleshoot and optimise SQL and ETL solutions to solve reporting and analytics problems.
  • Work with internal business customers and software development teams to gather and document requirements for data publishing and consumption.

Experience needed:

  • Experience with large scale distributed systems.
  • Python - must.(2 years+)
  • Understanding of Big Data technologies and solutions.(Redshift/Athena/S3/Kinesis…)
  • Experience with Amazon Web Services.
  • Ability to deal well with ambiguous/undefined problems; ability to think abstractly.
  • Knowledge of professional software engineering practices and best practices for the full software development life cycle(SDLC), including coding standards, code reviews, source control management, build processes, testing, and operations.
  • Experience with Apache Airflow- Big advantage
Znajdź swoją wymarzoną pracę