Data Engineer

Reports to: Chief Operations Officer

Responsibilities:

- Build distributed systems – work on improving and adding new functionality to Peg B distributed
systems backbone;
- Work with very large datasets and implement algorithms that improve the quality and
usefulness of our data assets;
- Support benchmarking systems, analyze system & query bottlenecks and propose solutions to
eliminate them;
- Scale the network – work on tuning and optimizing the delivery of various data sets in a network
with thousands concurrent events and unique data scalability challenges;
- Keep it running – help troubleshoot data systems and application operational issues.
- Work with Product management on understanding features.

Requirements:

- Bachelor’s Degree in Computer Science or another related field;

- Professional experience in building and managing data distributed systems infrastructure;
- Knowledge in Big Data processing technologies – either Hadoop or Spark;
- Experience with: Git (Bitbucket, GitHub);
- Knowledge in either: Storm, MySQL, Cassandra, MongoDB, Couchbase, Kafka, HBase or
ElasticSearch.
- Knowledge in either: Docker, Kubernetes, Redis, RabbitMQ or Jenkins.