Loading…
DevConf.CZ 2019 has ended

Sign up or log in to bookmark your favorites and sync them to your phone or calendar.

Academic & Research [clear filter]
Saturday, January 26
 

11:30am CET

Cloud native data replication strategies
This talk explains the key challenges of data replication of cloud/on-prem based Big Data clusters. To show how the replication strategies of the current storage systems (eg. Hadoop HDFS, Ceph)could be improved.

I. DATA

* What is Apache Hadoop Ozone
* main strength and vision (TLDR; multiple interfaces, not just hadoop: +s3 +posix fs).
* Explain why data replication is a key element of a cloud native storage.

II. SCIENCE

* Commonly used strategies (eg. random replication)
* What are the problems? (multiple independent node failures guarantee data loss)
* How they could be improved (larger data loss can be accepted if it has lower possibility).

This part is based on the copyset/hyperset papers but visualized and presented in a simplified way to easy to understand

Speakers
avatar for Marton Elek

Marton Elek

Engineer, Cloudera
Marton Elek is am Open Source Engineer at Cloudera. He is an Apache committer in Apache Hadoop project and PMC member of Apache Ratis. He has an experimental containerization project for Hadoop, Spark and other bigdata components which includes docker containers, and configuration... Read More →



Saturday January 26, 2019 11:30am - 11:55am CET
E104

12:30pm CET

Erasure Codes in a nutshell
This session will be a great option for people who already know about Erasure codes and want to understand low-level details. The presentation will contain a high-level overview of standard EC implementations, detailed information about math and algorithms behind EC and practical examples. This session is not suitable for EC developers.

Speakers


Saturday January 26, 2019 12:30pm - 1:20pm CET
E104