Loading…
DevConf.CZ 2019 has ended

Saturday, January 26 • 11:30am - 11:55am
Cloud native data replication strategies

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.
This talk explains the key challenges of data replication of cloud/on-prem based Big Data clusters. To show how the replication strategies of the current storage systems (eg. Hadoop HDFS, Ceph)could be improved.

I. DATA

* What is Apache Hadoop Ozone
* main strength and vision (TLDR; multiple interfaces, not just hadoop: +s3 +posix fs).
* Explain why data replication is a key element of a cloud native storage.

II. SCIENCE

* Commonly used strategies (eg. random replication)
* What are the problems? (multiple independent node failures guarantee data loss)
* How they could be improved (larger data loss can be accepted if it has lower possibility).

This part is based on the copyset/hyperset papers but visualized and presented in a simplified way to easy to understand

Speakers
avatar for Marton Elek

Marton Elek

Engineer, Cloudera
Marton Elek is am Open Source Engineer at Cloudera. He is an Apache committer in Apache Hadoop project and PMC member of Apache Ratis. He has an experimental containerization project for Hadoop, Spark and other bigdata components which includes docker containers, and configuration... Read More →



Saturday January 26, 2019 11:30am - 11:55am
E104

Attendees (77)