Liberty2010 - Đọc tin mới thường ngày với nhiều chủ đề hấp dẫn
  • Home
  • Ẩm Thực
No Result
View All Result
  • Home
  • Ẩm Thực
No Result
View All Result
Liberty2010 - Đọc tin mới thường ngày với nhiều chủ đề hấp dẫn
No Result
View All Result

Distributed Consensus and Data Replication strategies on the server

admin by admin
July 20, 2020
in Uncategorized
34
Distributed Consensus and Data Replication strategies on the server



We talk about the Master Slave replication strategy for reliability and data backups. This database concept is often asked in system design interviews with discussions on consistency and availability tradeoffs.

Very closely tied to the master slave architecture is the concept of distributed consensus. When designing a system, we must make sure that the individual components can agree on a particular value. (Leader election, distributed transactions, etc…) Some popular techniques are 2 phase commit, Multi Version Concurrency Control, SAGAs and Quorum.

Chapters
0:00 Problem Statement
0:53 Replication
1:24 Synchronous replication vs. Asynchronous replication
3:36 Peer to Peer data transfer
4:44 Split brain problem

Also useful when used with Master Slave replication is sharding. You can check out the video mentioned below.

AlgoExpert:

Made by engineers from Google and Uber, this site helps you build your algorithmic skills using code and white board explanations.
Be sure to use the code ‘gaurav’ for the discount. You get 15% off!

System Design Course:

Sharding:
System Design Playlist:
Designing Data Intensive Applications –

You can follow me on:
Facebook:
Quora:
GitHub:
LinkedIn:

#SystemDesign #Databases #Replication

Nguồn: https://liberty2010.org/

Xem thêm bài viết khác: https://liberty2010.org/game/

Xem thêm Bài Viết:

  • Với Cakhia link xem bóng đá trực tuyến không còn khó khăn
  • MEEYCRM Phần mềm quản lý bất động sản
  • Sinh năm 1985 mệnh gì? Tuổi Ất Sửu hợp với màu gì?
  • Phân tích kèo nhà cái TNC365 chính xác nhất
  • Đội hình tuyển Phần Lan tại Euro 2021 – Liệu có làm nên sự khác biệt
Previous Post

❤Cách dùng thuốc tránh thai KHẨN CẤP loại 1 viên/ Is emergency contraception harmful?

Next Post

Giảm béo bằng tiêm giảm mỡ bụng, có nên tiêm, tiêm gì, tại hại, nguy cơ, bao nhiêu tiền? Dr Ninh

Next Post
Giảm béo bằng tiêm giảm mỡ bụng, có nên tiêm, tiêm gì, tại hại, nguy cơ, bao nhiêu tiền? Dr Ninh

Giảm béo bằng tiêm giảm mỡ bụng, có nên tiêm, tiêm gì, tại hại, nguy cơ, bao nhiêu tiền? Dr Ninh

Comments 34

  1. YGorillAY says:
    2 years ago

    Hey man, awesome Videos on important topics! Actually, I haven't come across any other good source on Systems Design.

    Can you recommend some literature or a crash course on Systems Design? Or maybe you can make a whole course, going from topic to topic in a structured manner, more like how the topics are structured in a book, so that it can serve as a starter basic overview on the whole field.
    Cheers 😉

    Reply
  2. Nitesh Gupta says:
    2 years ago

    In many Amazon interviews, they usually ask Command execution framework design and play store design. Can i have material for that?

    Reply
  3. Rakib Jahan Khan says:
    2 years ago

    If there is single database, my application is scaling up in terms of user then the load balancer will not help, all the load will be in single database, for that how to serve fast in terms of user experience(read/write), how to scale or design the database??? i m seeking help for sql server

    Reply
  4. Ishaan Arora says:
    2 years ago

    06:00 The balance deduction thing, the 2 messages deduction 100 and deduction 50 are different messages right ? so what's wrong with deducting 150 ? I think I am missing a key point.

    Reply
  5. Piyush Singh says:
    2 years ago

    Amazing content brother 👍

    Reply
  6. DaveStar- says:
    2 years ago

    awesome.

    Reply
  7. Justin Bieber says:
    2 years ago

    is gossip architecture implements distributed consensus or is it basically just another name for it?

    Reply
  8. Kiwi AustEcon says:
    2 years ago

    Good video. Subbed 😉

    Reply
  9. Prathmesh Borle says:
    2 years ago

    Hi gaurav, will you make a video about system design of UPI and Bitcoin please

    Reply
  10. Soumya Sengupta says:
    2 years ago

    Hi Gaurav.
    I have been going through your blogs for a while now and they helped me ace my WalmartLabs interview where i started a couple of months back.
    Litlle context on the practical application of this video, this is a very common problem in distributed systems where solution to the problem through only sharding is prettymuch rare as data is expected to be available anywhere and everywhere.
    I have been using Microsoft's offering of AZURE COSMOS DB which is a planet scale document based db solution where you get triggers or events when the state of your data changes so that it can be asynchronously communicated to other nodes/clusters. So, AZURE COSMOS DB offer's the option of multiple master for writes which asynchronously sync with each other and in case if a conflict there are 2 options _ the last write wins / you can execute a stored proc for some custom logic. So all of this is very relevant.

    Reply
  11. TheHp6515b says:
    2 years ago

    Great content (upvoted and subbed). Don't see any other channel with short and precise summaries of fairly complicated concepts.

    One more benefit of Master-Slave – Move replicated data closer (geographically) to the end user. For better user experience – lower latency.
    Also sharding and replication scheme are tangential and often work in tandem. Generally you will have sharded databases with each shard replicated. Replicated shard could be a slave or a master (consensus based).

    I vote for distributed consensus. In fact this would cover the meat of distributed systems and could be broken down into multiple smaller introductory videos
    Video 1> Inherent problems with distributed systems (failure detection, n/w partitions, byzantine(non) faults, clock skews).
    Video 2> Why do we need consensus ? Protocols to tackle #1 and what they tradeoff to offer consensus (CAP axis). Protocols – 2pc, 3pc, paxos (intro).
    Video 3> Real applications and tradeoff they make for better performances. (Why distributed acid applications are hard and to be avoided).

    I see lot of interviewees(i'm interviewer in one of the FANG) have surface knowledge of these concepts and often incorrectly adjust to a constraint (been guilty myself). Content like yours can help someone find gaps in their understanding.

    Reply
  12. abhishek shetty says:
    2 years ago

    Hi Gaurav, awesome video.
    Do you happen to know which system design is probably used in the scenario when you run out of locks during distributed consensus pretty fast. Something like rate limiting for acquiring locks ?

    Reply
  13. Aakash Goplani says:
    2 years ago

    If our system has 'n' replicas, which replica amongst those 'n' stand chance to be master? What is the criteria for selecting one single replica amongst pool of replicas?

    Reply
  14. Mukund Sridhar says:
    2 years ago

    Excellent video as always gaurav.
    A few points from my side.
    1. Taking snapshots at regular intervals of the db is one way to avoid the single point of failure.
    2. Log reconstruction is one more way. Before writing to the db first flush to a log file. So if the db crashes the log file can be used to restore the db.
    3. I think when you talk about the databases communicating with each other , you mean there is an API that sits in front of them and these API's communicate with each other.
    Or is it that there is an API in front of the db which writes to a queue and another process that polls the queue and talks to the second db.
    4. One way to deal with the split brain problem is through the paxos algorithm.

    Great job and thanks !!! 🙂

    Reply
  15. Archit Sanghvi says:
    2 years ago

    Why don't you make a technical meme page. Where we get knowledge with laughter. haha 😛
    Amazing video and amazing memes in between 😛

    Reply
  16. Mihir Sawant says:
    2 years ago

    In AWS will multi AZ database work?

    Reply
  17. phd says:
    2 years ago

    Dude thanks very much. Your work is highly appreciated!

    Reply
  18. Saurabh Singh says:
    2 years ago

    Hi Gaurav,
    Nice video. I have some elementary doubts.
    1) how communication between two DB could get broken which results in Split brain problem. My guess is they communicate on particular port. Closing of port is only way to cause this issue.

    2) how master master architecture is achieved in DB. Bcz server would be configured to sent data to particular DB say DB1, howcome data could be dynamically sent to DB2. As much I know there is no load balancer behind DB set up.

    Thanks lot.

    Reply
  19. vikeng21 says:
    2 years ago

    hey can you slow down your speed a bit. looks like its 1.3x instead of 1.0x. i know you get excited but if you can tone down your speed people can follow a bit better.

    Reply
  20. Sampath says:
    2 years ago

    Auto increment, foriegn key having issue in master-master replication. How to get rid off it.

    Reply
  21. Krishna Purohit says:
    2 years ago

    I've Amazon interview in 2 days for SDE-1, any tips?

    Reply
  22. Abhishek Jain says:
    2 years ago

    Hey, another great video. But i have some doubts regarding how states are maintained. Say there are 3 nodes(A,B,C), each at state S0. Link between A and B is broken. A gets an update and propogates it to C and now both of them are on state S2. Now if C gets an update and tries to propogate it to B, B will take note the C's state is not the same as its own. So….how will it be decides who is ahead and who is behind? According to your example, B will just tell C to rollback and force its own state onto C which is not right. So how will this work?

    Reply
  23. Blank Blank says:
    2 years ago

    Great video !

    Reply
  24. somesh bose says:
    2 years ago

    Hello Gaurav. Just want to ask what is your view on data science in industry field? Are you planning to switch to data science field in the near future?

    Reply
  25. ocassionaltea says:
    2 years ago

    HI! i love your competitive programming videos. do u think you can make a serie of fendwick tree (some applications of it in problems, not the theory). i think it is hard to conceptualize a problem and using fendwick tree to solve it, so it would be really helpful.
    Thanks!

    Reply
  26. Back To Back SWE says:
    2 years ago

    Hey Gaurav, check out my most recent video, I want to talk to you 1 on 1.

    Reply
  27. girish pathak says:
    2 years ago

    Hi Gaurav , this was very helpful video to understand master slave architecture , I have few queries like what if load balancer itself goes down , how master and slave notify each other I mean what mechanism they will use so that both with will be in synch? I am facing one problem with load balancer I have posted the question in stackoverflow https://stackoverflow.com/questions/54923637/wildfly14-undertow-load-balancer-is-retriggering-the-rest-call-internally
    could you please suggest me here what I am doing worng ?

    Reply
  28. Chiranjeevi Saride says:
    2 years ago

    Wat software u use for editing your videos???

    Reply
  29. Divyanshu Bansal says:
    2 years ago

    Nice work Gaurav! This is the only channel for which I have enabled notifications. You are helping the whole community. Thanks a lot.
    PS: start an instagram page and post all these memes there also.😀

    Reply
  30. Ngalla Juke says:
    2 years ago

    dude you just look like Donald Glover in The Martian ahahah great video thx !!

    Reply
  31. Collected Reader says:
    2 years ago

    Your videos are great and you've done a great job in your explanations. You should do a video on book recommendations that aid people on learning about systems design thinking in this way.

    Reply
  32. Nandan Rathod says:
    2 years ago

    Hi Gaurav, good video. Can you make a video over "how large scale Indian Unified Payment Interface works"? Focus on technical/Networking and Database aspects. Thanks !!!

    Reply
  33. Faisal says:
    2 years ago

    is it just me or the audio isn't there..?

    Reply
  34. suhani gupta says:
    2 years ago

    can you please make a video on SAGA?

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Tin Tức Hàng Ngày

No Content Available
  • Liên Hệ
  • Chính Sách Bảo Mật

© 2022 JNews - Premium WordPress news & magazine theme by Jegtheme.

No Result
View All Result
  • Home
  • Ẩm Thực

© 2022 JNews - Premium WordPress news & magazine theme by Jegtheme.