Data Synchronization


Data synchronization is hard, but it doesn’t have to be!

I’m your host and author of this site, Jason Whitehorn, and learned these lessons the hard way – through years of experience working on various data synchronization projects. Sadly, most of this knowledge is not well documented. To my knowledge, no books or dedicated resources exist that document this to any great extent, until now.

This site explains various patterns, tools, and techniques for reliably implementing data synchronization without pulling your hair out. If you’re new to this site I recommend starting with an introduction to data synchronization and going from there. Returning visitors will likely find the list of content updates a helpful resource.

Large portions of this website are available completely free, and I hope that you read and enjoy those pages. If you find them useful, I recommend registering as a paid member. By doing so you’ll not only support this website, but you’ll also get a lifetime of ad-free access to 100% of the content on this website, including many sections reserved exclusively for paid members.

 

Table of Contents

Part I: Server to Client Updates

  1. Whole Database Synchronization
  2. Delta-based Synchronization
  3. Handling Deletions
  4. Access Rights

Part II: Client to Server Updates

  1. Unique Identifiers
  2. Conflict Resolution
  3. Audit Logging

Part III: Performance & Scaling

  1. Identifying Changed Records
  2. Rapid Updates

Part IV: Legacy Integrations

  1. Unreliable Timestamps
  2. Replaying Transaction Logs

– denotes content which is only available to paid members.