Source of Truth Series - Introduction

Nov 24, 2021 18:06 · 357 words · 2 minute read sot

Introduction

This post will be the first in a series of posts about Source of Truth (SoT) and my thoughts and observations on the subject. It’s a topic which is often discussed and debated at the tooling level, however I aim to take a holistic approach to addressing some of the other considerations which I can’t find any strong existing material for.

Background

In order to build and provide platforms for other people to consume, data governance, integrity and accuracy becomes a primary concern for automation professionals. This is where the subject of SoT is regularly discussed.

Often, this problem manifests into an automators’ world as they are attempting to objectify, document and automate business processes. Existing, ad-hoc data management problems managed by humans do not scale with automation, so it often feels like a problem they are looking to get resolved.

At the time of writing, there are some considerations and subjects I’d like to address:

  • How does it directly/indirectly affect business imperatives and operations?
  • How do I articulate this problem to other people not involved in the minutia?
  • What are the challenges and barriers which prevent adoption?
  • What should I be aware of, apart from the technical implementation?
  • What are some methods for migrating to a Source of Truth?

Writing Style

In taking on this series, the amount of content which will be covered will be substantial. It’s going to take some imaginative thinking on my behalf (and yours) to keep things as engaging as possible. It’s anticipated that some examples and analogies will not even be about the IT world itself, so that I can portray the concepts to you in an abstract, yet relatable manner.

After giving this some thought for some months, it’s really hard to structure the series into a formulaic sequence. So please, hang in there as I bounce around ideas and topics, and hopefully it all comes together!

It should also be noted that I have no intention to be prescriptive with this series, and is more intended to provoke thought and provide some insight into pitfalls and potentially a framework for addressing this problem.

Thank you for reading.