{"id":14,"date":"2022-06-09T12:49:23","date_gmt":"2022-06-09T12:49:23","guid":{"rendered":"https:\/\/eck.uidev.site\/?page_id=14"},"modified":"2022-11-16T14:39:59","modified_gmt":"2022-11-16T14:39:59","slug":"challenges","status":"publish","type":"page","link":"https:\/\/markets.eckerson.com\/data-observability\/challenges\/","title":{"rendered":"Use Cases"},"content":{"rendered":"<div class=\"entry-content\">\n\t<div style=\" z-index: 2\" class=\"simplesub wow zoomIn bggrey b100w notoppover footover ceven withtitle singleno\">\n\t\t\t\t<h1>Use Cases<\/h1>\n\t\t\n\t\t<div class=\"textblockwrap\">\n\n\t\t\t\t\t\t<div class=\"txt\">\n\t\t\t<p>Data teams, and data engineers in particular, use data observability to optimize data quality and data pipelines across a lifecycle of three stages: validate and detect, assess and predict, and resolve and prevent.<\/p>\n<ul>\n<li><strong>Validate and detect<\/strong>. During this stage, data teams identify patterns in all the signals, as well as breaks in the patterns that might include anomalous trends, outlier values, job failures, or system errors. These pattern breaks indicate issues that need attention.<\/li>\n<li><strong>Assess and predict<\/strong>. During this stage, data teams triage issues such as null values or pipeline failures, and measure their impact on the business in terms of affected users, revenue, etc. They trace workflows and correlate events across various elements\u2014data sources, clusters, targets, etc.\u2014to isolate the root cause.<\/li>\n<li><strong>Resolve and prevent. <\/strong>Once data teams find the culprit\u2014perhaps a server failure or misfiring Kaka producer\u2014they work to get things back under control. They might debug pipeline code, optimize hardware utilization, or cleanse data to remove null value, all in an effort to prevent or at least minimize downstream damage to the business.<\/li>\n<\/ul>\n\t\t\t<\/div>\n\t\t\t\t\t\t<div class=\"sub\">\n\t\t\t\t\n\t\t\t\t\n\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t<div class=\"quote\">\n\t\t\t\t\t<p>Data observability addresses a lifecycle of three stages: validate and detect; assess and predict; and resolve and prevent.<\/p>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\n\t\t\t\t\n\n\t\t\t\t\n\n\n\n\n\t\t\t\t\t\t\t\t<div class=\"vidimg\">\n\t\t\t\t\t<div class=\"img\">\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"iframelink\">youtu.be\/bWd_w8PqKew<\/div>\n\t\t\t\t\t\t<iframe class=\"videoem\" src=\"https:\/\/www.youtube.com\/embed\/bWd_w8PqKew?rel=0\" title=\"YouTube video player\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen=\"\"><\/iframe>\n\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<div class=\"txtlnk\">\n\t\t\t\t\t\t<p>The life cycle of data observability.<\/p>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/div>\t\n\t<\/div>\n<\/div>\t\n\n<div class=\"entry-content\">\n\t<div style=\" z-index: 2\" class=\"simplesub wow zoomIn bgblue b100w notoppover footover cignore singleyes\">\n\t\t\n\t\t<div class=\"textblockwrap\">\n\n\t\t\t\t\t\t<div class=\"sub\">\n\t\t\t\t\n\t\t\t\t\n\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\n\t\t\t\t\n\n\t\t\t\t\t\t\t\t<div class=\"cfigure bgwhite\">\n\t\t\t\t\t<h2>The Lifecycle of Data Observability<\/h2>\n\t\t\t\t\t\n\n\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/markets.eckerson.com\/data-observability\/wp-content\/uploads\/sites\/14\/2022\/10\/Use-Cases-1024x493.png\" alt=\"\" \/>\n\t\t\t\t\t\n\n\n\n\n\t\t\t\t\t\t\t\t\t\t<a class=\"close\" href=\"https:\/\/markets.eckerson.com\/data-observability\/wp-content\/uploads\/sites\/14\/2022\/10\/Use-Cases.png\">Close<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\n\n\n\n\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/div>\t\n\t<\/div>\n<\/div>\t\n\n<div class=\"entry-content\">\n\t<\/div>","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":1343,"parent":0,"menu_order":3,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"class_list":["post-14","page","type-page","status-publish","has-post-thumbnail","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/markets.eckerson.com\/data-observability\/wp-json\/wp\/v2\/pages\/14","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/markets.eckerson.com\/data-observability\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/markets.eckerson.com\/data-observability\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/markets.eckerson.com\/data-observability\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/markets.eckerson.com\/data-observability\/wp-json\/wp\/v2\/comments?post=14"}],"version-history":[{"count":41,"href":"https:\/\/markets.eckerson.com\/data-observability\/wp-json\/wp\/v2\/pages\/14\/revisions"}],"predecessor-version":[{"id":1455,"href":"https:\/\/markets.eckerson.com\/data-observability\/wp-json\/wp\/v2\/pages\/14\/revisions\/1455"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/markets.eckerson.com\/data-observability\/wp-json\/wp\/v2\/media\/1343"}],"wp:attachment":[{"href":"https:\/\/markets.eckerson.com\/data-observability\/wp-json\/wp\/v2\/media?parent=14"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}