<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Daniel Buchta on Medium]]></title>
        <description><![CDATA[Stories by Daniel Buchta on Medium]]></description>
        <link>https://medium.com/@daniel.buchta666?source=rss-8a3943e6b649------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/2*aBK4GH857acECsaHfwuGHA.jpeg</url>
            <title>Stories by Daniel Buchta on Medium</title>
            <link>https://medium.com/@daniel.buchta666?source=rss-8a3943e6b649------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sat, 21 Nov 2026 14:32:53 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@daniel.buchta666/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Consciousness]]></title>
            <link>https://medium.com/@daniel.buchta666/consciousness-a92d8776adeb?source=rss-8a3943e6b649------2</link>
            <guid isPermaLink="false">https://medium.com/p/a92d8776adeb</guid>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[machine-consciousness]]></category>
            <category><![CDATA[consciousness]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <dc:creator><![CDATA[Daniel Buchta]]></dc:creator>
            <pubDate>Tue, 29 Nov 2022 07:10:44 GMT</pubDate>
            <atom:updated>2022-11-29T07:10:44.600Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Pj-Kk2ZPeWD7e_6BIk_t-w.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@andrewbui?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Andrew Bui</a> on <a href="https://unsplash.com/s/photos/free?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Unsplash</a></figcaption></figure><blockquote>Explaining how something as complex as consciousness can emerge from a grey, jelly-like lump of tissue in the head is arguably the greatest scientific challenge of our time. The brain is an extraordinarily <a href="https://theconversation.com/the-brain-a-radical-rethink-is-needed-to-understand-it-74460">complex organ</a>, consisting of almost 100 billion cells — known as neurons — each connected to 10,000 others, yielding some ten trillion nerve connections.</blockquote><p><a href="https://theconversation.com/profiles/philip-goff-761089">Philip Goff</a> starts his article <a href="http://theconversation.com/science-as-we-know-it-cant-explain-consciousness-but-a-revolution-is-coming-126143"><strong>Science as we know it can’t explain consciousness — but a revolution is coming</strong></a><strong> </strong>with the words above. Then he continues like this</p><blockquote>The problem of consciousness, however, is radically unlike any other scientific problem. One reason is that consciousness is unobservable. You can’t look inside someone’s head and see their feelings and experiences. If we were just going off what we can observe from a third-person perspective, we would have no grounds for postulating consciousness at all.</blockquote><blockquote>Of course, scientists are used to dealing with unobservables. Electrons, for example, are too small to be seen. But scientists postulate unobservable entities in order to explain what we observe, such as lightning or vapour trails in cloud chambers. But in the unique case of consciousness, the thing to be explained cannot be observed. We know that consciousness exists not through experiments but through our immediate awareness of our feelings and experiences.</blockquote><p>Let’s try not to look inside our heads but make a test to know whether there’s something going on inside it. Let’s start with consciousness definition we shall use in the next thought experiment. We use one from the 1753 volume of <a href="https://en.wikipedia.org/wiki/Diderot">Diderot</a> and <a href="https://en.wikipedia.org/wiki/D%27Alembert">d’Alembert</a>’s <a href="https://en.wikipedia.org/wiki/Encyclop%C3%A9die">Encyclopédie</a>:</p><blockquote>Consciousness is the opinion or internal feeling that we ourselves have from what we do.</blockquote><p>We use this one as our interest is not in measuring intelligence as ability to solve some situation. We want to test inner perception presence. We are not gonna test the quality of this perception but only it’s existence. And now, let’s create 2 scenarios to measure our internal perception.</p><h3>Imagine that you are in the lift</h3><p>Your twin is in the second at the same ground floor. You don’t see anything outside same as in Einstein’s thought experiment. An operator can run one of them. You have no idea which one of them will move.</p><p>There is a touch screen with two words on the wall, “Me” and “Him”.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*LGlMkKQSKCZv1qNnK2mc-A.jpeg" /><figcaption>Alice and Bob are so popular I can’t help myself:)</figcaption></figure><p>Lifts are so smooth that none of you two can recognize whether it’s moving or not.</p><p>Operator runs one of them.</p><p>You have to push the “Me” or “Him” at some point when you decide to.</p><p>Unconsciouss one will never push the button as it will never get outter trigger to do an action.</p><p>Consciouss one will push the button after some amount of the time.</p><p>The event of pushing button does not come from outter world as there will be no outter trigger to do an action.</p><p>Thus this type of action is driven by consciousness as the opinion or internal feeling that we ourselves have from what we do.</p><h3>Bell’s like test</h3><p>This test is the same as in the previous scenario.</p><p>This time push the button or any action is measured. Whether the person inside the lift moves or makes something other is also the part of measurement.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Z4wOxjC4y_Nce6eq4xMN0Q.jpeg" /><figcaption>This time, Alice as a consciouss one thinks inner self.</figcaption></figure><p>Let’s use this labels:</p><ul><li>A — person in the first lift</li><li>B — person in the second lift</li><li>A(p) — measurement whether A pushes the button or not. A(p)=1 if button was pushed, A(p)=-1 if it was not.</li><li>A(m) — measurement whether person A made some other action. A(m)=1 if some other activity was done, A(m)=-1 if no other activity was done.</li><li>B(p) — measurement whether A pushes the button or not. B(p)=1 if button was pushed, B(p)=-1 if it was not.</li><li>B(m) — measurement whether person A made some other action. B(m)=1 if some other activity was done, B(m)=-1 if no other activity was done.</li></ul><p>Let’s make Bell’s like statement now:</p><blockquote>A(p)B(p)+A(p)B(m)+A(m)B(p)-A(m)B(m).</blockquote><p>After making easy step by excluding B(p) resp. B(m), we get:</p><blockquote>(A(p)+A(m))B(p)+(A(m)-A(p))B(m).</blockquote><p>For A, B both being unconsciouss, A(m)=A(p)=B(m)=B(p)=-1. Thus:</p><blockquote>(A(p)+A(m))B(p)+(A(m)-A(p))B(m)=2.</blockquote><p>For A consciouss and B unconsciouss, B(m)=B(p)=-1 while A(m) and A(p) can have both values. Also, if both A and B are consciouss, A(p), A(m), B(p), B(m) can be both -1,1. Then, the results of measurement can be 2 or -2 as at least one of A, B is consciouss. Statistically, after some amount of tests, we will come to this:</p><blockquote>(A(p)+A(m))B(p)+(A(m)-A(p))B(m)≤2.</blockquote><p>Thus, when one or both of A and B are not consciouss, there’s more outcomes for this scenario.</p><p>It means, consciousness brings another state to this scenario. In other words, entropy of the system increases.</p><h3>Conclusion</h3><p>We tried to propose the way of detecting consciousness. Albeit it’s hidden inside, we can propose scenarios where it exposes to us.</p><p>Then, consciousness as inner process can cause action that can be measured as the scenario one suggests.</p><p>The second, Bell’s like scenario, shows the purpose of consciousness. Consciousness leads towards increasing of entropy. Thus, consciousness is a functional property regarding the second law of thermodynamics.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*uMGmloUT1c62eUGASnjAhg.jpeg" /><figcaption>And what if Alice and Bob will hold entangled qubits and measure spins.</figcaption></figure><p>If A and B will be entagled particles, Bell’s inequality will cause:</p><blockquote>A(p)B(p)+A(p)B(m)+A(m)B(p)-A(m)B(m)≥2~2.8.</blockquote><p>Thus, quantum physics increases entropy by offering new interval to this scenario.</p><p>Do consciouss entities like us use also this extension?</p><p>Maybe theories like <a href="https://en.wikipedia.org/wiki/Orchestrated_objective_reduction#:~:text=Orchestrated%20objective%20reduction%20(Orch%20OR,product%20of%20connections%20between%20neurons.">Objective Orchstrated Reduction</a> will give us an answer.</p><p>Thanks for reading:)</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a92d8776adeb" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Why I like data mesh and μ Architecture]]></title>
            <link>https://medium.com/@daniel.buchta666/why-i-like-data-mesh-and-%CE%BC-architecture-d4ad0ddc125b?source=rss-8a3943e6b649------2</link>
            <guid isPermaLink="false">https://medium.com/p/d4ad0ddc125b</guid>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[data-streaming]]></category>
            <category><![CDATA[data-mesh]]></category>
            <dc:creator><![CDATA[Daniel Buchta]]></dc:creator>
            <pubDate>Thu, 24 Nov 2022 08:59:48 GMT</pubDate>
            <atom:updated>2022-11-25T16:03:08.089Z</atom:updated>
            <content:encoded><![CDATA[<p>Because I like to keep things simple and focus on value.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Q53vZlggJHreH6uH0sgbBA.jpeg" /><figcaption>Source: <a href="https://www.allthingsdistributed.com/2022/11/amazon-1998-distributed-computing-manifesto.html">https://www.allthingsdistributed.com/2022/11/amazon-1998-distributed-computing-manifesto.html</a></figcaption></figure><p>Back in 1998, a collective of senior Amazon engineers started to lay the groundwork for a radical overhaul of Amazon’s architecture to support the next generation of customer centric innovation. A core point was separating the presentation layer, business logic and data, while ensuring that reliability, scale, performance and security met an incredibly high bar and keeping costs under control. Their proposal was called the <a href="https://www.allthingsdistributed.com/2022/11/amazon-1998-distributed-computing-manifesto.html"><em>Distributed Computing Manifesto</em></a>.</p><blockquote>There are two key concepts in the new architecture we are proposing to address the shortcomings of the current system. The first, is to move toward a service-based model and the second, is to shift our processing so that it more closely models a workflow approach.</blockquote><blockquote><em>Distributed Computing Manifesto</em></blockquote><p>What happened with this great and clear idea?</p><p>Can you find the bottlenecks on the next 3 pictures?</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/1*RhN7i8_cAzWCPQuFT2l-NA.jpeg" /><figcaption>Bottleneck processing orthogonal against the flow based on store, extract, transform and store again and again to build complex overarchitected solutions. Source:<a href="https://scgupta.link/big-data-pipeline">https://scgupta.link/big-data-pipeline</a></figcaption></figure><p>Data processing was excluded from the flow. Architecture put it into the position of bottleneck between data producers and data consumers using the term <em>data pipeline</em>. This led to overarchitected complexity as we see it for example in nowadays cloud data technology solutions on the diagrams above.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/626/1*hLrKk48EPVwOlp4d63xfHg.jpeg" /><figcaption>Les données ne sont pas de la fumée(data is not smoke).</figcaption></figure><p>Data is not a smoke and thus, data processing is not to make a pipeline.</p><p>It’s time to return back to <em>Distributed Computing Manifesto.</em></p><p>The first, is to move toward a service-based model via data as a product principle.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*sMhzsC1ecgbKzDaEM1b2QA.png" /><figcaption>The first, is to move toward a service-based model via data as a product principle. Source: <a href="https://martinfowler.com/articles/data-mesh-principles.html">https://martinfowler.com/articles/data-mesh-principles.html</a></figcaption></figure><p>The second, is to shift our processing so that it more closely models a workflow approach via data streaming first solutions to connect domain driven data products.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*dPFv0DmY92RItD4qcnG5CQ.jpeg" /><figcaption>The second, flow of data consisting of self-repeating pattern doing small operations. Source for data product elements: <a href="https://martinfowler.com/articles/data-mesh-principles.html">https://martinfowler.com/articles/data-mesh-principles.html</a></figcaption></figure><p>The key architecture pattern towards this is <em>μ Architecture </em>as:</p><p><em>μ Architecture is recursivelly repeating pattern of self simillar data micro processors consisting of tripplets source connect, processor and sink connect, which we call data μ-products. These μ-products then create mesh. This pattern allows us to spread the complexity of processing across the mesh through distribution and scalability.</em></p><p>To fully embrace this idea, check out these articles:</p><ul><li><a href="https://medium.com/p/a91073af147c">μ Architecture</a> by me</li><li><a href="https://medium.com/agile-lab-engineering/how-to-identify-data-products-welcome-data-product-flow-76d7d85d23af">How to identify Data Products? Welcome “Data Product Flow”</a> by <a href="https://medium.com/u/e713e1f31a">P Platter</a></li><li><a href="https://medium.com/agile-lab-engineering/data-mesh-and-monoliths-integration-patterns-78ecf9f4daa1">Data mesh and monoliths integration patterns</a> by <a href="https://medium.com/u/258e4805335b">Ugo Ciracì</a></li><li><a href="https://medium.com/@ugociraci/scaled-data-mesh-250e2fe5c36f">Scaled Data Mesh</a> by <a href="https://medium.com/u/258e4805335b">Ugo Ciracì</a></li></ul><p>Let your data flow;)</p><p>Thanks for reading:)</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=d4ad0ddc125b" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[On superdeterminism of Bell’s theorem]]></title>
            <link>https://medium.com/@daniel.buchta666/on-superdeterminism-of-bells-theorem-e0ce4ce6d359?source=rss-8a3943e6b649------2</link>
            <guid isPermaLink="false">https://medium.com/p/e0ce4ce6d359</guid>
            <category><![CDATA[quantum-mechanics]]></category>
            <category><![CDATA[quantum-physics]]></category>
            <category><![CDATA[quantum]]></category>
            <dc:creator><![CDATA[Daniel Buchta]]></dc:creator>
            <pubDate>Thu, 03 Nov 2022 15:19:38 GMT</pubDate>
            <atom:updated>2022-11-03T15:23:59.908Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1020/1*ab-TEDy6aGs4Orx7-9Luyg.jpeg" /><figcaption>John Bell and his famous theorem in 1982 (Image: CERN). Source:<a href="https://home.cern/news/news/physics/fifty-years-bells-theorem">https://home.cern/news/news/physics/fifty-years-bells-theorem</a></figcaption></figure><p><a href="https://en.wikipedia.org/wiki/Bell%27s_theorem#Kochen%E2%80%93Specker_theorem_(1967)">Bell’s theorem</a> comes with two assumptions:</p><ul><li>Locality means that nothing travel faster than the speed of light ie. that only way to appear at the other place is to travel through timespace</li><li>Realism ie. things have the underlying physical properties that exist independently of being observed or measured</li></ul><p>Experimental validations of violations of the Bell inequalities that later resulted in Clauser, Aspect, and <a href="https://en.wikipedia.org/wiki/Anton_Zeilinger">Anton Zeilinger</a> being awarded the 2022 <a href="https://en.wikipedia.org/wiki/Nobel_Prize_in_Physics">Nobel Prize in Physics</a>, lead us to the result, that one of two assuptions above doesn’t hold</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/450/0*xyzdbK4qwFSrCI6R.png" /><figcaption><a href="https://en.wikipedia.org/wiki/Bell%27s_theorem">https://en.wikipedia.org/wiki/Bell%27s_theorem</a></figcaption></figure><p>There’s also the third assumption that is implicitly assumed within the Bell’s Theorem. A necessary assumption to derive Bell’s theorem is that the hidden variables are not correlated with the measurement settings. It’s often called The assumption of statistical independence. Sometimes, it’s also referred to as the free choice or free will assumption, since its negation implies that human experimentalists are not free to choose which measurement to perform. A theory where the choice of measurement is necessarily correlated with the system being measured is known as <em>superdeterminism</em>.</p><p>Let’s talk about this branch of <em>superdeterminism</em>. Then, there are properties that are just given. Let’s assume there is a countably infinite of them. Let’s call the set of properties <em>P</em>={<em>p_1,p_2,p_3,…</em>}. We can create also countably infinite of sentences <em>S</em>{<em>s_1,s_2,s_3,…</em>} where each of them describes property p_n as true(1) or false(0) by assigning 1 or 0 to the n-th place of the sentence.</p><p>Thus, at the end, we have the countably infinite set <em>S</em> of all sentences that describe all the superdeterminstic world around us.</p><p>Now, let’s use <a href="https://en.wikipedia.org/wiki/Cantor%27s_diagonal_argument">Cantor’s diagonal argument</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/500/0*AnJT7DBwrT6ggXta.png" /><figcaption><a href="https://en.wikipedia.org/wiki/Cantor%27s_diagonal_argument">https://en.wikipedia.org/wiki/Cantor%27s_diagonal_argument</a></figcaption></figure><p>By using it we can construct sentence <em>s</em> that is not the member of the countably infinite set <em>S</em>. Thus, <em>S</em> is not complete.</p><p>Note that sentences can be taken as events that are happening. Each event is described by sentence.</p><p>Thus, if our universe is superdeterministic, it’s not countably infinite. We are not able to describe it as a set of sentences line by line unless our universe is finite. When universe is finite then finite set of events/properties create only finite set of sentences. This prevents us from construction of sentence <em>s </em>via <a href="https://en.wikipedia.org/wiki/Cantor%27s_diagonal_argument">Cantor’s diagonal argument</a>.</p><p>Another possibility is that our universe is uncountably infinite ie. it has cardinality of the continuum.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e0ce4ce6d359" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Technical debt meets Fibonacci Sequence]]></title>
            <link>https://medium.com/@daniel.buchta666/technical-debt-meets-fibonacci-sequence-113e99138963?source=rss-8a3943e6b649------2</link>
            <guid isPermaLink="false">https://medium.com/p/113e99138963</guid>
            <category><![CDATA[technical-debt]]></category>
            <category><![CDATA[product-development]]></category>
            <dc:creator><![CDATA[Daniel Buchta]]></dc:creator>
            <pubDate>Mon, 17 Oct 2022 09:23:05 GMT</pubDate>
            <atom:updated>2022-10-17T11:41:19.765Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/857/1*doumIwk7kAaEBWVjAkDrog.jpeg" /><figcaption>When tackling technical debt you can either do nothing or take some action.</figcaption></figure><p>Is technical debt something you can avoid at all? Not really. I’ll try to explain it. Your application lives in cycles. After each cycle we want app to have as high quality as possible. But, during each cycle, we simply must accept that something is here to solve from previous one. Let’s write down a recursive description of this process:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/556/1*96aVDpIAqy_BYUSTWUes-A.jpeg" /></figure><p>Living cycles of your application can be decribed by loss function Q. In every step, you want to be at the maximum level. Thus, we want Q(n)=n. But, in every cycle we must take care of issues from previous one. This implies that equation describing application quality is affected by loss equal to Q(Q(n-1)). This leads to equation n-Q(Q(n-1)). Let’s write this function down:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/598/1*pIG1Ouy9pclhOp4DqGAQpQ.jpeg" /><figcaption>To get this, use Q(n)=n-Q(Q(n-1)) where Q(0)=0.</figcaption></figure><p>Take a look at it. This leads towards some self repeating pattern. When we’ll put it down, it allows us to see this diagram:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*a2OGrUrC5DF2iftxXA0VCw.jpeg" /><figcaption>This diagram is constructed this way: Every Q(n) is connected with n by an arrow.</figcaption></figure><p>If we take a closer look, we an see selfsimilar pattern that appears to be constructor of this diagram/fractal:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/857/1*doumIwk7kAaEBWVjAkDrog.jpeg" /><figcaption>Remember. When tackling technical debt you can either do nothing or take some action.</figcaption></figure><p>At each level, we want our app ie. Q have the highest possible value. Check out next diagram:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*4Jmj4QBOu5G1NRL9CBYeNg.png" /><figcaption>When you decide whether to tackle technical debt or let it just be, note that at every level, your app will reach the maximal value when you decide to tak an action. Check out numbers at the very right side. They maximize value at the each level. Do you know this sequence?</figcaption></figure><p>You can see that the biggest value for every level is at the very right side. Let’s write down the values: 1,2,3,5,8,13,21… Are you familiar with this sequence? It’s famous <a href="https://en.wikipedia.org/wiki/Fibonacci_number">Fibonacci sequence</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*TBKF5OcNL4Q_Zm8qyMqOBA.jpeg" /><figcaption>When you decide whether to tackle technical debt or just let it be, note that at every level, your app will reach the maximal value when you decide to taka an action. The maximal value is defined by Fibonacci sequence.</figcaption></figure><h4>Conclusion</h4><p>When you decide whether to tackle technical debt or just let it be, note that at every level, your app will reach the maximal value when you decide to take an action.</p><p>If you decide to take no action nothing happens. No added value, no customers, no money.</p><p>If you decide to take action and make your application better, the maximal value at each level is defined by Fibonacci sequence.</p><p>It’s the same with every challenge in your life.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=113e99138963" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[μ Architecture offers Next Best Offer]]></title>
            <link>https://medium.com/@daniel.buchta666/%CE%BC-architecture-offers-next-best-offer-d9771f8da0ee?source=rss-8a3943e6b649------2</link>
            <guid isPermaLink="false">https://medium.com/p/d9771f8da0ee</guid>
            <category><![CDATA[data-architecture]]></category>
            <category><![CDATA[data-mesh]]></category>
            <category><![CDATA[data-science]]></category>
            <dc:creator><![CDATA[Daniel Buchta]]></dc:creator>
            <pubDate>Fri, 16 Sep 2022 10:28:28 GMT</pubDate>
            <atom:updated>2022-09-16T10:28:28.979Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/800/1*op2kcr7ofx-Fyo3hK_auGQ.png" /><figcaption>Source: <a href="https://en.wiktionary.org/wiki/%CE%BC">https://en.wiktionary.org/wiki/%CE%BC</a></figcaption></figure><p>This article provides real implementation of μ Architecture in the Next Best Offer use case.</p><p>Next best offer (also known as <a href="https://www.ngdata.com/s/next-best-action-marketing-software/">next best action</a>) is a form of predictive analytics that helps marketers and their organizations better judge customer spending habits and guide marketing efforts toward connecting with customers to close a deal.</p><p>We want to bring value to the customer toengage him make him engaged and make a deal with us. So we need right offer in the right time.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*jc-jWHOqsS-uns4ScFLoBg.jpeg" /><figcaption>Offer value is time dependent. It’s highest value is in the Primary Interest period. The Secondary Interest period meets the lower offer value. Then, offer does not have relevant value for customer. Moreover, there is Point of Negative Impact, where offer starts to generate negative value for customer.</figcaption></figure><p>Offer value is time dependent. It’s highest value is in <em>the Primary Interest Period</em>. <em>The Secondary Interest Period </em>meets the lower offer value. Then, offer does not have relevant value for customer. Moreover, there is <em>Point of Negative Impact</em>, where offer starts to generate negative value for customer.</p><p>That’s where data comes into this. They have to be both actual and relevant. Moreover, we want them to be personalized.</p><p><em>Actual data</em> means they have to be <em>event-driven.</em></p><p><em>Relevant data</em> means to be <em>polyglot</em>.</p><p><em>Personalized data</em> means to be <em>decentralized</em>.</p><p>That’s the completelly oposite scenario towards standard ETL/batch data processing where we want to get all of the data to the one place to do complex analytics process on them.</p><p>And, in fact standard ETL/batch data processing fails here in these terms:</p><ul><li>Reaction time is too long many times going not only beyond <em>The Interest Periods</em> but falling behind <em>Point of Negative Impact.</em></li><li>Complexity affects time-to-market by extensivelly growing feature delivery hand in hand with growing engineering costs.</li><li>Company culture concentrates on <em>How can we do it?</em> and <em>When it will be done?</em> instead of <em>What can we do?</em> causing that customer remains on the periphery of interest.</li></ul><p><strong>Let’s create Next Best Offer</strong></p><p>To create Next Best Offer we need data. They are polyglot in different ways:</p><ul><li>character, some of the covers characteristic, some of them cover dynamics, some of them cover relations</li><li>speed ie. realtime, batch, API.</li><li>environment, ie. DWH, OLTP, 3rd parties</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*PfrFADuVB9CV9aOUGAD2sQ.jpeg" /><figcaption>Offer Pool is standard DWH batch output. Customer Profile is CRM connector. Ineraction Events are Customer Journey continuous track flow.</figcaption></figure><p>When creating Next Best Offer, you need:</p><ul><li>Pool of offers typically prepared by DWH through batch process</li><li>Pool of customers typically served by CRM in oltp manner</li><li>Events that covers customer journey. They come in continuous flow.</li></ul><p>Customer journey events are in fact places in time that trigger action. When we want to serve customer The Next Best Offer, we have to know curent customer state. Otherwise, when trying to create Next Best Offer from previous customer state, we will frustrate him with previous best offer. That’s when we reach <em>Point of Negative Impact.</em></p><p>That’s why having continuous flow of events is inevitable prerequisite of succesfull Next Beste Offer solution.</p><p>Once, we have data sources defined, we can create a value for customer.</p><p>First step towards creating valuable Next Best Offer is to create pool of valid personalized offers.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*RFMJSqF_igLFfMHfkxIYOg.jpeg" /><figcaption>First step towards creating valuable Next Best Offer is to create pool of valid personalized offers.</figcaption></figure><p>The most interesting part on diagram above are that tiny black arrows. In fact, their smoothness will determine whether your application will be the valuable. Once you will not pay main attention to the borders between data sources and app itself, your product will soon become complex, your feature delivery pipeline will be longer and longer and engineering costs will remain growing.</p><p>Zhamak Dehghani covers this theme by the term orthogonality within her book <a href="https://www.oreilly.com/library/view/data-mesh/9781492092384/">Data Mesh</a>.</p><p><em>μ Architecture</em> comes here with pattern depicted as those hexagonal structure to create recursivelly repeating pattern of self simillar data micro processors consisting of tripplets source connect, processor and sink connect, which we will call data <em>μ-products</em>.</p><p>We will demonstrate this on <em>Valid Offers μ-product.</em></p><p>We will need also Validations and Eligibilities to create it.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*U3YhwkmLphgoI6MJ6uzG6w.jpeg" /><figcaption>Valid Offers <em>μ-product.</em></figcaption></figure><p>When using streaming technology like <a href="https://kafka.apache.org/">Apache Kafka</a> we can define communication boundaries by topics. They are performant, resillient and scalable.</p><p>Valid Offers <em>μ-product </em>then consists of<em> </em>Sources are represented by topics offers, customers, events. Business logic is delivered through topics validation_rules and eligibilities. The serving side of the Valid Offers <em>μ-product is valid_offers topic.</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/556/1*HvUUhkNgmoHkAhDiHGuwZw.jpeg" /><figcaption>Valid Offers <em>μ-product. </em>Sources are represented by topics offers, customers, events. Business logic is delivered through topics validation_rules and eligibilities. The serving side of the Valid Offers <em>μ-product is valid_offers topic.</em></figcaption></figure><p>Kstream library serves here as a place for business logic. When divided into smaller steps, this is able to absorb whole Next Best Offer business logic.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*a-Vl6JCPsVqChzF4TvCjLA.jpeg" /><figcaption>This diagram illustrates previous steps</figcaption></figure><p>The same pattern is then used to create final best offers by filtering them from valid offers.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*az8yBRBwU3PBjO1LMSLrcA.jpeg" /><figcaption>Next Best Offer as a <em>μ-product at the end of continuous data flow.</em></figcaption></figure><p>By realising this, it makes this kind of architecture continously producing the Next Best Offer personalized for each customer.</p><p>Note that there is no database used. When realizing it as self similar pattern of producers, processors and consumers, at the end you realize, that what is an active part of application is not retrieving results via queries but continuous data flow making application to react in tact with customer journey.</p><p>Whole application then serves various marketing channels making them be a part of Next Best Offer platform in terms of taking primary attention to the smoothness of data flow that in fatc brings value to our customers.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*EsVpUDztMm-8ikpcBvreAA.jpeg" /><figcaption>Next Best Offer platform including Marketing Channels.</figcaption></figure><p>True <em>crème de la crème magic </em>happens when marketing channel’s customer feedback is backpropagated into platform via Interaction events.</p><p>That’s where I use the term Continuous Customer Experience:)</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*VW5S-Vc-NJaKgjFxT5GGAw.jpeg" /><figcaption>Continuous Customer Experience:)</figcaption></figure><p>This type of architecture can be enhanced by machine learning implemented straight into the flow within <em>μ-products. </em>Check my previous article <a href="https://medium.com/@daniel.buchta666/%CE%BC-architecture-goes-machine-learning-fe7e3a8c5d35"><em>μ Architecture goes machine learning</em></a><em> </em>for more information.</p><p>Thanks for reading:)</p><p>Check out also previous articles about <em>μ Architecture:</em></p><p><a href="https://medium.com/@daniel.buchta666/%CE%BC-architecture-a91073af147c"><em>μ Architecture</em></a></p><p><a href="https://medium.com/@daniel.buchta666/%CE%BC-architecture-goes-machine-learning-fe7e3a8c5d35"><em>μ Architecture goes machine learning</em></a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=d9771f8da0ee" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Potential loopholes theory]]></title>
            <link>https://medium.com/@daniel.buchta666/potential-loopholes-theory-a6919f4f5c34?source=rss-8a3943e6b649------2</link>
            <guid isPermaLink="false">https://medium.com/p/a6919f4f5c34</guid>
            <category><![CDATA[quantum-physics]]></category>
            <category><![CDATA[quantum-computing]]></category>
            <dc:creator><![CDATA[Daniel Buchta]]></dc:creator>
            <pubDate>Fri, 09 Sep 2022 13:04:25 GMT</pubDate>
            <atom:updated>2022-09-09T13:04:25.304Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/700/1*S_eRj_0p8Ejw9foFGSiqmg.jpeg" /><figcaption><a href="https://en.wikipedia.org/wiki/Theory_of_relativity">Theory of Relativity</a></figcaption></figure><p>What is an observer?</p><p>This is the question where problems of the modern quantum physics point after all.</p><p>Why after more than 100 years we did not make succesful theory to let us embrace quantum mechanics albeit as a method it provides right results?</p><p><a href="https://www.youtube.com/watch?v=zcqZHYo7ONs">Bell’s theorem</a> shows that quantum physics cannot be a local realistic hidden variable theory. What that means is that any interpretation of quantum mechanics either requires <a href="https://en.wikipedia.org/wiki/Quantum_nonlocality#Entanglement_and_nonlocality">non-locality</a>, or requires non-realism.</p><p>Here:</p><ul><li>locality means that information can’t travel faster than light</li><li>realism means that act of observation doesn’t affect the observed entity.</li></ul><p>Where did the same thing happens in physics?</p><p>The <a href="https://en.wikipedia.org/wiki/Principle_of_relativity">principle of relativity</a> states that physical laws depend on the reference frame of an observer.</p><p>An <a href="https://en.wikipedia.org/wiki/Event_(relativity)">event</a> is an occurrence that can be assigned a single unique moment and location in space relative to a <a href="https://en.wikipedia.org/wiki/Frame_of_reference"><strong>frame of reference</strong></a><strong>.</strong></p><p>In <a href="https://en.wikipedia.org/wiki/Theory_of_relativity">Einsteinian relativity</a>, reference frames are used to specify the relationship between a moving <a href="https://en.wikipedia.org/wiki/Observer_(special_relativity)">observer</a> and the phenomenon under observation. In this context, the term often becomes <strong><em>observational frame of reference</em></strong> or <strong><em>observational reference frame.</em></strong></p><p>Let’s go back to <a href="https://en.wikipedia.org/wiki/Albert_Einstein">q</a>uantum physics.</p><p>In the famous <a href="https://en.wikipedia.org/wiki/Double-slit_experiment">double-slit experiment</a>, it’s shown that both light and matter can display characteristics of both classically defined waves and particles. Moreover, it displays the fundamentally probabilistic nature of <a href="https://en.wikipedia.org/wiki/Quantum_mechanics">quantum mechanical</a> phenomena.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*l5cI3DyrPQ6Rq_9oP9xjaA.jpeg" /><figcaption>Quantum States Simplified: Wave, Particle and String. Based on different angles of Views all are possible.</figcaption></figure><p>An act of observation is what makes this probalities to materialize as an observed event, ie. an occurrence that can be assigned a single unique moment and location in space relative to a <a href="https://en.wikipedia.org/wiki/Frame_of_reference"><strong>frame of reference</strong></a><strong>.</strong></p><p>What about to put an observer into our theory to make it complete?</p><p>What about to add an Observer dimension to the spacetime.</p><p>In my thought experiment, I imagine an Observer walking on the memory foam. His mind makes steps and that steps remind imprinted within this foam.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ljsKalU47-7t_6xFdjsJ0w.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*pVoeKCSXWosdX5Up2NmGNw.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*dtcwOZIguV5m7ByLmbfS3A.jpeg" /><figcaption>Quantum States Simplified: Wave, Particle and String. Based on different angles of Views all are possible. In fact they are projections of loophole created by spacetime bended by mind. It’s like stepping on the spacetime memory foam. Bending is localized within the mind. It’s also immediate.</figcaption></figure><p>Spacetime remains bended through our mind creating loophole whenever interacting with spacetime. Here, spacetime is represented by Schrödinger Equation.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/413/1*bRjjyFDf89gtkYbcqM1d_A.jpeg" /><figcaption><a href="https://en.wikipedia.org/wiki/Schr%C3%B6dinger_equation">https://en.wikipedia.org/wiki/Schr%C3%B6dinger_equation</a></figcaption></figure><p>We perceive this once like wave, once like particle or once like string due to our observer dimension position when talking about double-slit experiment.</p><p>What is common is a loophole.</p><p>Loophole is localized within the observer as the observer bends the timespace. Same principle as Einstein used for <a href="https://en.wikipedia.org/wiki/General_relativity">The General Theory of Relativity</a> can be used. This time energy comes both from natural powers and from mind of observer. Energy = en -“at” + ergo-”action”, represents here state of being in action for both natural powers and mind. Depending on observers energy/expectation setup appropriate natural power acts.</p><p>Schrödinger Equation then can be rewritten by adding observer dimension o.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*BPeaSPwtPgUtenaKi5Jibw.jpeg" /><figcaption>Schrödinger Equation perturbed by an Observer dimension o within an observable, the <a href="https://en.wikipedia.org/wiki/Hamiltonian_(quantum_mechanics)">Hamiltonian</a> <a href="https://en.wikipedia.org/wiki/Operator_(physics)">operator</a>.</figcaption></figure><p>Let’s look deeper at the Schrödinger Equation:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/393/1*nGYtYD882sBiFkw71bVJXw.jpeg" /><figcaption>Position-space Schrödinger equation with three-dimensional position vector r.</figcaption></figure><p>Let’s consider that an observer affects the time-invariant potential energy <em>V</em> at the location given by the position vector <em>r</em>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Pe4XKBvYNFVFFhq1fF7lXg.jpeg" /><figcaption>Observer affects the time-invariant potential energy <em>V</em> at the location given by the position vector <em>r</em>.</figcaption></figure><p>In the moment of observation, observer changes the potential of the situation. He creates <em>potential loophole</em> into spacetime. As mentioned before, we used an analogy with gravity bending timespace within General Relativity Theory. Observer function <em>o</em> has to be immediate acting in the moment of observation. Thus, the good candidate to represent it can be kind of <a href="https://hal.inria.fr/inria-00423540/document">non smooth dynamical system</a>. To research proper type of dynamical system to use requires some nontrivial amount of research. Thus, we’ll let this for later.</p><p>The first equation acquires observer only within the Hamiltonian. Now, let’s try to think beyond this idea. What if observer affects whole position vector <em>r</em>. The second equation bellow implements observer <em>o</em> into position vector <em>r</em> affecting also wave function <em>Ψ</em>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Kg3Fp5dOpOVAosZlAW8pLQ.jpeg" /><figcaption>Observer o acts along with position vector r throughout whole Schrödinger Equation.</figcaption></figure><p>This can seem rather weird. We’ll let this idea open for now.</p><p>How observer acts?</p><p>What energy does he use to interact with particle?</p><p>One of the possible scenarios leads to <em>Landauer principle </em>that arises from <a href="https://en.wikipedia.org/wiki/Maxwell%27s_demon">Maxwell’s demon</a><em>.</em><a href="https://medium.com/@daniel.buchta666/red-queen-a-theory-of-relativity-and-maxwells-daemon-90258fdb85c7"><em> </em>I discussed this in one of my previous articles</a><em>.</em></p><p>Landauer principle states that for a computational operation in which 1 bit of logical information is lost, the amount of entropy generated is at least k ln 2, and so, the energy that must eventually be emitted to the environment is E ≥ kT ln 2. This also holds for us.</p><p>I see this as a valid path towards creating consistent mechanism of interaction between observer and particle.</p><p>Once again: Energy = en -“at” + ergo-”action”, represents here state of being in action for both natural powers and observer.</p><p><em>Landauer’s principle asserts that there is a minimum possible amount of energy required to erase one bit of information, known as the </em>Landauer limit<em>: </em>kT<em> ln 2.</em></p><h3>Conclusion</h3><p>In this article we discussed consept of implementing observer into quantum mechanics to solve challenges regarding it’s understanding and acceptance.</p><p>Using an analogy with Albert Einstein’s General Theory of Relativity we proposed that physical timespace is bended by act of observation creating together observed timespace. We call this bending a <em>Potential loophole</em>.</p><p>Further, we tried to extend Schrödinger Equation by involving observer in the form of dynamical system into it.</p><p>Two ideas how to do it are discussed:</p><ul><li>Observer affects the Hamiltonian. Here we propose that potential of the system is changed via observation.</li><li>Observer affects also wave function <em>Ψ</em>. This comes from idea that observer is somehow correlated with position vector <em>r</em>.</li></ul><p>This construction comes from the <em>E law</em>, which I stated to try to point out that accepting and acquiring the observer as an active part of quantum mechanics is a necessary prerequisite in order to take steps towards a complete theory.</p><p><em>E law</em>: For every expectation/expression <em>Ex</em> there exists eyewitness <em>Ey</em> and energy <em>E</em> under that <em>Ex</em> is experienced as experience <em>Ee</em>, i.e. <em>Ex(Ey,E):Ee</em>.</p><p>What may be interesting is that an <em>E law</em> is so far as I know only construction that not explains but implies quantum properties.</p><p>An <em>E law</em> needs <a href="https://en.wikipedia.org/wiki/Quantum_superposition">Quantum Superposition</a>, i.e. property that combination of two possible outcomes is also possible outcome.<br>It also needs <a href="https://en.wikipedia.org/wiki/Quantum_entanglement">Quantum Entanglement</a>, ability to correlate two no matter how far places in spacetime.<br>It implies <a href="https://en.wikipedia.org/wiki/Measurement_problem">Quantum Measurement Problem</a> as a result of of not including observer/eyewitness into an Experience description.</p><p>Albert Einstein showed us that the time perception is subjective.<br>Maybe we are ready to accept that whole reality is subjective.<br>The, we can create better one.</p><p>What seems to play a crutial role here is negentropy. I want to discuss it further.</p><p>So let me finish this article with Leon Brillouin and Ervin Schrödinger.</p><p><em>If a living organism needs food, it is only for the negentropy it can get from it, and which is needed to make up for the losses due to mechanical work done, or simple degradation processes in the living system. Energy contained in food does not really matter, since energy is conserved and never gets lost, but negentropy is the important factor.</em></p><p>Leon Brillouin, <a href="https://books.google.sk/books?id=vGPDAgAAQBAJ&amp;pg=PA117&amp;dq=Energy+contained+in+food+does+not+really+matter,+since+energy+is+conserved+and+never+gets+lost,+but+negentropy+is+the+important+factor.&amp;hl=en&amp;sa=X&amp;ved=0ahUKEwjd46yZ5ZjkAhVN4qQKHZ9KDU4Q6AEIKTAA#v=onepage&amp;q=Energy%20contained%20in%20food%20does%20not%20really%20matter%2C%20since%20energy%20is%20conserved%20and%20never%20gets%20lost%2C%20but%20negentropy%20is%20the%20important%20factor.&amp;f=false">Science and Information Theory</a></p><p>ORGANIZATION MAINTAINED BY EXTRACTING ‘ORDER’ FROM THE ENVIRONMENT</p><p><em>How would we express in terms of the statistical theory the marvellous faculty of a living organism, by which it delays the decay into thermodynamical equilibrium (death)? We said before: ‘It feeds upon negative entropy’, attracting, as it were, a stream of negative entropy upon itself, to compensate the entropy increase it produces by living and thus to maintain itself on a stationary and fairly low entropy level. If D is a measure of disorder, its reciprocal, l/D, can be regarded as a direct measure of order. Since the logarithm of l/D is just minus the logarithm of D, we can write Boltzmann’s equation thus: -(entropy) = k log (l/D). Hence the awkward expression ‘negative entropy’ can be he replaced by a better one: entropy, taken with the negative sign, is itself a measure of order. Thus the device by which an organism maintains itself stationary at a fairly high level of he orderliness ( = fairly low level of entropy) really consists continually sucking orderliness from its environment.</em></p><p>Erwin Schrödinger, <a href="https://en.wikipedia.org/wiki/What_Is_Life%3F">What is Life</a></p><p>Thanks for reading:)</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a6919f4f5c34" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[μ Architecture goes machine learning]]></title>
            <link>https://medium.com/@daniel.buchta666/%CE%BC-architecture-goes-machine-learning-fe7e3a8c5d35?source=rss-8a3943e6b649------2</link>
            <guid isPermaLink="false">https://medium.com/p/fe7e3a8c5d35</guid>
            <category><![CDATA[data-mesh]]></category>
            <category><![CDATA[data-democratization]]></category>
            <category><![CDATA[data-architecture]]></category>
            <category><![CDATA[data-science]]></category>
            <dc:creator><![CDATA[Daniel Buchta]]></dc:creator>
            <pubDate>Fri, 09 Sep 2022 12:58:36 GMT</pubDate>
            <atom:updated>2022-09-09T14:00:09.900Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/700/0*sjh_Xa2wf6WKYi-y.png" /><figcaption>Source: <a href="https://en.wiktionary.org/wiki/%CE%BC">https://en.wiktionary.org/wiki/%CE%BC</a></figcaption></figure><p>This article is continuation of introduction to <a href="https://medium.com/@daniel.buchta666/%CE%BC-architecture-a91073af147c"><em>μ Architecture</em></a>. This time we will discuss how machine learning can be organically embeded into this kind of data architecture.</p><p>First, let’s repeat the main principle of <em>μ Architecture</em>:</p><blockquote><strong><em>Queries are passive and data are active.</em></strong></blockquote><p>Let’s repeat also <em>μ Architecture</em> definition.</p><blockquote>μ Architecture<em> is recursivelly repeating pattern of self simillar data micro processors consisting of tripplets source connect, processor and sink connect, which we will call data μ-products. These μ products then create mesh. This pattern allows us to spread the complexity of processing across the mesh through distribution and scalability.</em></blockquote><h3><em>μ product/μ neuron</em></h3><p>Zhamak Dehghani demonstrates the data product as the architectural quantum. I will not use this as term quantum will better fit into the next generation of an arhcitecture I call an <em>ω</em><strong><em> </em></strong><em>Architecture</em>.</p><p>Data Mesh principle and <em>μ Architecture</em> as it’s data architecture interpretation are based on idea of neural network. Then, building block rather looks like neuron.</p><p>That’s why I’ll use term <em>μ neuron</em> as a basic building block in <em>μ Architecture.</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*QJLTL-3zwCQK3hgFtgNOtQ.jpeg" /><figcaption><em>Basic building block of μ Architecture is μ product/μ neuron. </em>Source: <a href="https://martinfowler.com/articles/data-mesh-principles.html">https://martinfowler.com/articles/data-mesh-principles.html</a></figcaption></figure><h3>μ Architecture as μ Neural Network consisting of μ neuron</h3><p>One of the main advantages and challenges <em>μ Architecture </em>offers isto represent what now is a consistent from to pipeline as a topological structure that seems like neural network.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*nvyUPnBZ4HzsDLUToVlsQA.jpeg" /><figcaption>Three <em>μ products/μ neuron connected linear way</em></figcaption></figure><p>When looking at the linear way depicted at the diagram above, it looks like nothing really interesting happens. In fact, complexity challenge is the first impression man can have arising in his mind:)</p><p>Let’s look at the scenario, where both users <em>μ neuron </em>and pageviews<em> μ neuron </em>supply the users pageviews <em>μ neuron.</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qc-jUKP9TxlJCbdiTaZI4w.jpeg" /><figcaption>Scenario, where both users <em>μ neuron </em>and pageviews<em> μ neuron </em>supply the users pageviews <em>μ neuron.</em></figcaption></figure><p>Here it starts to make sense. Users Pageviews <em>μ neuron </em>is here to serve as an end point for some services or send information into another <em>μ neuron/s.</em></p><p>In fact, as for any kind of architecture including LEGO:) it’s so reliable as it’s basic building block.</p><p>From the perspective of technology, event data streaming seems to be the best fit for this kind of architecture. It’ due to throughput performance and ability to store/transform information along the stream/s.</p><p>Me, especially, like Apache Kafka ecosystem (but do not hesitate to chose one by your own decision:) where we can find:</p><ul><li>Connectors, both sink and source and topics with storage to interconnect neurons</li><li>Streams API and KSQL to do <em>μ transformations </em>inside<em> μ neuron.</em></li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/692/1*IXG1zcWX8mv7p9dB3R7IXw.jpeg" /><figcaption>Source: <a href="https://itnext.io/is-kafka-a-message-queue-or-a-stream-processing-platform-7decc3cf1cf">https://itnext.io/is-kafka-a-message-queue-or-a-stream-processing-platform-7decc3cf1cf</a></figcaption></figure><p>To have one core technology to materialize <em>μ Architecture</em> seems like the benefit that is worth considering.</p><h3>μ Architecture goes machine learning</h3><p>And what about embeding machine learning into our neural network?</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*EmduFkdlloSMYevdhocHFg.jpeg" /><figcaption><em>μ neuron in the centre uses ML.</em></figcaption></figure><p>Every<strong> <em>μ neuron</em></strong><em> </em>can operate <strong>with or within</strong> <strong>ML model</strong>. It’s because we can repeat the selfsimilar pattern also within the <em>μ neuron</em> itself.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*a1__NA_H8QVCFu1ZY4duRg.jpeg" /><figcaption>Event comes, event goes.</figcaption></figure><p>We want to create diagram depicted above.</p><p>Let’s start this way. We create Flow and derive Feature from it by:</p><ul><li>sending data into antoher topic</li><li>enrich them with other data/metadata</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Hc7JdbPbJZZW9j-6LxAiHg.jpeg" /><figcaption>Feature data flow derived from basic Flow.</figcaption></figure><p>Now, we can add the ML part of the <em>μ neuron. </em>Model+Model Update Topic supplies continuously ML technology both with data to update model and to serve model for output. Serving Layer then serves data back to Flow.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*BbgKYKMDuBhtBzTQj3PeOA.jpeg" /><figcaption>Model+Model Update Topic supplies continuously ML technology both with data to update model and to serve model for output. Serving Layer then serves data back to Flow.</figcaption></figure><p>This kind of architecture is challenging. It combines both flow complexity and performance requirements. The best fit for this is cloud environment. I also recommend considering the use of techniques such as <a href="https://en.wikipedia.org/wiki/Chaos_engineering">chaos engineering</a> not only because I am chaos tehory PhD:). Configuration, Notification, Logging and automation are de facto prerequisities.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qEBFMmuY2yCxI4nUJQgrfg.jpeg" /><figcaption>μ Architecture as μ Neural Network like topology leveraging Machine Learning.</figcaption></figure><p>At the end, when using <em>Reinforcement Learning/Q learning</em>, it seems for me to be <em>la crème de la crème </em>of modern data architecture. Continuity and ability to provide constant feedback makes it what I call Infinite Data Experience.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qzBRszfDSKEe4ItWUylOrw.jpeg" /><figcaption>Infinite Data Experience, ML empowered.</figcaption></figure><p>I want also to turn your attention towards the work of another great people around the modern data architecture.</p><p>First of all big thanks to <a href="https://www.linkedin.com/in/zhamak-dehghani/">Zhamak Dehghani</a> who created a <em>Data mesh </em>as<em> a decentralized sociotechnical approach to share, access, and manage analytical data in complex and large-scale environments.</em></p><p>I also found great inspiration in the article <a href="https://medium.com/agile-lab-engineering/data-mesh-and-monoliths-integration-patterns-78ecf9f4daa1">Data mesh and monoliths integration patterns</a> by <a href="https://medium.com/@ugociraci">Ugo Ciraci</a>.</p><p>Thanks for reading:)</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=fe7e3a8c5d35" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[μ Architecture]]></title>
            <link>https://medium.com/@daniel.buchta666/%CE%BC-architecture-a91073af147c?source=rss-8a3943e6b649------2</link>
            <guid isPermaLink="false">https://medium.com/p/a91073af147c</guid>
            <category><![CDATA[big-data-streaming]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[data-mesh]]></category>
            <category><![CDATA[data]]></category>
            <dc:creator><![CDATA[Daniel Buchta]]></dc:creator>
            <pubDate>Sun, 24 Jul 2022 12:18:37 GMT</pubDate>
            <atom:updated>2022-12-17T12:06:49.986Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/800/1*op2kcr7ofx-Fyo3hK_auGQ.png" /><figcaption>Source: <a href="https://en.wiktionary.org/wiki/%CE%BC">https://en.wiktionary.org/wiki/%CE%BC</a></figcaption></figure><p>Data mesh by Zhamak Dehghani can be seen as new framework for intensive data distribution.</p><blockquote>Data mesh objective is to create a foundation for getting value from analytical data and historical facts at scale — scale being applied to constant change of data landscape, proliferation of both sources of data and consumers, diversity of transformation and processing that use cases require, speed of response to change.</blockquote><blockquote>Zhamak Dehghani, <a href="https://martinfowler.com/articles/data-mesh-principles.html">https://martinfowler.com/articles/data-mesh-principles.html</a></blockquote><p>As by the definition</p><blockquote>Data mesh is a decentralized sociotechnical approach to share, access, and manage analytical data in complex and large-scale environments — within or across organizations.</blockquote><blockquote>Zhamak Dehghani, Data Mesh</blockquote><p>In the end of the day, it has to be valued by proper data architecture pattern.<br>We saw the rise of lambda architecture and kappa architecture during big data period.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/668/1*JOh-W21PMepOsByBkzHTJw.jpeg" /><figcaption>Source: <a href="https://isdanni.com/streaming-system/">https://isdanni.com/streaming-system/</a></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/590/1*NB-AafQMMbLumvaNmLy4sg.jpeg" /><figcaption>Source: <a href="https://isdanni.com/streaming-system/">https://isdanni.com/streaming-system/</a></figcaption></figure><p>Both lambda architecture and kappa architecture were oriented to deliver continuous near realtime pipelines. By that I mean to create data tubes to transport dat from source point to destination where value is derived.</p><p>I think there’s time to come with new architecture to catalyse data mesh principles.<br>Let’s call it μ architecture.<br>It has one and only one main proposition:</p><blockquote><strong>Queries are passive and data are active.</strong></blockquote><blockquote>μ Architecture</blockquote><p>This idea is not new as for example data streaming uses it as a paradigm.</p><blockquote>In a traditional database, the data sits passively and waits for an application or person to issue queries that are responded to. In stream processing, this is inverted: the data is a continuous, active stream of events, fed to passive queries that simply react and process that stream.</blockquote><blockquote>Jay Kreps, <a href="https://www.confluent.io/blog/every-company-is-becoming-software/">https://www.confluent.io/blog/every-company-is-becoming-software/</a></blockquote><p>Let’s find out what does it mean. Till now, the query is the value bringer. You have the data store and your main goal is to write query that fits for your app/API. In fact, it doesn’t bother us whether the all data are there neither what value they have.</p><p>This status quo is quite natural because till now, typical enterprise data architecture consists of set of data producing apps with their local data models/data stores and some DWH relative centralized storage. Local data model are here mainly to serve OLTP processes, eg. keep apps going. DWH relative storage is the only source of truth, eg. there isn’t anything else against which this can be validated.</p><p>Then, the only thing we are going to achieve most the time is to write query the way it returns result that is expected by it’s user. And that user is typically our colleague.</p><p>Moreover, as DWH like storages are used often for long term aggregations like for example How many customers bought our product during last 3 months, there’s no place for thinking about some dynamics.</p><p>Nowadays, two facts arise, that are changing our perspective:</p><ul><li>Standard data user model shifts from enterprise employee, trained to work with data the way enterprise wants him, to enterprise customer, who is neither trained nor paid to do so. In fact, he pays for having smooth and meaningful user experience:)</li><li>Technology stack as data streaming, cloud computing, serverless etc. enables us to let our data continuously flow to be almost everywhere at almost the same time:)</li></ul><p>So there is time to concentrate on data as a dynamic fluid to expose rather than static object to analyze.</p><p>It means that essential is to have data in motion.<br>This leads to classical Data Dichotomy as described by great Ben Stopford <a href="https://www.confluent.io/blog/data-dichotomy-rethinking-the-way-we-treat-data-and-services/">https://www.confluent.io/blog/data-dichotomy-rethinking-the-way-we-treat-data-and-services/</a>:</p><blockquote>Data systems are about exposing data. Services are about hiding it.</blockquote><blockquote>Ben Stopford</blockquote><h3>Transitive vs. distributive data.</h3><p>Transitivity is about data travelling in the time of querying. Almost all of nowadays queries with complexity beyond simple querying of transaction that just happened within the app that queries struggle with two things:<br>1. Some of the data are transfered from the remote source as a part of query. This is typical for integration platforms like ESB.<br>2. Some of the data are “on the road” in the time when query is executed. Your query just runs over database that does not have the moat valuable data. This is typical for DWH.<br>These two pain points leads us to the next chapter:</p><h3>Linear data processing vs. data everywhere topology</h3><p>By linear data processing we mean what is typically represented by pipeline. It’s the prevailing pattern based on transportation of data from the point A to point B. Moreover, most the time both A and B are terminal states in terms of that A is the data origin place and B is the place where value is produced.</p><p>This pattern leads to typical architecture of N data systems connected via full N*(N-1) pipelines.</p><p>The problems of this way are well known:</p><ul><li>Interconnection of all systems the each other leads towards enormous amount of change management and adding new one is always great thing.</li><li>Collaboration between teams/systems is possible in quartal level at best as nobody can create new pipeline in less the 3 months time.</li></ul><p>There was the SOA approach based on ESB. But the Common Data Model concept was the fail as it just added another complexity.</p><p>The Data Mesh principle, at the other hand, opens the way to post/consume from the point in data topology that fits the use case best. It embraces collaboration because the finding best fit point in topology is much more simple as creating new pipeline. Interconnection of the systems is not so bully straightforward like when traditional pipeline one. This allows us to think in terms of data everywhere especially when using technologies like data streaming with it’s continuous processing.</p><h3>Real-time use cases vs. Continuous processing</h3><p>Talking with the people that can profit from data, especially in case of data streaming usage, they often tell, that they don’t actually need to solve use cases in real-time.</p><p>What I think is necessary to let them know, is that current technology stack allows us to continuosly process the data.</p><p>By this we mean, that data are not processed in separated time windows(typical example are night hours for DWH).</p><p>This allows us to:</p><ul><li>less complex processing as we don’t need so much complexity to glue this time windows together</li><li>less computing power as we are processing fewer amounts of data</li><li>more accurate results both in time and data quality as discrepancies caused by time delays are minimized</li></ul><h3><em>∞*∞=∞</em></h3><p>For big data, especially in cloud, we can consider infinite storage. Then, theoretically for now, we can consider also infinite many data sources. This can be explained by little bit courageous sentence</p><blockquote>Every query deserves its own database.</blockquote><h3>Data uncertainty principle</h3><p>When we operate with data, we are tackling same problem as with Heisenberg uncertainty principle. Data have their position given by Volume <strong>V</strong> and their momentum represented by value <strong>𝜈</strong>. Volume and value can’t be measured without affecting each other. So there is place to state uncertainty between this two values</p><p><strong>ΔV*Δ𝜈≥V/2f</strong></p><p>where f is frequency of adding new amount of data. This represents the statement:</p><blockquote>Extracting of data value and data volume from a system containing data affect each other with uncertainty that can be denominated by product of V/2 representing number of operations to find some information within the data volume V and 1/f as inverted frequency of changes representing how old are the latest data in the system.</blockquote><p>Disclaimer №1: The term data value is not well defined. It will be the part of the next work uppon this concept.</p><p>Disclaimer №2: Please note that for quantum computer using Grover’s algorithm, there will be <strong>V/2 </strong>replaced by <strong>√V.</strong></p><h3><strong>Queries are passive and data are active.</strong></h3><p>To explain the idea of μ Architecture, let’s start with this picture by Zhamak Dehghani.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*vUEF-RQN5lSMXFQmMTqq2g.png" /><figcaption>Credit goes to Zhamak Dehghani, Source: <a href="https://martinfowler.com/articles/data-monolith-to-mesh.html#DataAndSelf-servePlatformDesignConvergence">https://martinfowler.com/articles/data-monolith-to-mesh.html#DataAndSelf-servePlatformDesignConvergence</a></figcaption></figure><p>Let’s continue with basic neuron structure.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/1*cnvYHe71F8pD4DAlVAc7WA.jpeg" /><figcaption>Source: <a href="https://en.wikipedia.org/wiki/Neuron">https://en.wikipedia.org/wiki/Neuron</a></figcaption></figure><p>Let’s compare this for example with modern streaming technology like Apache Kafka.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*hRvP8YFDZxyGmIQylgT9Bw.png" /><figcaption>Source: <a href="https://medium.com/@navdeepsharma/the-ecosystem-of-apache-kafka-6087b621d16f">https://medium.com/@navdeepsharma/the-ecosystem-of-apache-kafka-6087b621d16f</a></figcaption></figure><p>All 3 diagrams are about the same pattern consisting of tripplet get,transform, serve. This, btw. is generic pattern also for ETL, ESB etc. What is new thanks to nowadays technology stack here is ability to make a mesh consisting of many of these tripplets operating distributive way continuously near real-time.</p><p>Then, complexity of query is spanned into lot of μ-queries representedfor example in Kafka ecosystem by Kafka Streams/KSQL. These flow of queries serve as percolators of continuous data flow making data active. We can imagine it’s similar to hydroelectric power plant system or neural network.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/1*-swu6lruzh3dtwaSx9tG_g.jpeg" /><figcaption>Source: <a href="https://www.asb.sk/stavebnictvo/inzinierske-stavby/vodohospodarske-stavby/ako-sa-planuje-prevadzka-vodnych-elektrarni-na-slovensku">https://www.asb.sk/stavebnictvo/inzinierske-stavby/vodohospodarske-stavby/ako-sa-planuje-prevadzka-vodnych-elektrarni-na-slovensku</a></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*nvp-KQdjCC7GTwYWPmFFTw.png" /><figcaption>Credit: <a href="https://denisezannino.wordpress.com/2014/09/30/neural-circuitry/">https://denisezannino.wordpress.com/2014/09/30/neural-circuitry/</a></figcaption></figure><p>In this kind of architecture data are active part that sulphurize the signal through the mesh.</p><h3>μ Architecture definition</h3><blockquote>μ Architecture is recursivelly repeating pattern of self simillar data micro processors consisting of tripplets source connect, processor and sink connect, which we will call data μ-products. These μ-products then create mesh. Data flow through this mesh while being transformed along the streams. This pattern allows us to spread the complexity of processing across the mesh through distribution and scalability.</blockquote><p>Principial difference with Data Quantum from Data Mesh principle and μ-product lies the range of both as μ-product is much smaller, has given simple structure. Thus, Data Quantum consists of mesh of μ-products. Moreover, this mesh does not need to be compact neither continuous. It can consist of one or more separate parts.</p><p>Let’s return to <em>Queries are passive and data are active</em>. Tripplets that μ-products are created of, have processor, where change of information happens. These processors are now in passive position as their change is no more acceptable in arbitrary manner as they are part of complex mesh structure.</p><blockquote>It can scarcely be denied that the supreme goal of all theory is to make the irreducible basic elements as simple and as few as possible without having to surrender the adequate representation of a single datum of experience.</blockquote><blockquote>Albert Einstein</blockquote><p>But the changes are inevitable:) The trivial change, where the output is not changed the way that affects depending μ-products, doesn’t require complex action. When the non-trivial change of query is needed, we use pattern of building parallel μ-product and resolve all affected μ-products.</p><p>This seems to be main tradeoff against the dynamic macro-queries as it looks like there will be many little changes needed to provide.</p><p>Fair statement is that it’s absolutely valid point of view.</p><p>From my point of view based on practical experience this can be set to minimum by applying four principles of Data Mesh:</p><ul><li>Domain Ownership</li><li>Data as a product</li><li>Self-serve data platform</li><li>Federated computational governance</li></ul><p>In fact, Data Mesh is the foundation/enabler to make next step on the way from ETL through λ and <strong>ϰ </strong>Architecture towards μ Architecture.</p><h3>Multi Technology Stack vs. One Technology Rules Them All</h3><p>The idea of μ-product, once adopted, leads to initiatives of removing friction based on technological heterogenity of single μ-products. Here, the solution is to build at least core mesh in one technology. To be honest, data streaming solutions as Apache Kafka are the best fit for this for now.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/824/1*MhtFS2IZ2OVoVBBfYfme8Q.jpeg" /><figcaption>Creating simple stream of user and his pageviews</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/641/1*H6ZIL1AlRECIShN7ANJCyA.png" /><figcaption>Flow consisting of two microproducts, USER_PAGEVIEWS and USER_PAGEVIEWS_MU_PRODUCT. <a href="https://zz85.github.io/kafka-streams-viz/">https://zz85.github.io/kafka-streams-viz/</a>.</figcaption></figure><p>Let’s note that in this kind of architecture, you can reuse components as USERS_PAGEVIEWS. One of my friends told that this approach is similar to cascading subselects to create views in the SQL DWH .</p><pre><em>-- use t_pageviews table</em><br><strong>WITH</strong> t1 <strong>AS</strong> (<br>	<strong>SELECT</strong> tp.*<br>	<strong>FROM</strong> t_pageviews tp <br>        <strong>WHERE</strong> tp.is_deleted <strong>!=</strong> &#39;<strong>True&#39;<br></strong>),<br><br><em>-- Add t_users</em><br>t2 <strong>AS</strong> (<br>	<strong>SELECT</strong> t1.*, tu.*<br>	<strong>FROM</strong> t1<br>	<strong>JOIN</strong> t_users tu<br>	<strong>ON</strong> t1.user_Id <strong>=</strong> tu.Id <br>        <strong>WHERE</strong> t1.is_active <strong>=</strong> &#39;<strong>True&#39;</strong><br>),<br><br><em>-- Apply some rule, for example Location column</em><br>t3 <strong>AS</strong> (<br>	<strong>SELECT</strong> t2.*<br>	<strong>CASE</strong> <strong>WHEN</strong> tr.<strong>Location</strong> <strong>=</strong> &quot;US&quot; <strong>THEN</strong> &quot;USA add&quot;<br>		<strong>WHEN</strong> tr.<strong>Location</strong> <strong>=</strong> &quot;Slovakia&quot; <strong>THEN</strong> &quot;Slovakia add&quot;<br>		<strong>WHEN</strong> tr.<strong>Location</strong> <strong>=</strong> &quot;Sao Paulo&quot; <strong>THEN</strong> &quot;Brazil add&quot;<br>		<strong>ELSE</strong> null<br>		<strong>END</strong> <strong>AS</strong> &quot;Location rule&quot;<br>	<strong>FROM</strong> t2<br>        <strong>JOIN</strong> t_rules tr<br>	<strong>ON</strong> t2.rule_type_Id <strong>=</strong> tr.Id <br>        <strong>WHERE</strong> tr.is_valid <strong>=</strong> &#39;<strong>True&#39;</strong><br>)<br><br><em>-- filter row that are relevant</em><br>t4 <strong>as</strong> (<br>	<strong>SELECT</strong> t3.* <br>	<strong>FROM</strong> t3<br>	<strong>WHERE</strong> is_relevant <strong>=</strong> &#39;<strong>True&#39;</strong><br>)<br><br><em>-- create view for Data Warehouse</em><br><strong>CREATE</strong> <strong>VIEW</strong> vw_product <strong>AS</strong><br>	<strong>SELECT</strong> <strong>*</strong><br>	<strong>FROM</strong> t4</pre><p>Then, queries on the diagram above JOIN:PWT+UT and KSQL-RULE respectively are passive in terms of they are quite simple and they sit within the structure. The streams of new data are the active part in this architecture.</p><h3>Create products don’t slice them</h3><p>As Lars Rönnbäck states in his famous The Slayers of Layers (<a href="https://www.linkedin.com/pulse/slayers-layers-lars-r%C3%B6nnb%C3%A4ck/">https://www.linkedin.com/pulse/slayers-layers-lars-r%C3%B6nnb%C3%A4ck/</a>)</p><blockquote>It is time to rethink the layer. When you see a layer, act with suspicion and question its existence. If nothing else, think about the costs involved having to maintain every additional layer. Above all, we need to go back to the root of the problem and create tech that needs few or no layers to be acceptable.</blockquote><p>μ Architecture as the architecture representation derived upon Data Mesh by Zhamak Dehghani is here to stop us from slicing architecture into layers.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*iNErRv_8WF6KtO9egRBgHQ.jpeg" /><figcaption>Credit: https://www.freepik.com/free-vector/soccer-ball-grass-background_2875611.htm and <a href="https://martinfowler.com/articles/data-mesh-principles.html">https://martinfowler.com/articles/data-mesh-principles.html</a></figcaption></figure><p>Now we can create products as topology representation consisting of data products.</p><p>This opens completely new perspective regarding time to market and comes with the first real data-driven approach.</p><p>If you are CEO or product manager, ask your architect whether it’s still the best approach to slice your product by technology or logical parts. Have a fair talk about whether you have to wait while your product will be sliced into stripes, then packed into roadmap and delivered in about year.</p><p>The main power given us by <a href="https://www.linkedin.com/feed/#">Zhamak Dehghani</a> through Data Mesh is to deliberate us to create products meaningful way.</p><h3>Conclusion</h3><p>In this article, new data architecture pattern is presented. I call it μ Architecture and it has one main principle:</p><blockquote><strong>Queries are passive and data are active.</strong></blockquote><p>It has this definition.</p><blockquote>μ Architecture is recursivelly repeating pattern of self simillar data micro processors consisting of tripplets source connect, processor and sink connect, which we will call data μ-products. These μ-products then create mesh. This pattern allows us to spread the complexity of processing across the mesh through distribution and scalability.</blockquote><p>It’s foundation is Data Mesh by Zhamak Dehghani as both enabler and sociotechnical framework. The second enabler is application of Data As a Product in terms of repeating self similar μ-products organized to create mesh.</p><p>Thanks for reading:)</p><p>Story of μ Architecture continues:</p><p><a href="https://medium.com/p/fe7e3a8c5d35">μ Architecture goes machine learning</a></p><p><a href="https://medium.com/p/d9771f8da0ee">μ Architecture offers Next Best Offer</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a91073af147c" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[The story about a father and his son.]]></title>
            <link>https://medium.com/@daniel.buchta666/the-story-about-a-father-and-his-son-fc5e02e6bb3f?source=rss-8a3943e6b649------2</link>
            <guid isPermaLink="false">https://medium.com/p/fc5e02e6bb3f</guid>
            <dc:creator><![CDATA[Daniel Buchta]]></dc:creator>
            <pubDate>Wed, 02 Oct 2019 04:03:40 GMT</pubDate>
            <atom:updated>2019-10-02T05:15:24.127Z</atom:updated>
            <content:encoded><![CDATA[<p>Son was often blowing up at every little thing.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*68gwCinB3syUBBdKAFbAZQ.jpeg" /><figcaption><a href="https://www.pexels.com/photo/brown-hammer-near-silver-nail-162644/">https://www.pexels.com/photo/brown-hammer-near-silver-nail-162644/</a></figcaption></figure><p>One time, father came to him and told him this: ”My son. Next time you will want to start yelling, please instead of it take a hammer and nails, go to our rail fence and drive some nails into it.”</p><p>Son did as a father wanted him. After some time all the fence was full of nails and there was no place for others.</p><p>“Now my son, when you will rage about something, pull out some of these nails.”</p><p>After some time son came to father: “Father, I pulled out all the nails.”</p><p>“So let’s take a look at the fence.”</p><p>“Hmmm. It’s full of holes… We will need a new one.”</p><p>Even when I do everything to make things right again, that holes remain at the end. I don’t know how to avoid a rage as without it tension in a relationship becomes intolerable.</p><p>Do you have any idea?</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=fc5e02e6bb3f" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Three types of people]]></title>
            <link>https://medium.com/@daniel.buchta666/three-types-of-people-b9cb9ec20f89?source=rss-8a3943e6b649------2</link>
            <guid isPermaLink="false">https://medium.com/p/b9cb9ec20f89</guid>
            <dc:creator><![CDATA[Daniel Buchta]]></dc:creator>
            <pubDate>Sun, 08 Sep 2019 09:26:32 GMT</pubDate>
            <atom:updated>2019-09-08T09:32:35.473Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*xfp-IASrywQlhDTvwEhRZQ.jpeg" /></figure><p>Photo by <a href="https://unsplash.com/@aarontorres">Aaron Torres</a> on <a href="https://unsplash.com/">Unsplash</a></p><p>During my life, I saw many people. I have created categories for people to take an orientation in relationships with them.</p><p>When it comes to some domain of my life, for example, job satisfaction, parenting, marital relations, I see three types of people again and again.</p><ul><li>The lucky ones</li><li>The brave ones</li><li>The broken ones</li></ul><p>I see myself as a member of one of these categories as well when it comes to some problematic.</p><h4>The lucky 🍀 ones</h4><p>People in this category have a domain of interest under control. For example, they have stable job relationships or they are ordered couple with their partner.</p><p>I like to talk to these people or read their articles because they share stories from their life. They don’t talk big. Their stories are real and I call them lucky ones because those stories have meaningful continuity.</p><p>It’s refreshing for me to hear somebody talk about a weekend family trip or succesful project deployment. He often talks about how it was hard, what he had to overcome. His story often finishes like this: ”I’ll tell you man. It was hard but next week we will do this again.”</p><h4>The brave ones</h4><p>These people are losing their control/orientation. They often talk about the problems they face and about impacts these problems have to their life. I know that I see/am a man of this category when they talk about repetitiveness of their problem. You know this talk: “My boss made this again…”, “Again, me and my wife…”</p><p>People(most of us) from this category are no more able to handle the situation without the help of other people. They are desperately seeking someone to tell them what to do immediately.</p><p>Then, the third category often comes…</p><h4>The broken ones</h4><p>These people start to advise on immediately. Their articles title often look like: “Three things you have to do to…”</p><p>I can recognise this sort of people easy as they don’t talk about themselves or if they do, they talk big about their success.</p><p>In fact, I see broken people. They struggle with their own life the way that only thing that can make them feel useful is to advise about other people lives.</p><p>Thus, when I start to talk to somebody what he has to do, I soon talk to myself: “Ups. I’m deep in sh*t.”</p><p>Most of the time when I am in the second category looking for help, I am an easy target for the third category.</p><p>Then I easy find myself trying to do “easy” things somebody told me to do with imperative in his mouth.</p><p>What I know is good for me is to find some lucky 🍀 one who will tell me some of the bittersweet stories finishing: “…”I’ll tell you man. It was hard but next week we will do this again.” or somebody brave to share our troubles.</p><p>I hope reading this article didn’t help you anyway because if yes then I am deep in sh*t😉</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=b9cb9ec20f89" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>