BIG DATA | Database and Architecture : <p>First of the all I want to say:
I checked the similar posts in internet, and I saw similar question on stack overflow like:</p>

<ul>
<li><p><a href="https://dba.stackexchange.com/questions/188667/best-database-and-table-design-for-billions-of-rows-of-data">https://dba.stackexchange.com/questions/188667/best-database-and-table-design-for-billions-of-rows-of-data</a></p>

<p><a href="https://stackoverflow.com/questions/2794736/best-data-store-for-billions-of-rows">Best data store for billions of rows</a></p>

<p><a href="https://stackoverflow.com/questions/9815234/how-to-store-7-3-billion-rows-of-market-data-optimized-to-be-read">How to store 7.3 billion rows of market data (optimized to be read)?</a></p></li>
</ul>

<p>But I want to open my question for double check.</p>

<p>So...I on the start to write my [BIG PROJECT] and right now I'm write all documentations etc...</p>

<p>While check the "things" I see that in 1 of my general USE CASES of application  I will need handle...</p>

<p><strong>[!!!ATTENTIONS!!!]</strong> About BILLIONS Requests per DAY!</p>

<p>Yep. Billions per day!</p>

<p>I cannot say what is this requests and etc, but I can say:</p>

<p>1) The data inside request is has pretty good structure
2) I will need work with this data a lot. I mean many-many queries to this data.</p>

<p>Today I did fast test for calculate in <em>MS SQL Server 2017 (14.0.100)</em>:</p>

<p><strong><em>50M of this records = 10GB</em></strong></p>

<p>===> <strong>1B ==> 200GB</strong></p>

<p>So <strong>200GB</strong> is <strong><em>DAILY</em></strong> SIZE!!!</p>

<p><strong>200Gb</strong> * 30 = <strong>6TB</strong> - <strong>Monthly</strong></p>

<p><strong>6TB</strong> * 12 ===> <strong>72TB</strong> - <strong><em>1 Year size</em></strong></p>

<p>And Queries (Store procedure) not was so fast.</p>

<p>Because I'm only on the Documentation, Technical Design step..I want to take time and check the best way to handle this data.</p>

<p>If I look in 1-3-5 year forward...</p>

<p>(Don't want after 2 years start change how migrate data etc..)</p>

<hr>

<p>The second question is <strong>Architecture</strong>...</p>

<p>This Big data flow very similar to <strong><em>Google Analytics</em></strong>.
But I have send ID of request in response .</p>

<p>I'm in generally <strong>.NET DEVELOPER</strong> and will develop this project on  <strong>.NET CORE and Microservices architecture</strong></p>

<p>And now I see big power in <strong><em>.NET CORE under linux, ngnix</em></strong> etc...</p>

<p>So my Question is :
What is <strong>best practices/ architecture template</strong> to write this microservice.
How <strong><em>Google analytics</em></strong> handle this <em>millions</em> and <em>billions</em> requests per <strong>day</strong>.</p>

<p>I check about DB of Google analytics - this is <strong>BigTable</strong>.</p>

<p>The best alternative I found is: <strong>HBase</strong></p>

<p>If the <strong>HBase</strong> is my <strong><em>HERO</em></strong>??</p>

<hr>

<p>And 1 more question is:</p>

<p>What is the best choice:</p>

<ul>
<li>Use cloud database solution (like in AWS EMR/Dynamo/etc..) </li>
<li>Launch EC2 instanse and run own database on this instance</li>
</ul>

<p>Thank you guys for help, and sorry for my English grammar.</p>
