From 8e691b56817e4b5f24f2811fe7215239f38db7d8 Mon Sep 17 00:00:00 2001 From: bregman-arie Date: Sat, 25 Mar 2023 17:41:32 +0000 Subject: [PATCH] Update README index --- README.md | 318 ++++--------------- images/logos/grafana.png | Bin 0 -> 8955 bytes images/{monitoring.png => observability.png} | Bin topics/databases/README.md | 191 +++++++++++ topics/observability/README.md | 88 +++++ 5 files changed, 336 insertions(+), 261 deletions(-) create mode 100644 images/logos/grafana.png rename images/{monitoring.png => observability.png} (100%) create mode 100644 topics/databases/README.md create mode 100644 topics/observability/README.md diff --git a/README.md b/README.md index 4c47d28..378cae8 100644 --- a/README.md +++ b/README.md @@ -2,7 +2,7 @@ :information_source:  This repo contains questions and exercises on various technical topics, sometimes related to DevOps and SRE -:bar_chart:  There are currently **2621** exercises and questions +:bar_chart:  There are currently **2624** exercises and questions :warning:  You can use these for preparing for an interview but most of the questions and exercises don't represent an actual interview. Please read [FAQ page](faq.md) for more details @@ -18,74 +18,82 @@
- - - - + + - - + + + - + - - - - - - - - - - - - - - - - - - - - - + - - + - - - - - + + + + + + - + + + + + + + + + + + + + + + + + + + + + + + + + + + - - - - - + + + + + - - - - - - + + + + + + + - + + +
DevOps
DevOps		cicd
CI/CD		Git
Git		ansible
Ansible		DevOps
DevOps		Git
Git		 Network
Network		Hardware
Hardware		kubernetes
Kubernetes
programming
Software Development		programming
Software Development		 Python
Python		 go
Go		Bash
Shell Scripting		kubernetes
Kubernetes
Cloud
Cloud		aws
AWS		azure
Azure		Google Cloud Platform
Google Cloud Platform		openstack
OpenStack
Operating System
Operating System		Monitoring
Monitoring		Elastic
Elastic		Virtualization
Virtualization		DNS
DNS
Testing
Testing		Databases
Databases		perl
Perl		 RegEx
Regex		Design
System Design		Hardware
Hardware
Certificates
Certificates		Containers
Containers		sql
SQL		OpenShift
OpenShift		Storage
Storage		Cloud
Cloud		aws
AWS		azure
Azure		Google Cloud Platform
Google Cloud Platform		openstack
OpenStack
Terraform
Terraform		Operating System
Operating System		Linux
Linux		Virtualization
Virtualization		DNS
DNS		Bash
Shell Scripting
Databases
Databases		sql
SQL		 Mongo
Mongo		Testing
Testing		Big Data
Big Data
cicd
CI/CD		Certificates
Certificates		Containers
Containers		OpenShift
OpenShift		Storage
Storage
Terraform
Terraform		 puppet
Puppet		 Distributed
Distributed		 you
Questions you can ask		ansible
Ansible
Circle CI
Circle CI		Argo
Argo		Kafka
Kafka		DataDog
perl
Perl		observability
Observability		Prometheus
Prometheus		Circle CI
Circle CI		DataDog
Grafana
Grafana
Linux
Linux		Prometheus
Prometheus		Big Data
Big Data		HR
Soft Skills		security
Security
Argo
Argo		HR
Soft Skills		security
Security		Design
System Design
Chaos Engineering
Chaos Engineering		Chaos Engineering
Chaos Engineering		 Misc
Misc		Elastic
Elastic		Kafka
Kafka
@@ -868,60 +876,6 @@ The introduction of virtual machines allowed companies to deploy multiple busine Do we need virtual machines in the age of containers? Are they still relevant?
-## Monitoring - -
-Explain monitoring. What is it? What its goal?
- -Google: "Monitoring is one of the primary means by which service owners keep track of a system’s health and availability". -
- -
-What is wrong with the old approach of watching for a specific value and trigger an email/phone alert while value is exceeded?
- -This approach require from a human to always check why the value exceeded and how to handle it while today, it is more effective to notify people only when they need to take an actual action. -If the issue doesn't require any human intervention, then the problem can be fixed by some processes running in the relevant environment. -
- -
-What types of monitoring outputs are you familiar with and/or used in the past?
- -Alerts
-Tickets
-Logging
-
- -
-What is the difference between infrastructure monitoring and application monitoring? (methods, tools, ...)
-
- -### Application Performance Management - -
-What is Application Performance Management?
- -- IT metrics translated into business insights -- Practices for monitoring applications insights so we can improve performances, reduce issues and improve overall user experience -
- -
-Name three aspects of a project you can monitor with APM (e.g. backend)
- -- Frontend -- Backend -- Infra -- ... -
- -
-What can be collected/monitored to perform APM monitoring?
- -- Metrics -- Logs -- Events - Traces -
- ## Prometheus
@@ -3122,164 +3076,6 @@ Not only this will tell you what is expected from you, it will also provide big
-## Databases - -|Name|Topic|Objective & Instructions|Solution|Comments| -|--------|--------|------|----|----| -| Message Board Tables | Relational DB Tables | [Exercise](topics/databases/table_for_message_board_system.md) | [Solution](topics/databases/solutions/table_for_message_board_system.md) - -
-What is a relational database?
- - * Data Storage: system to store data in tables - * SQL: programming language to manage relational databases - * Data Definition Language: a standard syntax to create, alter and delete tables -
- -
-What does it mean when a database is ACID compliant?
- -ACID stands for Atomicity, Consistency, Isolation, Durability. In order to be ACID compliant, the database must meet each of the four criteria - -**Atomicity** - When a change occurs to the database, it should either succeed or fail as a whole. - -For example, if you were to update a table, the update should completely execute. If it only partially executes, the -update is considered failed as a whole, and will not go through - the DB will revert back to it's original -state before the update occurred. It should also be mentioned that Atomicity ensures that each -transaction is completed as it's own stand alone "unit" - if any part fails, the whole statement fails. - -**Consistency** - any change made to the database should bring it from one valid state into the next. - -For example, if you make a change to the DB, it shouldn't corrupt it. Consistency is upheld by checks and constraints that -are pre-defined in the DB. For example, if you tried to change a value from a string to an int when the column -should be of datatype string, a consistent DB would not allow this transaction to go through, and the action would -not be executed - -**Isolation** - this ensures that a database will never be seen "mid-update" - as multiple transactions are running at -the same time, it should still leave the DB in the same state as if the transactions were being run sequentially. - -For example, let's say that 20 other people were making changes to the database at the same time. At the -time you executed your query, 15 of the 20 changes had gone through, but 5 were still in progress. You should -only see the 15 changes that had completed - you wouldn't see the database mid-update as the change goes through. - -**Durability** - Once a change is committed, it will remain committed regardless of what happens -(power failure, system crash, etc.). This means that all completed transactions -must be recorded in non-volatile memory. - -Note that SQL is by nature ACID compliant. Certain NoSQL DB's can be ACID compliant depending on -how they operate, but as a general rule of thumb, NoSQL DB's are not considered ACID compliant -
- -
-What is sharding?
- -Sharding is a horizontal partitioning. - -Are you able to explain what is it good for? -
- -
-You find out your database became a bottleneck and users experience issues accessing data. How can you deal with such situation?
- -Not much information provided as to why it became a bottleneck and what is current architecture, so one general approach could be
-to reduce the load on your database by moving frequently-accessed data to in-memory structure. -
- -
-What is a connection pool?
- -Connection Pool is a cache of database connections and the reason it's used is to avoid an overhead of establishing a connection for every query done to a database. -
- -
-What is a connection leak?
- -A connection leak is a situation where database connection isn't closed after being created and is no longer needed. -
- -
-What is Table Lock?
-
- -
-Your database performs slowly than usual. More specifically, your queries are taking a lot of time. What would you do?
- -* Query for running queries and cancel the irrelevant queries -* Check for connection leaks (query for running connections and include their IP) -* Check for table locks and kill irrelevant locking sessions -
- -
-What is a Data Warehouse?
- -"A data warehouse is a subject-oriented, integrated, time-variant and non-volatile collection of data in support of organisation's decision-making process" -
- -
-Explain what is a time-series database
-
- -
-What is OLTP (Online transaction processing)?
-
- -
-What is OLAP (Online Analytical Processing)?
-
- -
-What is an index in a database?
- -A database index is a data structure that improves the speed of operations in a table. Indexes can be created using one or more columns, providing the basis for both rapid random lookups and efficient ordering of access to records. -
- -
-What data types are there in relational databases?
-
- -
-Explain Normalization
- -Data that is used multiple times in a database should be stored once and referenced with a foreign key.
-This has the clear benefit of ease of maintenance where you need to change a value only in a single place to change it everywhere. -
- -
-Explain Primary Key and Foreign Key
- -Primary Key: each row in every table should a unique identifier that represents the row.
-Foreign Key: a reference to another table's primary key. This allows you to join table together to retrieve all the information you need without duplicating data. -
- -
-What types of data tables have you used?
- - * Primary data table: main data you care about - * Details table: includes a foreign key and has one to many relationship - * Lookup values table: can be one table per lookup or a table containing all the lookups and has one to many relationship - * Multi reference table -
- -
-What is ORM? What benefits it provides in regards to relational databases usage?
- -[Wikipedia](https://en.wikipedia.org/wiki/Object%E2%80%93relational_mapping): "is a programming technique for converting data between incompatible type systems using object-oriented programming languages" - -In regards to the relational databases: - - * Database as code - * Database abstraction - * Encapsulates SQL complexity - * Enables code review process - * Enables usage as a native OOP structure -
- -
-What is DDL?
- -[Wikipedia](https://en.wikipedia.org/wiki/Data_definition_language): "In the context of SQL, data definition or data description language (DDL) is a syntax for creating and modifying database objects such as tables, indices, and users." -
- ## Regex Given a text file, perform the following exercises diff --git a/images/logos/grafana.png b/images/logos/grafana.png new file mode 100644 index 0000000000000000000000000000000000000000..b0cd0621507c12529bbbb862a4a0f6f81ba9e315 GIT binary patch literal 8955 zcmXw91xy^@*M-6&i@Uo^ix)5M?(SNoxJzMicc;MO4uwLYK#MF;q(Jdf+@-)`yUSAf z@9#^#0-2zK(|W3=IbZg;0Vr0@2Vg z(Db#9RZwBCJ^G3>;Gpc;xf8>s9V^t58@0|YseYL=UD>iU z#XDT6CD%Y7{vVy|Kg5a)YR!3V#d()O1-0P1^Z@gLH{dlNC_c07NR$RCKEVus5_epdp)2=0 z!n^VBd|6@n)TpAcY?_BuIz%HWiiI+OQoeCxM}^2y)O@&Lxzw;`Vif)a!AB`0nn~}Y z7@r_`umWmS#fM}%cqt{KgBbY*|Hg&=v6U2FMtL90fC6v*SP-owa4t@aZcMYJ)m!?#FIoL>uX2 z9}#kZ5c!1wmPdnVB75v1zH#Mv$fCXVWV`iYg;!Ic)Zi7As1teYB!LxD-^VfBxU=6! zGv0c$!Ahv^6Y1|lnNe2%bC^yCE2h4SWI|2#A%zZA9Z^pXuOo+-QzC~5QNx5+QQW>} zzl&gkl~FyU(LE&7-vzMT$1p;zxgN4<5iMl5eymTEc=rhmH};%QtTxQ~JO8h|$6cUdp#K&8IKt(ExofQUJxS_j(j%@%!; zev10vx~e>_BGC<2mb82+v+#|bE1Gh&bmG4QGm7L*B-Nl>HF}PP4+x%-B!5Wp9150{ z&8#~Ti5#u=N~nd=R|@ltbJyuby2w0Zr5m4E3w@^i!Xw$|Cg!U$!Htd(aaf~UWSPzb z<7;jfR+ZjZYwd9WYXY@VDMrpPsnNhQl5L>KItGdLupox+IO7Nn-E6!8U;e_qnCpjA zbP}`V5*?(xau4L~LU1q3v&=C17@XI>qt@&A$;p|;OQp8mtWvvF`Bq+N84l4#%pe1L z{$UMl)vCj}a3m(XY@75$_VxDttT{&o>8ADIj4`dED%#ci4QbA`z5n*pmil^?O*i-&$7+Zdk zw3F?)MT=D5>!MnOe`TWN8bnC0ex?%L1$X>8Wc{L@!7hr~uB{X3+E;#_y{6V#X2n_4 z^;cT46=?TUgQ~0a(wdB^5AD%0wqPTE;C|$iqo~0yZ;9rMK)Cr(-T>|J&-A*nn*_G( zw*)e+lZUk2(9#MC1YxPCzvr=z#H!l?;RBW30^>o%oP4x_8VuKSGBXKXMz{+awJZbY zYrdiejI@nmZwgsE(Z0;K|EvIp9yAmEqxEhg<6;;SF_3qXj``wBnc=Uk!oVn*>M=w= ztoKeY^UNFE^I;wU%t$~-)7JUTbQ#KM6p6>tspIJ3tgEnt_vre3xjM=wN0oo}_?V?s zDc^F9B4p$q=A<({RUN?~MRX*8IYxz77s^7*p&yb?kj+p@~-qw`c?oY+6t zo4Eo9yp&fLdMnt84(^uMH8t{-eCV2O*RTI-nF`gnxX@dY1~yJd3M-0V?boPV1@AiGlr=^J*MXwd*;>JA{Ucn3NrJZ=8*5PAt*c{ zaCQ0A!ng_U;bmdjJl9Amq#PSu4fyhJ=j4S|Kjr5f`KWvFz%ZyYz<&wnrRQaJ(_byG zh$OZ#ML)jpd)O{g2ZwFRC?0j!;+fFcc z#V?@6-Ms%H2sBo;Y0EJ_!r<*zGJMB4$hm(>eF(tdC1Y#K#PT5yr4($E>txC0I*cO! zIJj;29^H6C!H|K1S4nacDAYJdITet5oXT@;48}EXc*HgWkd7*mo0r(^u>f0VNkfyL z@pa=cRu5~YhwP#d$SM@mJH*iO7y`W1^Lb0139>L-O1~CulTNE2TiGtNYrVv(%<~7T z7>Vd@e((|~2@VQX+9~F&xY#7k`Z8j>?qb&p_YB&@>R8gpUuc0S?$7$ma@meD+v zq{nl90MnY~uOT7@t0Ix-vz>x&6cwbuD}LR+J2s+dUWBI&)G-@Z0dc2K$+3aPS`3NW z^)ll)b=@V{z-0wJetr-(MY8^j-@jV2OYKiciJ<9&MUyUW;j)b-`zLbcUz7BuD2^N+ z9ni7!?^x2QqSV!-Sb=Rnb?wkr{0y5clnWaJPH3eVNg~vG3x~M=Vy&^)YzQ-wg&eg1 ze(_DKTyXKjCFJF*Z`Oi?-}6hN<@l!Uy7Q6U58fD}OT}{O>RCI*&pUJ5)s9uMx_;G@ zMbtE8PD1z^*1sxh?(?%{8N<=13vT_tFv8=*txpb*|9UD`mFe1&rA=2~X;T5=VQB>QD5-M}bZ zg?;jBY8SB|fvS7&$hI)y$%b-&JySCaNf&F>CcP=}sdc+vxxV5f8Exfwq7SS)WN)f$ zYg>~@CE()4P+-lc4$FbvdFUCqOOdRIE|f{FeYLbmbk?51T~#f3*I4l+_Ogatx|>_x z)ZlkCz&6WqQmS7niWg~!FMs$U^#uI+7)oes!9+y zJ3sE@a+nxQ)uh5(RWGsGqjRXfcSNC8p}p-Tfah<`%G*RH;8Omhp;C^;tyY(HGChrh z>od9CsVUTBT`#jSV za@SOiVv&ruPqBX*%x>p5jOAO80tD5r&c6KVuCICtD``0j07UFO;d!&it}nPd5pv{{(oU{h;j{urBvYtqP6CDM1q!bFSpt|2O+`Cq+lDYk8zw z{rONoy3p%LXE%;3j(2>mS#H|$-z2*7o|Yl9xl#DySp5?@6m;{T^A;xwvgKJew!-3% zWtH~6_;9SlQbsz@+BD-6v@t;U>vH8XMY`cWiwdf z?$q(XYc4V|;KV4=v;PTB~L3*XJ358k-7gWLa1N8SnxbgV#S|(a*^FCwP?nHTiIlmo+ zyxVn!b4-OQJYxvJ^)O#JGhYa0SUx{n{fi&|NoyR7Y4M)uF{r!xC3ONi;!imy{X3Ap zVRKopvjMQ17a*>v!3_%JL+AM$^V34J2t%d#Q*lCHmp=c2toqsWe05V+cC#ux@ojnV zKan1>DR{JyQsq!~dBAqw!O@BHJ2?twn(GP%XcThRP??o??&R$;>GrMbWdE(Yxb3Jq*c3IVg% z{;w4^T_=l6?Zf+7`!Nb;O*YD1eh4gM<@BeBIg;S=|2e@ehd&^^rD{{whp?CRF^l$p^pY>S+|jYEw@^K|Iw zIZ1bS-BHj>b@hY`28D!Q?qQygU#;DP^?=OH+%XX8>MiAa8gU2?{gPx7F2%&16^E&- zUijTk5P*B`m>$5bU%De41+ky+n2K{0ZSbv%d08$Jm{gN#f1rKZ2kMUpFMqF)1^r2@asCI_{GY9N~4M$Eao&@{r=)iXb2Xnb8R6v!`~7N~1t zs^ipO^a*{}IKb_)sO_V*Ctb1}wufwwW7V2q0O_nP^A{}v*{}0wYT8*+TXq|GYcs^j zO?+*5txyTl2>3|HoSixkb-(pC)E;D4v4DiL}v{~Bv9U9TGfxp}o_4KOhsqxXoUt!%~1oBW@q(0+QJGk9)wbOj#hEag;!;guxf2=xm6QNf-`Gu3wm)9%9Ec7$W zv+|_CLcJhh1>W0^HCn>`IZwG>PEx_PM{5!2{hy)jJ$d|;mRih}`}+B@jzCFVbZ9-Ehxs)Bx7EG0jMP}6s42G)T$uF?D;hF zh3Ab|3E{ay%HQ0E2qMSQEtievY~kv-3dOX!TsQW$wIexlaTpncaUvxwm#eSp!o;84 zY^q#=&;xVUBJu=;{PfFNbnn@z!QtFKUcV3Nn_pVOZqHQc<9c{QIz(93%#&un-*(#6_K8Yv_5Nj{wRHY3 zuD`B!-4YUdFC?5@(RrL_$v;V87m7=0J!CUrEAk81I7jn)CWeAJLWLqoqC=_Wz z4996wleo1goy|!U)^u)&bRl~&9fHZi4_Jz)Aol}To3`Jq)20B$Ps+*I-qR#nc-GPR z?^)yZ^Xf6Y{Rc-*K}{qs-k2=1tj<_Lpk%hbYyfOPgYqNWG>j{{*!ht-$7<7cE{Qk` z#}AwtHDidD6j3&WrYKdkvK|R9tiesZ%|IuNM<^$cPB{9F8BCsCNsD6zvN-!YWIXst zNVT%FX=Z=#>zvT-ru984piv=?xBWsC75ebkYfm}M&1HgI_==bY`I0+%O^a_=`D&V& zN%8oG2H8uFj&Dl;yuAK4%q1C{#Wqrv4)|P{#&>%ov@#z48 z@4d6_AP%F*JiJUN<3sYlIsk4g2lMCE{2L7GV5wD!mx&W@W6)xlq`8`)ad?PXnxiGKh6BGD%J~B9eUYP65}0zH z8RC)je!EGEWr@&&Q{5D};>%K}P}_(cjH2(-&S_vFk(wL^5W9+(>Bua#3}0rh zQ>jhITNot_qg6M?qbO0B%}%~qF3$<0zm-vCl{0oOPs*Q`W>x!U0KAe~S7a4mu04;;zp@wa!$+ z>h&?sjh-Y*Q~EgQ?_Yq{UjU@Z9lPU)(~<|(M?%gwdfuwNB(W|p=LPC+N%bZa7XIy= zI;t4ZI&&*JnH8Tux{W)ud4Aq1gmT;m zIvAU$W^i+>Sm!n(ufngB)X~O?7}0}AJ(_w)Tu)H8G8TW2Ou1&q#@NcU6~jD9_6TIo zH_WiG18oXQiSQyD5mDxX-r05SE0&Hz;i-+?({1(v*Ud!jw)B-+i;;@UShfS?j-^!g z*QsK_Q8J=5T=P6CY&%zRF%gXs?S@i^8&-Cxu% zva5><4wwZ3a(TcU2>q8=idb@Fgp(N%Q$)< zc1O7WyIuxUY)QaAn@aS9JC~I`NL+U7=!mmvNhmPVt@oWp-_tnl>@Nl`o5O}j=^w7U zKId0J8ZOwD7v_qP%;a#ooJzJ=i?1f;`^ zca4^@UL@L%uQBX#ov&;OG$h8@&8uUBf{6Zbq~t zT9`=I4Y`AW+B({E0YbcVSLfp&-WkHV7c^5o!t>o0-t!9rUdqRotZJ!4y*i?>6vf{_^wYUhXovf8Rh^Rq1jnl+fNP9rh$mQ+vgS zW1`=$(XoDHFplq8#|gqC*?!Z=&+EUj^yt~XvUyPH^Hru}l$2MkeMLrf#f(lkYx$9| zmG=(XEu|bb2o7jLIyGgDAAf?1B`@s|r+VtIXRKSB`LHbhDZ0j$H9U*}e>wOyPJX1ZeaVdDHbqB^~;Bij^}dS$kez_d+pY|-Xn_Nv-RGMI+FtC z-4Kne2-6#>g3<76Iv(>U8r((4@&SOrCxfTikq`DhoQk9?nY{oe2xAPIDgZnD5^r(m zH;72~6h!<lyTW**9hj?%kp&~T(B-O`xJW_OlLUZ zYU-S9`u=)7pN#b8?eEoP7btUK-A=b^u&5Bd!@t#q?>qwRhmkn1U%3opNZ#8_&%2{- zN>I8uaH_lf?Ue-6pB)fF?K8RQ0x}R{quCT&*IA9OlE6{!ZmDsN-4DBLNGIvJ&`x<> z1yk|rq>(DT>$PAI`<#TIir2%Jw4#)%z&2mUVjsvyCtBP6JDFFMxh7Hq2_^E$J{({w z>WyJ~SVTlrKow0a73ZfJX}0W#n5cZ`Qwp|hi+r%hdwUGhe^c}N9FCybS$q>RheR0J zAVD+x%mT#oH$ii5%w{;9u}V?L!&|RG1q#R4(z@7FwC@6vn59E9=J?~yyO87os13V7 zU@%Bbs)xjbhbe144ObrBFID&JcJcZ}-KjDrZ=Xg^svkf=g?ECYkjGG{y;z#3So|{3 z@P1URaa7~G2nCWfE1jI7aX}4Ii`Z;~kU>s<(aRWOd| zRjFmhb}3+JqmB**ct(5i@aK~TEt=2i zb22-0wd&Yuj|Q_^qmjdDft^yj6b11XF=p1Ji4AM_4OQ&?*n{R8)EI-axq_`sXu%U4 zHUYz4wz&mpu1gda#aZvsrc(I{iy!&A1btG`TPaNLKJUba(RMVB4uycKs(}G@hynwf zlsDgan*cGT!X51nbLhKM{=BdI*C#GMYc=!vGVWza-W(U?3&O{LofU+h;SerM6x@K* zAIr81ddEeuc1o-(P5saQ0rub87nrw;fof*ei`1= z)BQ?;$Rlz4>lNUZ+#vnxl+Iu?5dXx`!uc_Cpr7o}rD3R%(&?aVq0kXCr!FGXW``On zd&5^lIqKw#`u{;_-f#;}>PEZq=Fe15!;+;aRe;%SLsPOj2C-(C{-kts*VEn#$e{vV zVgb-$dh?-^5-;o>!p7DP@<3y4rH_~Jk9a^l_~OcICWh|odHA|iPvNqSq;NPXJ~D*n06*4#>jm{;>F>4v{J}{^@aFQnZCdO=B_hph z3uNU>a21=PQMdpCI7PLWFt+%<CCB7ci@5jAVFK*STE=90-=yvCc7VY6qj2;_0 z_d+6?w|PLWJ3<>rV`i7$i8Tlb*%Opol+7Vrrf{V6QvrFO?k+pREZQW@nt;n z8`jq8l_8o?35cy5e48#a?(u0%)?qE=vHC1o-@CdcgYG|8aXJ?Em6?TSR{?cWeiY`6{UY3Kf+H5F!JP&RJi z2`1f0RS4*d*(DTo$#q;Az4juB%FB+%6cN!rhTA*Oc)NepHxAWlIQii9=nv5^kstnD z^1MKU;U51=z?M+Gr_8aTvo(|`MB=o{>G(AXrLd^vAM8(lwWpNol|!g6_-Gm`y2|Z} H_Mra(hao9z literal 0 HcmV?d00001 diff --git a/images/monitoring.png b/images/observability.png similarity index 100% rename from images/monitoring.png rename to images/observability.png diff --git a/topics/databases/README.md b/topics/databases/README.md new file mode 100644 index 0000000..db5f679 --- /dev/null +++ b/topics/databases/README.md @@ -0,0 +1,191 @@ +# Databases + +- [Databases](#databases) + - [Exercises](#exercises) + - [Questions](#questions) + - [SQL](#sql) + - [Time Series](#time-series) + +## Exercises + +|Name|Topic|Objective & Instructions|Solution|Comments| +|--------|--------|------|----|----| +| Message Board Tables | Relational DB Tables | [Exercise](topics/databases/table_for_message_board_system.md) | [Solution](topics/databases/solutions/table_for_message_board_system.md) + +## Questions + + +
+What type of databases are you familiar with?
+ +Relational (SQL) +NoSQL +Time serties +
+ +### SQL + +
+What is a relational database?
+ + * Data Storage: system to store data in tables + * SQL: programming language to manage relational databases + * Data Definition Language: a standard syntax to create, alter and delete tables + +
+ +
+What does it mean when a database is ACID compliant?
+ +ACID stands for Atomicity, Consistency, Isolation, Durability. In order to be ACID compliant, the database must meet each of the four criteria + +**Atomicity** - When a change occurs to the database, it should either succeed or fail as a whole. + +For example, if you were to update a table, the update should completely execute. If it only partially executes, the +update is considered failed as a whole, and will not go through - the DB will revert back to it's original +state before the update occurred. It should also be mentioned that Atomicity ensures that each +transaction is completed as it's own stand alone "unit" - if any part fails, the whole statement fails. + +**Consistency** - any change made to the database should bring it from one valid state into the next. + +For example, if you make a change to the DB, it shouldn't corrupt it. Consistency is upheld by checks and constraints that +are pre-defined in the DB. For example, if you tried to change a value from a string to an int when the column +should be of datatype string, a consistent DB would not allow this transaction to go through, and the action would +not be executed + +**Isolation** - this ensures that a database will never be seen "mid-update" - as multiple transactions are running at +the same time, it should still leave the DB in the same state as if the transactions were being run sequentially. + +For example, let's say that 20 other people were making changes to the database at the same time. At the +time you executed your query, 15 of the 20 changes had gone through, but 5 were still in progress. You should +only see the 15 changes that had completed - you wouldn't see the database mid-update as the change goes through. + +**Durability** - Once a change is committed, it will remain committed regardless of what happens +(power failure, system crash, etc.). This means that all completed transactions +must be recorded in non-volatile memory. + +Note that SQL is by nature ACID compliant. Certain NoSQL DB's can be ACID compliant depending on +how they operate, but as a general rule of thumb, NoSQL DB's are not considered ACID compliant +
+ +
+What is sharding?
+ +Sharding is a horizontal partitioning. + +Are you able to explain what is it good for? +
+ +
+You find out your database became a bottleneck and users experience issues accessing data. How can you deal with such situation?
+ +Not much information provided as to why it became a bottleneck and what is current architecture, so one general approach could be
+to reduce the load on your database by moving frequently-accessed data to in-memory structure. +
+ +
+What is a connection pool?
+ +Connection Pool is a cache of database connections and the reason it's used is to avoid an overhead of establishing a connection for every query done to a database. +
+ +
+What is a connection leak?
+ +A connection leak is a situation where database connection isn't closed after being created and is no longer needed. +
+ +
+What is Table Lock?
+
+ +
+Your database performs slowly than usual. More specifically, your queries are taking a lot of time. What would you do?
+ +* Query for running queries and cancel the irrelevant queries +* Check for connection leaks (query for running connections and include their IP) +* Check for table locks and kill irrelevant locking sessions +
+ +
+What is a Data Warehouse?
+ +"A data warehouse is a subject-oriented, integrated, time-variant and non-volatile collection of data in support of organisation's decision-making process" +
+ +
+Explain what is a time-series database
+
+ +
+What is OLTP (Online transaction processing)?
+
+ +
+What is OLAP (Online Analytical Processing)?
+
+ +
+What is an index in a database?
+ +A database index is a data structure that improves the speed of operations in a table. Indexes can be created using one or more columns, providing the basis for both rapid random lookups and efficient ordering of access to records. +
+ +
+What data types are there in relational databases?
+
+ +
+Explain Normalization
+ +Data that is used multiple times in a database should be stored once and referenced with a foreign key.
+This has the clear benefit of ease of maintenance where you need to change a value only in a single place to change it everywhere. +
+ +
+Explain Primary Key and Foreign Key
+ +Primary Key: each row in every table should a unique identifier that represents the row.
+Foreign Key: a reference to another table's primary key. This allows you to join table together to retrieve all the information you need without duplicating data. +
+ +
+What types of data tables have you used?
+ + * Primary data table: main data you care about + * Details table: includes a foreign key and has one to many relationship + * Lookup values table: can be one table per lookup or a table containing all the lookups and has one to many relationship + * Multi reference table +
+ +
+What is ORM? What benefits it provides in regards to relational databases usage?
+ +[Wikipedia](https://en.wikipedia.org/wiki/Object%E2%80%93relational_mapping): "is a programming technique for converting data between incompatible type systems using object-oriented programming languages" + +In regards to the relational databases: + + * Database as code + * Database abstraction + * Encapsulates SQL complexity + * Enables code review process + * Enables usage as a native OOP structure +
+ +
+What is DDL?
+ +[Wikipedia](https://en.wikipedia.org/wiki/Data_definition_language): "In the context of SQL, data definition or data description language (DDL) is a syntax for creating and modifying database objects such as tables, indices, and users." +
+ +### Time Series + +
+What is Time Series database?
+ +A database designed specifically for time series based data. + +It comes with multiple optimizations: + +: complete this :) +
\ No newline at end of file diff --git a/topics/observability/README.md b/topics/observability/README.md new file mode 100644 index 0000000..d388b62 --- /dev/null +++ b/topics/observability/README.md @@ -0,0 +1,88 @@ +# Observability + +- [Observability](#observability) + - [Monitoring](#monitoring) + - [Data](#data) + - [Application Performance Management](#application-performance-management) + +
+What's Observability?
+
+ +## Monitoring + +
+What's monitoring? How is it related to Observability?
+ +Google: "Monitoring is one of the primary means by which service owners keep track of a system’s health and availability". +
+ +
+What types of monitoring outputs are you familiar with and/or used in the past?
+ +Alerts
+Tickets
+Logging
+
+ +## Data + +
+Can you mention what type of things are often montiored in the IT industry?
+ +- Hardware (CPU, RAM, ...) +- Infrastructure (Disk capacity, Network latency, ...) +- App (Status code, Errors in logs, ...) +
+ +
+Explain "Time Series" data
+ +Time series data is sequenced data, measuring certain parameter in ordered (by time) way. + +An example would be CPU utilization every hour: + +``` +08:00 17 +09:00 22 +10:00 91 +``` +
+ +
+Explain data aggregation
+ +In monitoring, aggregating data is basically combining collection of values. It can be done in different ways like taking the average of multiple values, the sum of them, the count of many times they appear in the collection and other ways that mainly depend on the type of the collection (e.g. time-series would be one type). + +
+ + +## Application Performance Management + +
+What is Application Performance Management?
+ +- IT metrics translated into business insights +- Practices for monitoring applications insights so we can improve performances, reduce issues and improve overall user experience + +
+ +
+Name three aspects of a project you can monitor with APM (e.g. backend)
+ +- Frontend +- Backend +- Infra +- ... + +
+ +
+What can be collected/monitored to perform APM monitoring?
+ +- Metrics +- Logs +- Events +- Traces + +