SRE. Рецепты выживания в продакшене для инженера по надежности. Наталья Савенкова

здесь сказать. Управление надежностью это прекрасная область для развития своего профессионализма, которая учит людей целому спектру интересных навыков от дизайна систем до оценки бюджета инфраструктуры. Этот этап в карьере точно оставляет в памяти разные истории о том, как "Игорь" случайно выключил продакшн и пошёл обедать без телефона, пока все пытались понять, что произошло.

      Спасибо всем моим коллегам, сарказму и котикам, на которых всё это держится.

/9j/4AAQSkZJRgABAQEASABIAAD/2wBDAAgGBgcGBQgHBwcJCQgKDBQNDAsLDBkSEw8UHRofHh0aHBwgJC4nICIsIxwcKDcpLDAxNDQ0Hyc5PTgyPC4zNDL/2wBDAQkJCQwLDBgNDRgyIRwhMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjL/wgARCAhhBdwDASIAAhEBAxEB/8QAGwABAQACAwEAAAAAAAAAAAAAAAECBAMFBgf/xAAZAQEBAQEBAQAAAAAAAAAAAAAAAQIDBAX/2gAMAwEAAhADEAAAAfbWWecAQKIoikiiKIoiliiKIoiiKIoioiiKIoiiLAAAAAAAAFABQLAAAKIoijFRGQxURlCMpEUAJRFgAAAAAAAAACBVAAAAACAAAAAoIBFKQCgAAAACUoAIlCURRAAWCggKAC1KWVcygAAAACAAgKAAAAAAAAEAAJRFgAAAAAACgAAoACwVKAAAAAAJURYAAJYAAAAAAAACkURVgAICgAAgAAAKAAAAAAAAACgCkUQAAAIACgAJYAoCwZEsqUAlhKAAAEAAAAAAAAAAACAAAIAEBQAAAUAAAKFiWUABQAAAABCyxQkBUsQAVYUiwAFIsAFAAEACwAAAAAAAAAAAAAAAFAsolAAACLAAEBQAAEogUAQyFgCwVKAAgAAAIAAAAAAAAAEAAARYAAAAAAoAUAAECgCC1KCFgWBYAAASgJVRSQCwVKoICgAAAgAAIAAAAAAAAAAAAACgAUAAAAAAAEUQAAAApAAslhkLAAAAFgoAQAAEAAAAAAAACAAAIKAACAoFAAAACAKBKIsUAAAAAAAAAACLAACpQAAAAAAAAAEAAAAAAAABRSAKIAsKAAAAAAAABKIsACiUEoijHHLEzJVgUAAACwUAIAAACAAAAABAUAAlCWFlgAACgAAAAABAAKAAAAAAAAAAAIWWAAKBUIsFAAAAAAAAAACAAAUAKlAQllAAALBUsoUACAAAAEFSgAAAAGOOWBmAUACggAKApCpRKRAsIsUgKALAAAACCoLACAUAAAAAAKACUAAAAAFBAAAABCpRAAABQAAASgJQQoAAEsAKgoAAAKlAAAVLEAAAABQKgWCoSoKigAgAAFBFgqCYZ4GZaAAAAAAAWEoAJYKlAJRAAAAIogAAUAIAABQBCwKgqChQCUAAAAAABABCoAAAAAUQqUCAoEAoCAUgAAUABZQAAACpQEACoIAAAAAAAAACgBCpQSWpQgqCoWY5YpyCwAAAAEFICwAAAAKgoECgCwlEsAUIBQQFCUgsAAFAAAAAWAACoKgWCoBRLEAAIKAQpCwUAICqgqEoAAAAAAoAAUAAAKIsKgqCkAgAAgqCoKgqCoKgqKsAAAIAAEWgmGeKcgsAUAIogAAAAAAAAAAAUECgAgFAAILACAUQqFWIqCpaBAAAAAAAAFlsQAgQAqUAgAAAUAAAACpUAJaAAAAWCoKgqUWCwAAFlSABUIBQAAAAAQAKACAEoiiBagmOWJzQuQKlAoIgAUAAAAAAAFABAAAQBBbAWCwAAAEoiyUABYKgoARBQAKlAQAAAgsAACkoWIAARQAKgpCoKEAqKWCoiiiCpQQogCipYKgsCoKgoEsUIAAAAAAAAAELAoAAEoxxyxOUWAAVBUFeK12veOn7hk83F9K8B2K+uTpE7x43WX3byPrUoBqG28Xxr7h4j2JzPO6KeweB7c9O6Doz3bh6BPSuj7ss8byr61899Qd085pHsHgtZfozpe3TN1vUnqHgd5fYPC+hTuZYhrdEvpmvsA6yOzeP6Vr6U8L7e5zeF9FL3AQ1Okl9M1+qTvb0HZ6bjwPrzeeT119peu8pHu2l1yd88N6qt91nRHsHzXfX3bHKZrqPM2+8ec9GGt489y0epj0bw/tDkeI7te8aHlD3TpO7QnVnavDZW+3vBzTNYdFb6CeD65fpzoe+ZHUL27y2kvtnz3kPfNLzKezeIzX2jiyZzvi9Nr6A8d65MyJXiNtr1jg5mamhL2DwHb2+ouHGzzvAeqa7R5zoT6C0ehj1jV6SvSvJ+ljneH9Mdk8txV658+9Gd86foj2rDxZ7a+X7pN54nJr2bwvt5MwlQVBUExyxOVFlQVBQOm7nzC+P7vpfat+K+mfMvo54nr+w21y6j23g09dhz8CeT7DV+nr5X1dMANXa1Y+Zb+h7q76DDb6c7jzno+oOfvPUGOg8P7nw7X0zx/svHJp/RPnn0Q+Y8PL37er2npTn8r5Ow5nSdL9Q+Xp7Py/qt9n509d5Fvue47jdY+bdp1m817p56sdj84+j/OGvdd31HbsvB+88GvV9/wBWb0PdeV9+z877bqexX3E8/ZnsPnX0X5017rznp91n5x7DycuuD1/kNheHutH6EnX/AD/6D8+PoniPUeLJ7jw/uDz/AFnZ652nnN+nqu6wzc/K+U7HWdOP6d8t+lJrfPvoPz4+hdL3fSJ0P0b5z9GX5l6vynql0/PbGuvpPYeP9DMdL5aevuvL8ff9Gv0rOWctb5p9L+aXfZ57HSLzfS/N+kZvjPZdYnz7sut+hN+M4PQ+ePoHzf6T82TsNn0fRHF33lO0PPdrp/Ql8R3PH0h9Ixum5/POGnX2fofF+0c3nPR+DXprz67f03j4eac/m3rPJ896Y9jo/RU1fnn0b5ye96D0fnU0fdeG90fM/d+E94vm+o7fFb3voUx5bzPpvNXX03559D+eJv8AfdB354HZ1voi+f8AU86ZqEoAAJjljXIIAAAau0X5l6P0Xjmt/wBB473CfPccuuuuXsup+hnYeX9V5WZ8v3fQdjdez7Poe+YBlq7WovzP2Hj8nTPvOg+ip5vo+884d/6vxPqmeLw/uPDtfTvHex8czqfRPnf0M+Y7erwN+i9h4n1zHiebh5mva/L/AKh8vT2voPP+gZ6XwfvPBtfSN7S3Wfm2lu9g6aOr9H+bp6/xnrvInvu36jt3N4P3ng2umu57prwHvvEd+ed09zsV0dX6L84T2HjPW+SPfdt1PazHS+G7vpLsF9/2vhPdMdZ8/wDoHz9ru+nndr0XuPD+4Tz/AE/caa6nP77xCe35ugzZ8h6vyfctdN7zwfrDtfn30D5+drozNeL6B4D3rPgO46c1J2uid56jy/r2Pme/3njWu209fcX6MHLV+a/SvmrbP0fbL533Xyz6czy9Z2nWM/PfoXz36E303nvQefX6D82+k/Nk9j5LGtd/pey8YzfoHz/36eW8x6LzrX07ou98Yx0Xca3oG/NfSPln0tnm+Zez8OvrPKdv1DXtO0836Nj5uG/a+g8B7xjT+c/RvnK/QPPd/wBAaPu/Ce8PmfuvC+5Xzunt9Svfeu8V6lnqfLep8ovb9Vs8C7vqfLenTw/d9Jsr63vvK+pmKEAAASyzITVQVKAPO+i1j577bwPYXXWe58N7w8pljvr1D6D4BPe9H1Hbp5j3Hgq17nvPnPtWOxvzX6Gc+ptaafNfR+c9y3yd0Ofi+o7fzrp7rPwXZJ6bw/rfIr9K8d1GJt+5+d+kOk7nptdfY9z849Iz1vNwcq+3+X/TPmae19B570LPS+D9t4lv6Tu9d2M5/Nt90d6dtwT3acXzv6P84Pfdv0/cMPB+88KvH3XkY3fofW+gZ+b9hj0zXacM93HB89+ifO6951E84jvufuj5/wB90P0Jfnvo50J7nwXt/EF9z5H3KfOvceH9ovR48vTnrfJT2J2fg/ffOEdl33oz5vu9h5pfe/Pvd+ET6F0nddCnTfRvm/0hfmWGca9d5n33z9nvPSeI4Dj7HS+hL4rizwPoQc9X5r9L+bN+z871+0u177V2nN1nZ9WfPvoXz36C30/nu86JfoPzf6L86T0nc4d0y8b7LQPB/SvmXZNY8Gj69e9+c9r0Z6bufAie48PzLuddl6ZOnw+i+dTz/t/nPuzwXfdD7pfDd9t+WPoXzz1XlT3HRdLDe9b4QX23iPRGpjl1K+03PAduz2XmvSebX6Z8++gfO07LvvP+gPBe28TWvYeg+cezZ7YTIAAAlmYmgRZSUAOv6f1BfP8Af1Z0XH6ENHeGny848p2PdBxcpPM+msEyh5ze7UtQmr5v1xeq7UNLpfTjo9ns9c+Z+t6v1DWPS+vM62yJ0+l6VLPP+hHUduGv0XpRrbKI6/sBx8gcfRehW6O8IwzJ53e7SKKTruxRx52HH0foKulr9qRx8g8x3e4XHrO0HF53046fuKs6rm7AcfQ+hHV9nZE6Xuxx8stcPSehHD13bw1uLeR5L1lV5/D0gaG+Omx7saW6Jo9Z6EoWNLdHmfQ8vGvKwJnw80PL91vw1PP+rq8fnvSjq+zskA4On74vQd9R875facbWq7kz4jqvo3VtOy56y4+Qef7XbHle47Irq+0JwdN6AvTZduTqr2g67a5xpee9cXQ3xOPqO7GPUdwl876DKnncfSKxyEEigAAgrMSgAWBUBYUAWAABKCFVFiCLXF55fTNHeQA87sr3KVADq+sX07qu2SL10dg836S1ej4zv06GO/mlTdnlPS1zOHSTs08yvpmpwJ2c8z6Mzef2F7h5X08mbp817S8Xlz1rS4jsr0unXpp1OzJuul1LfSOp7YGvJsvLdtb2iGRxLyzrtJe+eVh6tjqpuzznEvqGvsSBS9fpneHlz1Dqe2B5w9G6Lua5AyaXVL6JrbCX597rom+PHd0l9Umk57zUq7V816Ezee2TuGv0x6Bh0h3zoO/DQ6qX0jy/ojmCHRRe+Y5INddh0fVr7B1/VJ6Vx9edo893hyhAAAAAIVYsKgsUlAACWADMSgAAALBZYKIAAAAsUCAuh849z4Z0y+l/Mvdp3ZxTHzrTyxvX2novFe1c54/Y8s1jPeeGa732vkfXMXyPrvJx5r6T829jb4zCVr6b82+k/NmfS9r1vZJ4D6P84+jteX6T6P8AOz3fz7f0D1PTTQOb3vDvs/Mj1bfn/ZdtZj59y8Wzdew+afTPmcntOv7HrjzWef0W3xvf950rPhdnW+iteF9T0PIe56fuPHsecuWDr9L2es7NxeO9h16/PMsfbunjuP13kj6Z4P23zhjHtub1zXhvoPy73idsGPJdD3vSOn0n5x9I+bs9x7DyHrkfNfdfPGnqvMd6vtBePnvGel81O259H+W/SmdT5/8AQPn9t3fVd5JoeE+ldJZ5f0fjN9vr/b+I341Oy0/oVnU+K9r4qPpHkvY+PudX3/gPay+G0L37Wo9l85T6j0m35Jnqubl9E31fe+L+ip4bS9J0bXBt9h7Vnyfmva+KX6R4H1/hUfQPn/0E7IOYAAhUFIUAEAC0IIAALKZCaAAAAAUQAAQoAJYKlog8h0nL2Lp03f6HEfQ+p7bybHley0fZN+W+k/Kvpqea839N+fHrvB4F9Z6rzHp2L5P1flDzXbdNXTB2vVH035t9J+bM9veirT6B8+9Qnrel7ro5jw8svV6jy/eM+51+bhnP5n6TzS9ffdt86+gTHg5esu/S+bQ9fq6W7M9D63xfJdfSur09tjw3v/AbTfB6XzX0ZNr5v7r52nf9B6Tzq+x9B4/17DV2tWPm3ufDe5u9byXrfJHufB+48Oe+7Pr96Y+Zer8n6q79QHPyPQ995p09Z5jjL3vtfm/0Jjzvndo1zcOWgfTWODl4THR9c6+P9v47vU7z5/8AQPn9er7n5528nvEXn5DzfovOzssNe+7bzvoXHovFe08U36voNOru+p8b6FPM/Q/nn0U2Pmf0n5sew8p6jyx3va6XqWfnnv8AMj539F+dNdh7XxXtU6LxXtfEt+h8/wAu+dV9B+ffQU7IOYACAWCoVKAAJRAUAAAGQlABbFICkKEAASgBBQBUmrtfO7rr/ceG32u68zs6a/UvBbvn2e29l0fpk+We88P2bXpvB8u+bPQfR/nB7T0XQegYnlPV+UPKcvF3bp2nkfZeNT6b82+j/N09B22l2CeC+j/OfcNbfz+85yaH0X50b2h7XqTZ9L8z9rJ4r1Xlea6952Hy31sx0mfHtXXqvnX0r5rJ7Xrux646D33z7K36L13jvVs+M7jp/pLXVd+xmPD9Ntb96dRn9G6RnofoPy76SbGrtakz839z4b3N3reS9X5M9/8APvp/gU9NueR2DovaeP8Ao5sBjyPRd70jp7/wX0j5qnddr1XKnl5ye9a8Jw/Tfmh9D0ur6Jnh+kfON9rl49TiX33z/wBL5pn2294LiPqPm+p6dG/udzdeK3tL6JHzz3XkNc9h4r2Pjz33m/Y+OZ1/WeT96fL/AHnkNtr03ge56w9n5b33Rs6fo/B8q83rvn30RNr519F+cnY+18R7dOi8T7bxLV9j5v2B4H6D8++gHZhzAEAAAAAFgsABQAELLDMSgAoAAFQVKgAAgCgAcXzL6d51rpew77sk8f0f0zo7fL5d96Q6zs6Y8jpe7L431OzU4/G+2h0ndg6Xuh889b2xdDznshp9N6WR0PYbw+f+t7MvmO726mHifcDo+5zHlPT8g8d1/wBBL1fY5yTpdP0xeHxnuVdBt9oT5923qy6/DvE8B7LdUwzSeS7rsytbZHi/R9jFvBzE8L6Du4vV+U9+OGc5PM9X7pb0vdwlCdd0PryzyPryeR7Tui+W9SI8x6ceE6f6T0Dejs+n52fH+e+oeaXh1e+7mzwnrN8nB5v1Yw098ngfZ7cXT6j0Y1fNevRr9J6MeD92pref9RTwnpO2KKnn+i96Xqe2EnlPWDyXrQ6/yHvy+f7fZWeS7rswEiAACgAAAAAAAVCAoGYgAAFKIAVAAIFAAAAoSBVgoQKABAUCKgKBAWCAEAABLFWCyyBCpRACgAAFgsAEBVlSAAWAKqCpRAWEUAAAAAFiqgoEAIAAAASglAAAAAAqywSyFlEsAUAAAAAAAICgAjMAACygAUAAEAqURYAAUgUShAALBUJRQhQAAIARACFAgoBLAhYAAUUQAICgihBVlEoJYAAKACUCCwLKCFQVBUJSLUFQVAAAAAAAAAABYCwVBbCWAQtQAAAEoAAEAAELUFQlQcgAAqgAAAAACUAAAAAABAAAAsEAAJVBAEAhQAEAABYAAAFgoSUIsLACgFgpCywAAWCoLEKgqCoKgqCoKgqCwKgqIsKCAAoAAAAABYKgqCoKgAAAACAtACAAAAAAAORKBYBUoAAAAEAoAAAAAAEEBRBYkuUloSTKRVQVBUQQtRFhQAIOG3mThOdKhr85SFceqbyYHI4eUqCuLkKwyqkSsNZdxCVw1eVImTW2CsOA2nU9ivLOLiTanHkZOLMycPMHHyBr8i8jDXTbdX2a0102EoAAAAAAAAAAsFQVBUFQVBUFQVBUFQVBUoAAAChAAAAAGaKohYKlLAqEsFqCoKgsCoAKgsFCCCwBIqAQqKsASKgqCwKirAACwC+J9r4y30Pm/TeZX0u7qaaeN954f1K934b33Gnzvuev9+s8v6n58mx7n539EV1Xa+Vk0PYeD+gW+J934P0x23U73hEX1/mWvcTPQmPG8/Nnd+w63e8qx0H0r5z7prLw/vPIk7LrfTnh+z1foB4/stXdNDZ1d88v7zwvaHWeow0DrZ6bpl3+k7Cp1frfK+4Mvm/s/HHsu2816VkEAACgAAAAAAAAAAAAAAFlAAAAgAAAAFACAAMhSxFAAsFQUBBUS1BYFgoQAAQVAAAgAEIAAAFAAgUAAA8R7fxlupq+68y16LzXp/Dp6TqOTrF99s9T27Hgvf8AgPfroeV7LpV5u96CL73wvq/PJp+18x3Z5Dt+s5F7HrvU9SnnOy7LrV911nZasx5r1Xj8Lr23z71fjz0HBr9avvPBe38unPs8HoDw3d9d7hfO9R3W8nlfS628eR58e2X1nkdzNnc6fZ6Zd/qPSdeano/PeyPKbvnt5eH1/hfV2d6GAAAAAAAAAAAAABSUAAAAAAAAgAFAAAAACAFircaVBbjYqCwlAIKiKgqFqCpQgqCoFgAILBAAAAAoEACgAAAHlPVq0eu78dT1nqSvKerJobmaPCe7LfK+g2hreY9gPPcveDoeD0o8D6LvBweO9wNbzfrQCeS5/TF6fi70k8V7Ya/iPfjou8o8NzezL5rc7knT8vZjxnsMx4/1XMPHZevLoeM+hDr+fZWeT9YHmOz7SAIAAAAAAAAAKRQAAAAAKRSxRFEURQEAAAAAAARYBBFtShBbiMkuQAAQIVBULUFQVBUFQAAAgAAAAUCABQAAAAAAAAAAAAAAAAAUAACAAAABQAAAAAAAAACURYAAAAFEoAAAAAAFAKAAAEAAAAAAAAAAQpi1sd622mNxqQ3GoNu6VNxp2NtqDbadjbadNtqDbag22qXaaw2WqNprDZaw2WrTZaw2WsNlrDZa1Nhr2udwRNhrjYa42GsNlrQ2msrZaw2WtI2mrTZaw2WtTYa1NhrjYa42GvTncA52uNhrq2GujYa8Nlq02WsNlrK2WsNl