{"id":25032,"date":"2015-12-11T10:32:27","date_gmt":"2015-12-11T08:32:27","guid":{"rendered":"https:\/\/mamchenkov.net\/wordpress\/?p=25032"},"modified":"2016-12-11T05:44:01","modified_gmt":"2016-12-11T03:44:01","slug":"cpu-steal-time","status":"publish","type":"post","link":"https:\/\/mamchenkov.net\/wordpress\/2015\/12\/11\/cpu-steal-time\/","title":{"rendered":"CPU Steal Time"},"content":{"rendered":"\n

Here’s something that happens once in a blue moon – you get a server that seems overloaded while doing nothing. \u00a0There are several reasons for why that can happen, but today I’m only going to look at one of them. \u00a0As it happened to me very recently.<\/p>\n

Firstly, if you have any kind of important infrastructure, make sure you have the monitoring tools in place. \u00a0Not just the notification kind, like Nagios<\/a>, but also graphing ones like Zabbix<\/a> and Munin<\/a>. \u00a0This will help you plenty in times like this.<\/p>\n

\"web1\"<\/a><\/p>\n

When you have an issue to solve, you don’t want to be installing monitoring tools, and starting<\/strong> to gather your data. \u00a0You want the data to be there already.<\/p>\n

Now, for the real thing. \u00a0What happened here? \u00a0Well, obviously the CPU steal time seems way off. \u00a0But what the hell is the CPU steal time? \u00a0Here’s a handy article –\u00a0Understanding the CPU steal time<\/a>. \u00a0And here is my favorite part of it:<\/p>\n

There are two possible causes:<\/p>\n

    \n
  1. You need a larger VM with more CPU resources (you are<\/strong> the problem).<\/li>\n
  2. The physical server is over-sold and the virtual machines are aggressively competing for resources (you are not<\/strong> the problem).<\/li>\n<\/ol>\n

    The catch: you can’t tell which case your situation falls under by just watching the impacted instance’s CPU metrics<\/strong>.<\/p><\/blockquote>\n

    In our case, it was a physical server issue, which we had no control over. \u00a0But it was super helpful to be able to say what is going. \u00a0We’ve prepared “plan B”, which was to move to another server, but finally the issue disappeared and we didn’t have to do that this time.<\/p>\n

    Oh, and if you don’t have those handy monitoring tools, you can use top<\/em>:<\/p>\n

    \"top_steal\"<\/a><\/p>\n

    P.S. : If you are on Amazon EC2, you might find this article<\/a> useful as well.<\/p>\n\n","protected":false},"excerpt":{"rendered":"\n

    Here’s something that happens once in a blue moon – you get a server that seems overloaded while doing nothing. \u00a0There are several reasons for why that can happen, but today I’m only going to look at one of them. \u00a0As it happened to me very recently. Firstly, if you have any kind of important … Continue reading CPU Steal Time<\/span><\/a><\/p>\n\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":true,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"CPU Steal Time #linux #SysAdmin #DevOps #WebHosting #monitoring #performance","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false,"_links_to":"","_links_to_target":""},"categories":[1,6,133,62,1334],"tags":[3270,3333,127,1057,2289],"keyring_services":[],"class_list":["post-25032","post","type-post","status-publish","format-standard","hentry","category-general","category-linux","category-sysadmin","category-technology","category-web-work","tag-amazon-aws","tag-amazon-ec2","tag-monitoring","tag-performance","tag-web-hosting"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t