Skip to content

Latest commit

 

History

History
25 lines (18 loc) · 905 Bytes

hostIssues.md

File metadata and controls

25 lines (18 loc) · 905 Bytes
Raw

Dealing with host level issues

  • Dedicated disks for NN / JN
  • Don’t co-locate heavy services like HiveServer2, HBase Master/Region server, Yarn RM etc on the same host as NN
  • Verify Kernel Configs after every OS patching
CPU Scaling should prefer Performance over Power Saving

Please set scaling governors to performance, which means running the CPU at maximum frequency. To do so run cpufreq-set -r -g performance OR edit /sys/devices/system/cpu/cpu*/cpufreq/scaling_governor and set the content to 'performance'

Disable Transparent Huge Pages

Disable THP to reduce the amount of system CPU utilization on your worker nodes. THP needs to be disabled by ensuring that the following proc entries are set to [never] instead of [always]: /sys/kernel/mm/redhat_transparent_hugepage/enabled