[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: Bug#960605: Idle temperatures too high when using maxcpus kernel parameter



Control: reassign -1 src:linux 4.19.98-1

On Jo, 14 mai 20, 15:34:05, Vaddina Kameswar Rao wrote:
> Package: kernel
> Version: 4.19
> 
> Hello,
> 
> We have Dell PowerEdge R630 server, 2 sockets, air cooled. It has Intel
> Xeon E5-2630L v4 (Broadwell, 1.80GHz, 2 CPUs/node, 10 cores/CPU). I am
> noticing that the idle temperatures are too high when I use the 'maxcpus'
> kernel level parameter. The temperature in the server room is controlled
> and I notice that without 'maxcpus' parameter the sensors command usually
> reports an average of under 27 degree C. With 'maxcpus' the temperature
> starts with 35 degree C on boot and slowly climbs to 42 degree C after 20
> min of idling. This means that, there is very little headroom for the
> application to not trigger active cooling (happens at 60degree C). We
> reproduced the problem on other clusters with the same hardware, with
> debian testing, debian 10, debian 9 and ubuntu 18.04. With and without
> intel_pstate driver activated, the result is still the same.
> 
> According to my rudimentary understanding (I might be wrong), the issue
> boils down to "Offline cpu prevents sibling core to go to deep idle state
> when the system is idling". This increases the temperatures of the cores.
> 
> 1) The attached Screenshot1.png depicts the output of 'turbostat' command.
> We can see that the operating system is requesting C6 deep idle state (C6%
> column), but was only getting C1 state (CPU%c1 column) from the hardware
> all of the time.
> 
> 2) In the attached Screenshot2.png, I made the sibling CPU for Core0
> online. That means, I made Core20 online. See the attached image
> architecture.png to know which are the sibling cores. You can see that the
> Core0 immediately went to the C6 deep idle state (CPU%c6).
> 
> 3) In the attached Screenshot3.png, I made the sibling core for Core0
> offline again. That means, I made Core20 offline. This time, the Core0 did
> not go back to the C1 idle state. But, remained in the C6 deep idle state.
> 
> 4) In the attached Screenshot4.png, I made all the sibling cores online and
> then offline again. This time, all the cores now are in the C6 deep idle
> state (CPU%c6). We can also notice that the PkgWatt power consumption has
> dropped by half. The temperatures are slowly going back to under 27 degree
> C. I also ran some stress tests and saw, that after the stress tests the
> CPU's are going back to the deep idle states. Temperatures are also
> returning to under 27 degree C.
> 
> This leads me to conclude that it might be possible, that the kernel 4.19
> might have some regression with intel_idle driver. I am not sure though.
> What do you think?
> 
> Best regards,
> Kamesh

> root@server-9:~# uname -a
> Linux server-27.paris.fr 4.19.0-8-amd64 #1 SMP Debian 4.19.98-1 (2020-01-26) x86_64 GNU/Linux
> 
> root@server-9:~# cpupower frequency-info
> analyzing CPU 0:
>   driver: intel_pstate
>   CPUs which run at the same hardware frequency: 0
>   CPUs which need to have their frequency coordinated by software: 0
>   maximum transition latency:  Cannot determine or is not supported.
>   hardware limits: 1.20 GHz - 2.90 GHz
>   available cpufreq governors: performance powersave
>   current policy: frequency should be within 1.20 GHz and 2.90 GHz.
>                   The governor "powersave" may decide which speed to use
>                   within this range.
>   current CPU frequency: Unable to call hardware
>   current CPU frequency: 1.20 GHz (asserted by call to kernel)
>   boost state support:
>     Supported: yes
>     Active: yes
> 
> 
> root@server-9:~# grep . /sys/devices/system/cpu/cpu*/cpufreq/* > grep.out
> /sys/devices/system/cpu/cpu0/cpufreq/affected_cpus:0
> /sys/devices/system/cpu/cpu0/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu0/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu0/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu0/cpufreq/related_cpus:0
> /sys/devices/system/cpu/cpu0/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu0/cpufreq/scaling_cur_freq:1200504
> /sys/devices/system/cpu/cpu0/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu0/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu0/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu0/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu10/cpufreq/affected_cpus:10
> /sys/devices/system/cpu/cpu10/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu10/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu10/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu10/cpufreq/related_cpus:10
> /sys/devices/system/cpu/cpu10/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu10/cpufreq/scaling_cur_freq:1200009
> /sys/devices/system/cpu/cpu10/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu10/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu10/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu10/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu10/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu11/cpufreq/affected_cpus:11
> /sys/devices/system/cpu/cpu11/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu11/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu11/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu11/cpufreq/related_cpus:11
> /sys/devices/system/cpu/cpu11/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu11/cpufreq/scaling_cur_freq:1199611
> /sys/devices/system/cpu/cpu11/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu11/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu11/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu11/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu11/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu12/cpufreq/affected_cpus:12
> /sys/devices/system/cpu/cpu12/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu12/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu12/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu12/cpufreq/related_cpus:12
> /sys/devices/system/cpu/cpu12/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu12/cpufreq/scaling_cur_freq:1201893
> /sys/devices/system/cpu/cpu12/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu12/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu12/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu12/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu12/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu13/cpufreq/affected_cpus:13
> /sys/devices/system/cpu/cpu13/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu13/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu13/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu13/cpufreq/related_cpus:13
> /sys/devices/system/cpu/cpu13/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu13/cpufreq/scaling_cur_freq:1199616
> /sys/devices/system/cpu/cpu13/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu13/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu13/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu13/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu13/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu14/cpufreq/affected_cpus:14
> /sys/devices/system/cpu/cpu14/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu14/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu14/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu14/cpufreq/related_cpus:14
> /sys/devices/system/cpu/cpu14/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu14/cpufreq/scaling_cur_freq:1199811
> /sys/devices/system/cpu/cpu14/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu14/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu14/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu14/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu14/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu15/cpufreq/affected_cpus:15
> /sys/devices/system/cpu/cpu15/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu15/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu15/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu15/cpufreq/related_cpus:15
> /sys/devices/system/cpu/cpu15/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu15/cpufreq/scaling_cur_freq:1200391
> /sys/devices/system/cpu/cpu15/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu15/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu15/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu15/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu15/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu16/cpufreq/affected_cpus:16
> /sys/devices/system/cpu/cpu16/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu16/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu16/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu16/cpufreq/related_cpus:16
> /sys/devices/system/cpu/cpu16/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu16/cpufreq/scaling_cur_freq:1201687
> /sys/devices/system/cpu/cpu16/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu16/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu16/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu16/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu16/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu17/cpufreq/affected_cpus:17
> /sys/devices/system/cpu/cpu17/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu17/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu17/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu17/cpufreq/related_cpus:17
> /sys/devices/system/cpu/cpu17/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu17/cpufreq/scaling_cur_freq:1199821
> /sys/devices/system/cpu/cpu17/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu17/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu17/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu17/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu17/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu18/cpufreq/affected_cpus:18
> /sys/devices/system/cpu/cpu18/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu18/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu18/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu18/cpufreq/related_cpus:18
> /sys/devices/system/cpu/cpu18/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu18/cpufreq/scaling_cur_freq:1201697
> /sys/devices/system/cpu/cpu18/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu18/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu18/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu18/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu18/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu19/cpufreq/affected_cpus:19
> /sys/devices/system/cpu/cpu19/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu19/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu19/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu19/cpufreq/related_cpus:19
> /sys/devices/system/cpu/cpu19/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu19/cpufreq/scaling_cur_freq:1199860
> /sys/devices/system/cpu/cpu19/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu19/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu19/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu19/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu19/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu1/cpufreq/affected_cpus:1
> /sys/devices/system/cpu/cpu1/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu1/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu1/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu1/cpufreq/related_cpus:1
> /sys/devices/system/cpu/cpu1/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu1/cpufreq/scaling_cur_freq:1200551
> /sys/devices/system/cpu/cpu1/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu1/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu1/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu1/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu2/cpufreq/affected_cpus:2
> /sys/devices/system/cpu/cpu2/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu2/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu2/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu2/cpufreq/related_cpus:2
> /sys/devices/system/cpu/cpu2/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu2/cpufreq/scaling_cur_freq:1200108
> /sys/devices/system/cpu/cpu2/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu2/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu2/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu2/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu2/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu3/cpufreq/affected_cpus:3
> /sys/devices/system/cpu/cpu3/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu3/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu3/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu3/cpufreq/related_cpus:3
> /sys/devices/system/cpu/cpu3/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu3/cpufreq/scaling_cur_freq:1200348
> /sys/devices/system/cpu/cpu3/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu3/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu3/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu3/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu3/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu4/cpufreq/affected_cpus:4
> /sys/devices/system/cpu/cpu4/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu4/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu4/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu4/cpufreq/related_cpus:4
> /sys/devices/system/cpu/cpu4/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu4/cpufreq/scaling_cur_freq:1199638
> /sys/devices/system/cpu/cpu4/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu4/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu4/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu4/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu4/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu5/cpufreq/affected_cpus:5
> /sys/devices/system/cpu/cpu5/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu5/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu5/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu5/cpufreq/related_cpus:5
> /sys/devices/system/cpu/cpu5/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu5/cpufreq/scaling_cur_freq:1200009
> /sys/devices/system/cpu/cpu5/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu5/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu5/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu5/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu5/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu6/cpufreq/affected_cpus:6
> /sys/devices/system/cpu/cpu6/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu6/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu6/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu6/cpufreq/related_cpus:6
> /sys/devices/system/cpu/cpu6/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu6/cpufreq/scaling_cur_freq:1201640
> /sys/devices/system/cpu/cpu6/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu6/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu6/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu6/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu6/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu7/cpufreq/affected_cpus:7
> /sys/devices/system/cpu/cpu7/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu7/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu7/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu7/cpufreq/related_cpus:7
> /sys/devices/system/cpu/cpu7/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu7/cpufreq/scaling_cur_freq:1200009
> /sys/devices/system/cpu/cpu7/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu7/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu7/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu7/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu7/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu8/cpufreq/affected_cpus:8
> /sys/devices/system/cpu/cpu8/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu8/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu8/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu8/cpufreq/related_cpus:8
> /sys/devices/system/cpu/cpu8/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu8/cpufreq/scaling_cur_freq:1201718
> /sys/devices/system/cpu/cpu8/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu8/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu8/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu8/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu8/cpufreq/scaling_setspeed:<unsupported>
> /sys/devices/system/cpu/cpu9/cpufreq/affected_cpus:9
> /sys/devices/system/cpu/cpu9/cpufreq/cpuinfo_max_freq:2900000
> /sys/devices/system/cpu/cpu9/cpufreq/cpuinfo_min_freq:1200000
> /sys/devices/system/cpu/cpu9/cpufreq/cpuinfo_transition_latency:0
> /sys/devices/system/cpu/cpu9/cpufreq/related_cpus:9
> /sys/devices/system/cpu/cpu9/cpufreq/scaling_available_governors:performance powersave
> /sys/devices/system/cpu/cpu9/cpufreq/scaling_cur_freq:1199679
> /sys/devices/system/cpu/cpu9/cpufreq/scaling_driver:intel_pstate
> /sys/devices/system/cpu/cpu9/cpufreq/scaling_governor:powersave
> /sys/devices/system/cpu/cpu9/cpufreq/scaling_max_freq:2900000
> /sys/devices/system/cpu/cpu9/cpufreq/scaling_min_freq:1200000
> /sys/devices/system/cpu/cpu9/cpufreq/scaling_setspeed:<unsupported>
> 
> 
> 
> 
> ***************
> With maxcpus=20
> ***************
> 
> root@server-9:~# sensors
> coretemp-isa-0000
> Adapter: ISA adapter
> Package id 0:  +45.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 0:        +39.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 1:        +39.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 2:        +39.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 3:        +39.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 4:        +39.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 8:        +40.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 9:        +39.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 10:       +39.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 11:       +38.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 12:       +40.0°C  (high = +61.0°C, crit = +71.0°C)
> 
> coretemp-isa-0001
> Adapter: ISA adapter
> Package id 1:  +42.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 0:        +36.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 1:        +36.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 2:        +35.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 3:        +36.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 4:        +37.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 8:        +35.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 9:        +35.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 10:       +35.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 11:       +35.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 12:       +35.0°C  (high = +61.0°C, crit = +71.0°C)
> 
> 
> ***************************************************************************
> Without maxcpus on a different server with the same hardware (typical case)
> ***************************************************************************
> 
> root@server-25:~$ sensors
> coretemp-isa-0000
> Adapter: ISA adapter
> Package id 0:  +31.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 0:        +24.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 1:        +24.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 2:        +24.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 3:        +25.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 4:        +25.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 8:        +25.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 9:        +25.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 10:       +23.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 11:       +23.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 12:       +25.0°C  (high = +61.0°C, crit = +71.0°C)
> 
> coretemp-isa-0001
> Adapter: ISA adapter
> Package id 1:  +28.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 0:        +22.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 1:        +22.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 2:        +22.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 3:        +23.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 4:        +23.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 8:        +22.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 9:        +23.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 10:       +22.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 11:       +22.0°C  (high = +61.0°C, crit = +71.0°C)
> Core 12:       +22.0°C  (high = +61.0°C, crit = +71.0°C)

> turbostat version 18.07.27 - Len Brown <lenb@kernel.org>
> cpu 0 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 1 pkg 1 node 1 lnode 0 core 0 thread 0
> cpu 2 pkg 0 node 0 lnode 0 core 1 thread 0
> cpu 3 pkg 1 node 1 lnode 0 core 1 thread 0
> cpu 4 pkg 0 node 0 lnode 0 core 2 thread 0
> cpu 5 pkg 1 node 1 lnode 0 core 2 thread 0
> cpu 6 pkg 0 node 0 lnode 0 core 3 thread 0
> cpu 7 pkg 1 node 1 lnode 0 core 3 thread 0
> cpu 8 pkg 0 node 0 lnode 0 core 4 thread 0
> cpu 9 pkg 1 node 1 lnode 0 core 4 thread 0
> cpu 10 pkg 0 node 0 lnode 0 core 8 thread 0
> cpu 11 pkg 1 node 1 lnode 0 core 8 thread 0
> cpu 12 pkg 0 node 0 lnode 0 core 9 thread 0
> cpu 13 pkg 1 node 1 lnode 0 core 9 thread 0
> cpu 14 pkg 0 node 0 lnode 0 core 10 thread 0
> cpu 15 pkg 1 node 1 lnode 0 core 10 thread 0
> cpu 16 pkg 0 node 0 lnode 0 core 11 thread 0
> cpu 17 pkg 1 node 1 lnode 0 core 11 thread 0
> cpu 18 pkg 0 node 0 lnode 0 core 12 thread 0
> cpu 19 pkg 1 node 1 lnode 0 core 12 thread 0
> cpu 20 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 21 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 22 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 23 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 24 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 25 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 26 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 27 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 28 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 29 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 30 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 31 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 32 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 33 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 34 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 35 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 36 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 37 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 38 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 39 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 40 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 41 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 42 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 43 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 44 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 45 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 46 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 47 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 48 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 49 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 50 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 51 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 52 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 53 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 54 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 55 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 56 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 57 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 58 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 59 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 60 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 61 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 62 pkg 0 node 0 lnode 0 core 0 thread 0
> cpu 63 pkg 0 node 0 lnode 0 core 0 thread 0
> CPUID(0): GenuineIntel 0x14 CPUID levels; 0x80000008 xlevels; family:model:stepping 0x6:4f:1 (6:79:1)
> CPUID(1): SSE3 MONITOR SMX EIST TM2 TSC MSR ACPI-TM HT TM
> CPUID(6): APERF, TURBO, DTS, PTM, No-HWP, No-HWPnotify, No-HWPwindow, No-HWPepp, No-HWPpkg, EPB
> cpu2: MSR_IA32_MISC_ENABLE: 0x00850089 (TCC EIST MWAIT PREFETCH TURBO)
> CPUID(7): No-SGX
> cpu2: MSR_MISC_PWR_MGMT: 0x00402000 (ENable-EIST_Coordination DISable-EPB DISable-OOB)
> RAPL: 4766 sec. Joule Counter Range, at 55 Watts
> cpu2: MSR_PLATFORM_INFO: 0x20080c3bf2811200
> 12 * 100.0 = 1200.0 MHz max efficiency frequency
> 18 * 100.0 = 1800.0 MHz base frequency
> cpu2: MSR_IA32_POWER_CTL: 0x29240059 (C1E auto-promotion: DISabled)
> cpu2: MSR_TURBO_RATIO_LIMIT: 0x161718191a1b1d1d
> 22 * 100.0 = 2200.0 MHz max turbo 8 active cores
> 23 * 100.0 = 2300.0 MHz max turbo 7 active cores
> 24 * 100.0 = 2400.0 MHz max turbo 6 active cores
> 25 * 100.0 = 2500.0 MHz max turbo 5 active cores
> 26 * 100.0 = 2600.0 MHz max turbo 4 active cores
> 27 * 100.0 = 2700.0 MHz max turbo 3 active cores
> 29 * 100.0 = 2900.0 MHz max turbo 2 active cores
> 29 * 100.0 = 2900.0 MHz max turbo 1 active cores
> cpu2: MSR_CONFIG_TDP_NOMINAL: 0x00000012 (base_ratio=18)
> cpu2: MSR_CONFIG_TDP_LEVEL_1: 0x840370000d01b8 (PKG_MIN_PWR_LVL1=132 PKG_MAX_PWR_LVL1=880 LVL1_RATIO=13 PKG_TDP_LVL1=440)
> cpu2: MSR_CONFIG_TDP_LEVEL_2: 0x84037000000000 (PKG_MIN_PWR_LVL2=132 PKG_MAX_PWR_LVL2=880 LVL2_RATIO=0 PKG_TDP_LVL2=0)
> cpu2: MSR_CONFIG_TDP_CONTROL: 0x00000000 ( lock=0)
> cpu2: MSR_TURBO_ACTIVATION_RATIO: 0x00000012 (MAX_NON_TURBO_RATIO=18 lock=0)
> cpu2: MSR_PKG_CST_CONFIG_CONTROL: 0x00008403 (locked, pkg-cstate-limit=3 (pc6), automatic c-state conversion=off)
> cpu2: POLL: CPUIDLE CORE POLL IDLE
> cpu2: C1: MWAIT 0x00
> cpu2: C1E: MWAIT 0x01
> cpu2: C3: MWAIT 0x10
> cpu2: C6: MWAIT 0x20
> cpu2: cpufreq driver: intel_pstate
> cpu2: cpufreq governor: powersave
> cpufreq intel_pstate no_turbo: 0
> cpu2: MSR_MISC_FEATURE_CONTROL: 0x00000000 (L2-Prefetch L2-Prefetch-pair L1-Prefetch L1-IP-Prefetch)
> cpu0: MSR_IA32_ENERGY_PERF_BIAS: 0x00000007 (custom)
> cpu1: MSR_IA32_ENERGY_PERF_BIAS: 0x00000007 (custom)
> cpu0: MSR_RAPL_POWER_UNIT: 0x000a0e03 (0.125000 Watts, 0.000061 Joules, 0.000977 sec.)
> cpu0: MSR_PKG_POWER_INFO: 0x2f0370010801b8 (55 W TDP, RAPL 33 - 110 W, 0.045898 sec.)
> cpu0: MSR_PKG_POWER_LIMIT: 0x80068210005a81b8 (locked)
> cpu0: PKG Limit #1: ENabled (55.000000 Watts, 10.000000 sec, clamp DISabled)
> cpu0: PKG Limit #2: ENabled (66.000000 Watts, 0.007812* sec, clamp DISabled)
> cpu0: MSR_DRAM_POWER_INFO,: 0x2f00a20016009c (20 W TDP, RAPL 3 - 20 W, 0.045898 sec.)
> cpu0: MSR_DRAM_POWER_LIMIT: 0x80000000 (locked)
> cpu0: DRAM Limit: DISabled (0.000000 Watts, 0.000977 sec, clamp DISabled)
> cpu1: MSR_RAPL_POWER_UNIT: 0x000a0e03 (0.125000 Watts, 0.000061 Joules, 0.000977 sec.)
> cpu1: MSR_PKG_POWER_INFO: 0x2f0370010801b8 (55 W TDP, RAPL 33 - 110 W, 0.045898 sec.)
> cpu1: MSR_PKG_POWER_LIMIT: 0x80068210005a81b8 (locked)
> cpu1: PKG Limit #1: ENabled (55.000000 Watts, 10.000000 sec, clamp DISabled)
> cpu1: PKG Limit #2: ENabled (66.000000 Watts, 0.007812* sec, clamp DISabled)
> cpu1: MSR_DRAM_POWER_INFO,: 0x2f00a20016009c (20 W TDP, RAPL 3 - 20 W, 0.045898 sec.)
> cpu1: MSR_DRAM_POWER_LIMIT: 0x80000000 (locked)
> cpu1: DRAM Limit: DISabled (0.000000 Watts, 0.000977 sec, clamp DISabled)
> cpu0: MSR_IA32_TEMPERATURE_TARGET: 0x00470a00 (71 C)
> cpu1: MSR_IA32_TEMPERATURE_TARGET: 0x00470a00 (71 C)
> cpu0: MSR_IA32_PACKAGE_THERM_STATUS: 0x881a0000 (45 C)
> cpu0: MSR_IA32_PACKAGE_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu0: MSR_IA32_THERM_STATUS: 0x881f0000 (40 C +/- 1)
> cpu0: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu2: MSR_IA32_THERM_STATUS: 0x881f0000 (40 C +/- 1)
> cpu2: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu4: MSR_IA32_THERM_STATUS: 0x881f0000 (40 C +/- 1)
> cpu4: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu6: MSR_IA32_THERM_STATUS: 0x88200000 (39 C +/- 1)
> cpu6: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu8: MSR_IA32_THERM_STATUS: 0x88200000 (39 C +/- 1)
> cpu8: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu10: MSR_IA32_THERM_STATUS: 0x881f0000 (40 C +/- 1)
> cpu10: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu12: MSR_IA32_THERM_STATUS: 0x881f0000 (40 C +/- 1)
> cpu12: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu14: MSR_IA32_THERM_STATUS: 0x88200000 (39 C +/- 1)
> cpu14: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu16: MSR_IA32_THERM_STATUS: 0x881f0000 (40 C +/- 1)
> cpu16: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu18: MSR_IA32_THERM_STATUS: 0x881f0000 (40 C +/- 1)
> cpu18: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu1: MSR_IA32_PACKAGE_THERM_STATUS: 0x881d0000 (42 C)
> cpu1: MSR_IA32_PACKAGE_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu1: MSR_IA32_THERM_STATUS: 0x88230000 (36 C +/- 1)
> cpu1: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu3: MSR_IA32_THERM_STATUS: 0x88240000 (35 C +/- 1)
> cpu3: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu5: MSR_IA32_THERM_STATUS: 0x88230000 (36 C +/- 1)
> cpu5: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu7: MSR_IA32_THERM_STATUS: 0x88240000 (35 C +/- 1)
> cpu7: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu9: MSR_IA32_THERM_STATUS: 0x88230000 (36 C +/- 1)
> cpu9: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu11: MSR_IA32_THERM_STATUS: 0x88230000 (36 C +/- 1)
> cpu11: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu13: MSR_IA32_THERM_STATUS: 0x88240000 (35 C +/- 1)
> cpu13: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu15: MSR_IA32_THERM_STATUS: 0x88240000 (35 C +/- 1)
> cpu15: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu17: MSR_IA32_THERM_STATUS: 0x88240000 (35 C +/- 1)
> cpu17: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu19: MSR_IA32_THERM_STATUS: 0x88240000 (35 C +/- 1)
> cpu19: MSR_IA32_THERM_INTERRUPT: 0x00000003 (71 C, 71 C)
> cpu2: MSR_PKGC3_IRTL: 0x00000000 (NOTvalid, 0 ns)
> cpu2: MSR_PKGC6_IRTL: 0x00000000 (NOTvalid, 0 ns)
> cpu2: MSR_PKGC7_IRTL: 0x00000000 (NOTvalid, 0 ns)
> usec	Time_Of_Day_Seconds	Package	Core	CPU	APIC	X2APIC	Avg_MHz	Busy%	Bzy_MHz	TSC_MHz	IRQ	SMI	POLL	C1	C1E	C3	C6	POLL%	C1%	C1E%	C3%	C6%	CPU%c1	CPU%c3	CPU%c6	CoreTmp	PkgTmp	Pkg%pc2	Pkg%pc3	Pkg%pc6	PkgWatt	RAMWatt	PKG_%	RAM_%
>  3531	1587512452.188608	-	-	-	-	-	0	0.01	1220	1800	403	0	0	0	8	2	430	0.00	0.00	0.03	0.00	99.96	99.99	0.00	0.00	40	46	0.00	0.00	0.00	39.08	6.51	0.00	0.00
>   219	1587512452.185296	0	0	0	0	0	0	0.03	1200	1800	56	0	0	0	0	1	54	0.00	0.00	0.00	0.01	99.97	99.97	0.00	0.00	40	46	0.00	0.00	0.00	20.44	3.38	0.00	0.00
>   179	1587512452.185475	0	1	2	2	2	0	0.01	1573	1800	11	0	0	0	0	1	12	0.00	0.00	0.00	0.01	99.99	99.99	0.00	0.00	39
>   177	1587512452.185653	0	2	4	4	4	0	0.01	1200	1800	9	0	0	0	1	0	10	0.00	0.00	0.00	0.00	100.00	99.99	0.00	0.00	40
>   190	1587512452.185843	0	3	6	6	6	0	0.01	1200	1800	21	0	0	0	0	0	22	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40
>   138	1587512452.185982	0	4	8	8	8	0	0.01	1364	1800	32	0	0	0	0	0	34	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   170	1587512452.186152	0	8	10	16	16	0	0.01	1200	1800	18	0	0	0	0	0	19	0.00	0.00	0.00	0.00	100.00	99.99	0.00	0.00	40
>   172	1587512452.186324	0	9	12	18	18	0	0.01	1200	1800	21	0	0	0	0	0	23	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40
>   175	1587512452.186499	0	10	14	20	20	0	0.01	1200	1800	18	0	0	0	0	0	20	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   173	1587512452.186673	0	11	16	22	22	0	0.01	1200	1800	29	0	0	0	7	0	24	0.00	0.00	0.56	0.00	99.43	99.99	0.00	0.00	39
>   174	1587512452.186847	0	12	18	24	24	0	0.01	1200	1800	10	0	0	0	0	0	12	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40
>   196	1587512452.187043	1	0	1	32	32	0	0.01	1200	1800	19	0	0	0	0	0	21	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	36	42	0.00	0.00	0.00	18.64	3.13	0.00	0.00
>   172	1587512452.187215	1	1	3	34	34	0	0.01	1200	1800	25	0	0	0	0	0	27	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   170	1587512452.187386	1	2	5	36	36	0	0.01	1200	1800	24	0	0	0	0	0	25	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	36
>   169	1587512452.187556	1	3	7	38	38	0	0.01	1200	1800	11	0	0	0	0	0	12	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   173	1587512452.187730	1	4	9	40	40	0	0.01	1200	1800	12	0	0	0	0	0	13	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	36
>   170	1587512452.187900	1	8	11	48	48	0	0.01	1200	1800	22	0	0	0	0	0	24	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   187	1587512452.188087	1	9	13	50	50	0	0.01	1200	1800	11	0	0	0	0	0	13	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   177	1587512452.188264	1	10	15	52	52	0	0.01	1200	1800	10	0	0	0	0	0	12	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   169	1587512452.188433	1	11	17	54	54	0	0.01	1200	1800	24	0	0	0	0	0	26	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   175	1587512452.188608	1	12	19	56	56	0	0.03	1200	1800	20	0	0	0	0	0	27	0.00	0.00	0.00	0.00	99.97	99.97	0.00	0.00	35
> usec	Time_Of_Day_Seconds	Package	Core	CPU	APIC	X2APIC	Avg_MHz	Busy%	Bzy_MHz	TSC_MHz	IRQ	SMI	POLL	C1	C1E	C3	C6	POLL%	C1%	C1E%	C3%	C6%	CPU%c1	CPU%c3	CPU%c6	CoreTmp	PkgTmp	Pkg%pc2	Pkg%pc3	Pkg%pc6	PkgWatt	RAMWatt	PKG_%	RAM_%
>  3515	1587512457.198454	-	-	-	-	-	0	0.01	1223	1800	414	0	0	1	2	4	444	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40	45	0.00	0.00	0.00	39.11	6.51	0.00	0.00
>   196	1587512457.195135	0	0	0	0	0	0	0.02	1200	1800	58	0	0	0	0	0	59	0.00	0.00	0.00	0.00	99.98	99.98	0.00	0.00	40	45	0.00	0.00	0.00	20.45	3.39	0.00	0.00
>   184	1587512457.195320	0	1	2	2	2	0	0.01	1240	1800	31	0	0	0	2	0	33	0.00	0.00	0.02	0.00	99.97	99.99	0.00	0.00	39
>   173	1587512457.195494	0	2	4	4	4	0	0.01	1200	1800	26	0	0	0	0	0	28	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   197	1587512457.195692	0	3	6	6	6	0	0.02	1200	1800	30	0	0	0	0	0	33	0.00	0.00	0.00	0.00	99.98	99.98	0.00	0.00	40
>   141	1587512457.195833	0	4	8	8	8	0	0.01	1557	1800	26	0	0	0	0	0	29	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   181	1587512457.196014	0	8	10	16	16	0	0.01	1200	1800	10	0	0	0	0	0	12	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40
>   169	1587512457.196184	0	9	12	18	18	0	0.01	1200	1800	22	0	0	0	0	0	23	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40
>   171	1587512457.196355	0	10	14	20	20	0	0.01	1200	1800	9	0	0	0	0	0	10	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   193	1587512457.196549	0	11	16	22	22	0	0.01	1200	1800	19	0	0	0	0	0	19	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   179	1587512457.196729	0	12	18	24	24	0	0.01	1200	1800	10	0	0	0	0	0	12	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   192	1587512457.196921	1	0	1	32	32	0	0.01	1200	1800	12	0	0	0	0	0	13	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	36	41	0.00	0.00	0.00	18.66	3.13	0.00	0.00
>   170	1587512457.197092	1	1	3	34	34	0	0.02	1200	1800	22	0	0	0	0	1	24	0.00	0.00	0.00	0.01	99.97	99.98	0.00	0.00	35
>   169	1587512457.197261	1	2	5	36	36	0	0.01	1200	1800	14	0	0	0	0	1	15	0.00	0.00	0.00	0.01	99.98	99.99	0.00	0.00	36
>   168	1587512457.197429	1	3	7	38	38	0	0.01	1200	1800	13	0	0	0	0	1	14	0.00	0.00	0.00	0.01	99.99	99.99	0.00	0.00	35
>   168	1587512457.197597	1	4	9	40	40	0	0.01	1200	1800	13	0	0	0	0	1	14	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   176	1587512457.197773	1	8	11	48	48	0	0.01	1200	1800	13	0	0	1	0	0	14	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   166	1587512457.197940	1	9	13	50	50	0	0.01	1200	1800	21	0	0	0	0	0	21	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   167	1587512457.198107	1	10	15	52	52	0	0.01	1200	1800	20	0	0	0	0	0	21	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	36
>   167	1587512457.198274	1	11	17	54	54	0	0.01	1200	1800	21	0	0	0	0	0	22	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   179	1587512457.198454	1	12	19	56	56	0	0.04	1200	1800	24	0	0	0	0	0	28	0.00	0.00	0.00	0.00	99.96	99.96	0.00	0.00	36
> usec	Time_Of_Day_Seconds	Package	Core	CPU	APIC	X2APIC	Avg_MHz	Busy%	Bzy_MHz	TSC_MHz	IRQ	SMI	POLL	C1	C1E	C3	C6	POLL%	C1%	C1E%	C3%	C6%	CPU%c1	CPU%c3	CPU%c6	CoreTmp	PkgTmp	Pkg%pc2	Pkg%pc3	Pkg%pc6	PkgWatt	RAMWatt	PKG_%	RAM_%
>  3457	1587512462.208333	-	-	-	-	-	0	0.01	1213	1800	431	0	0	0	8	2	450	0.00	0.00	0.02	0.00	99.96	99.99	0.00	0.00	40	46	0.00	0.00	0.00	39.06	6.51	0.00	0.00
>   196	1587512462.205072	0	0	0	0	0	0	0.02	1200	1800	53	0	0	0	6	0	47	0.00	0.00	0.48	0.00	99.50	99.98	0.00	0.00	40	46	0.00	0.00	0.00	20.44	3.39	0.00	0.00
>   172	1587512462.205244	0	1	2	2	2	0	0.01	1200	1800	8	0	0	0	0	1	8	0.00	0.00	0.00	0.01	99.98	99.99	0.00	0.00	39
>   170	1587512462.205414	0	2	4	4	4	0	0.01	1200	1800	10	0	0	0	0	1	10	0.00	0.00	0.00	0.01	99.99	99.99	0.00	0.00	39
>   192	1587512462.205606	0	3	6	6	6	0	0.01	1200	1800	11	0	0	0	1	0	10	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   131	1587512462.205737	0	4	8	8	8	0	0.01	1585	1800	13	0	0	0	1	0	14	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   173	1587512462.205910	0	8	10	16	16	0	0.01	1200	1800	22	0	0	0	0	0	22	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40
>   170	1587512462.206088	0	9	12	18	18	0	0.01	1200	1800	23	0	0	0	0	0	25	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40
>   171	1587512462.206259	0	10	14	20	20	0	0.01	1200	1800	24	0	0	0	0	0	26	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   172	1587512462.206431	0	11	16	22	22	0	0.01	1200	1800	24	0	0	0	0	0	26	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   173	1587512462.206604	0	12	18	24	24	0	0.01	1200	1800	22	0	0	0	0	0	24	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40
>   198	1587512462.206802	1	0	1	32	32	0	0.01	1200	1800	20	0	0	0	0	0	22	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	36	42	0.00	0.00	0.00	18.63	3.13	0.00	0.00
>   169	1587512462.206972	1	1	3	34	34	0	0.01	1200	1800	26	0	0	0	0	0	28	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   166	1587512462.207138	1	2	5	36	36	0	0.01	1200	1800	27	0	0	0	0	0	28	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	36
>   168	1587512462.207306	1	3	7	38	38	0	0.01	1200	1800	21	0	0	0	0	0	22	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   168	1587512462.207474	1	4	9	40	40	0	0.01	1200	1800	24	0	0	0	0	0	25	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   168	1587512462.207642	1	8	11	48	48	0	0.01	1200	1800	26	0	0	0	0	0	27	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   167	1587512462.207809	1	9	13	50	50	0	0.01	1200	1800	23	0	0	0	0	0	25	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   180	1587512462.207989	1	10	15	52	52	0	0.01	1200	1800	24	0	0	0	0	0	26	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   167	1587512462.208156	1	11	17	54	54	0	0.01	1200	1800	12	0	0	0	0	0	14	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	36
>   176	1587512462.208333	1	12	19	56	56	0	0.04	1200	1800	18	0	0	0	0	0	21	0.00	0.00	0.00	0.00	99.96	99.96	0.00	0.00	36
> usec	Time_Of_Day_Seconds	Package	Core	CPU	APIC	X2APIC	Avg_MHz	Busy%	Bzy_MHz	TSC_MHz	IRQ	SMI	POLL	C1	C1E	C3	C6	POLL%	C1%	C1E%	C3%	C6%	CPU%c1	CPU%c3	CPU%c6	CoreTmp	PkgTmp	Pkg%pc2	Pkg%pc3	Pkg%pc6	PkgWatt	RAMWatt	PKG_%	RAM_%
>  3463	1587512467.218085	-	-	-	-	-	0	0.01	1217	1800	397	0	0	0	3	2	426	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40	46	0.00	0.00	0.00	39.07	6.52	0.00	0.00
>   197	1587512467.214819	0	0	0	0	0	0	0.02	1200	1800	55	0	0	0	0	0	56	0.00	0.00	0.00	0.00	99.98	99.98	0.00	0.00	40	46	0.00	0.00	0.00	20.45	3.39	0.00	0.00
>   179	1587512467.214998	0	1	2	2	2	0	0.01	1255	1800	20	0	0	0	2	0	21	0.00	0.00	0.02	0.00	99.97	99.99	0.00	0.00	39
>   173	1587512467.215171	0	2	4	4	4	0	0.01	1200	1800	20	0	0	0	0	0	22	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40
>   193	1587512467.215364	0	3	6	6	6	0	0.01	1200	1800	30	0	0	0	0	0	33	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   132	1587512467.215496	0	4	8	8	8	0	0.01	1446	1800	39	0	0	0	0	0	42	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   168	1587512467.215664	0	8	10	16	16	0	0.01	1200	1800	26	0	0	0	0	0	28	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40
>   167	1587512467.215831	0	9	12	18	18	0	0.01	1200	1800	24	0	0	0	0	0	25	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40
>   182	1587512467.216013	0	10	14	20	20	0	0.01	1200	1800	10	0	0	0	0	0	11	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   173	1587512467.216186	0	11	16	22	22	0	0.01	1200	1800	13	0	0	0	0	0	14	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   175	1587512467.216361	0	12	18	24	24	0	0.01	1200	1800	11	0	0	0	0	0	12	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40
>   192	1587512467.216553	1	0	1	32	32	0	0.01	1200	1800	12	0	0	0	0	0	13	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	36	42	0.00	0.00	0.00	18.62	3.13	0.00	0.00
>   172	1587512467.216725	1	1	3	34	34	0	0.01	1200	1800	13	0	0	0	0	0	16	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   168	1587512467.216893	1	2	5	36	36	0	0.01	1200	1800	13	0	0	0	0	0	15	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   168	1587512467.217061	1	3	7	38	38	0	0.01	1200	1800	13	0	0	0	0	0	15	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   166	1587512467.217227	1	4	9	40	40	0	0.01	1200	1800	12	0	0	0	0	1	13	0.00	0.00	0.00	0.01	99.98	99.99	0.00	0.00	36
>   168	1587512467.217395	1	8	11	48	48	0	0.01	1200	1800	12	0	0	0	0	1	13	0.00	0.00	0.00	0.01	99.99	99.99	0.00	0.00	36
>   167	1587512467.217562	1	9	13	50	50	0	0.01	1200	1800	25	0	0	0	1	0	25	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   177	1587512467.217739	1	10	15	52	52	0	0.01	1200	1800	19	0	0	0	0	0	19	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   168	1587512467.217907	1	11	17	54	54	0	0.01	1200	1800	18	0	0	0	0	0	19	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   178	1587512467.218085	1	12	19	56	56	0	0.03	1200	1800	12	0	0	0	0	0	14	0.00	0.00	0.00	0.00	99.97	99.97	0.00	0.00	36
> usec	Time_Of_Day_Seconds	Package	Core	CPU	APIC	X2APIC	Avg_MHz	Busy%	Bzy_MHz	TSC_MHz	IRQ	SMI	POLL	C1	C1E	C3	C6	POLL%	C1%	C1E%	C3%	C6%	CPU%c1	CPU%c3	CPU%c6	CoreTmp	PkgTmp	Pkg%pc2	Pkg%pc3	Pkg%pc6	PkgWatt	RAMWatt	PKG_%	RAM_%
>  3433	1587512472.227928	-	-	-	-	-	0	0.01	1216	1800	438	0	0	15	16	3	436	0.00	0.06	0.06	0.00	99.88	99.99	0.00	0.00	40	46	0.00	0.00	0.00	39.04	6.51	0.00	0.00
>   196	1587512472.224691	0	0	0	0	0	0	0.02	1200	1800	52	0	0	0	7	0	45	0.00	0.00	0.56	0.00	99.42	99.98	0.00	0.00	40	46	0.00	0.00	0.00	20.43	3.38	0.00	0.00
>   179	1587512472.224871	0	1	2	2	2	0	0.01	1259	1800	17	0	0	1	1	0	18	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   171	1587512472.225042	0	2	4	4	4	0	0.01	1200	1800	10	0	0	0	0	0	11	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   192	1587512472.225235	0	3	6	6	6	0	0.01	1200	1800	14	0	0	0	0	1	15	0.00	0.00	0.00	0.01	99.98	99.99	0.00	0.00	39
>   132	1587512472.225367	0	4	8	8	8	0	0.01	1589	1800	14	0	0	0	0	1	15	0.00	0.00	0.00	0.01	99.98	99.99	0.00	0.00	39
>   167	1587512472.225534	0	8	10	16	16	0	0.01	1200	1800	9	0	0	0	0	1	9	0.00	0.00	0.00	0.01	99.99	99.99	0.00	0.00	40
>   168	1587512472.225703	0	9	12	18	18	0	0.01	1200	1800	19	0	0	0	1	0	20	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	40
>   167	1587512472.225871	0	10	14	20	20	0	0.01	1200	1800	21	0	0	0	0	0	22	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	39
>   170	1587512472.226042	0	11	16	22	22	0	0.01	1200	1800	30	0	0	0	7	0	25	0.00	0.00	0.56	0.00	99.43	99.99	0.00	0.00	39
>   174	1587512472.226216	0	12	18	24	24	0	0.01	1200	1800	31	0	0	7	0	0	26	0.00	0.56	0.00	0.00	99.43	99.99	0.00	0.00	40
>   192	1587512472.226409	1	0	1	32	32	0	0.01	1200	1800	22	0	0	0	0	0	24	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	36	41	0.00	0.00	0.00	18.60	3.12	0.00	0.00
>   169	1587512472.226578	1	1	3	34	34	0	0.01	1200	1800	21	0	0	0	0	0	23	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   168	1587512472.226746	1	2	5	36	36	0	0.01	1200	1800	25	0	0	0	0	0	26	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	36
>   167	1587512472.226913	1	3	7	38	38	0	0.01	1200	1800	24	0	0	0	0	0	25	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   167	1587512472.227080	1	4	9	40	40	0	0.01	1200	1800	21	0	0	0	0	0	22	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	36
>   167	1587512472.227247	1	8	11	48	48	0	0.01	1200	1800	21	0	0	0	0	0	22	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	36
>   167	1587512472.227415	1	9	13	50	50	0	0.01	1200	1800	31	0	0	7	0	0	26	0.00	0.56	0.00	0.00	99.43	99.99	0.00	0.00	35
>   168	1587512472.227583	1	10	15	52	52	0	0.01	1200	1800	23	0	0	0	0	0	25	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   168	1587512472.227751	1	11	17	54	54	0	0.01	1200	1800	13	0	0	0	0	0	15	0.00	0.00	0.00	0.00	99.99	99.99	0.00	0.00	35
>   177	1587512472.227928	1	12	19	56	56	0	0.04	1200	1800	20	0	0	0	0	0	22	0.00	0.00	0.00	0.00	99.96	99.96	0.00	0.00	36







-- 
Looking after bugs filled against unknown packages

Attachment: signature.asc
Description: PGP signature


Reply to: