Tuesday, 15 August 2017

linux-4.12-ck2, MuQSS version 0.160 for linux-4.12

Announcing a new -ck release, 4.12-ck2  with the latest version of the Multiple Queue Skiplist Scheduler, version 0.160. These are patches designed to improve system responsiveness and interactivity with specific emphasis on the desktop, but configurable for any workload.

linux-4.12-ck2

-ck2 patches:

Git tree:


MuQSS

Download:

Git tree:

Sorry about the delay. I skipped announcing 4.12-ck1 as there was a lingering bug report from pf (thanks for extensive report!) and a config problem in it that rendered it unbootable without extra confg options.

MuQSS 0.160 updates

- Fixed race leading to crash on use of sched_setaffinity.

4.12-ck2 updates

- BFQ is now in mainline so it is no longer part of the patchset.
- BFQ now enabled by default along with scsi multiqueue to enable booting with it by default.
- Enable setting new kyber I/O scheduler as default as well (I recommend people use BFQ though.)
- Removed the mandatory swap_full() flag in the swap sucks patch after reports saying it was unhelpful.
Enjoy!
お楽しみ下さい
-ck
at

26 comments:

  1. Oleksandr Natalenko16 August 2017 at 02:03

    If CONFIG_SMP=n is set, the following warning appears:

    ===
    In file included from kernel/sched/sched.h:2:0,
    from kernel/sched/idle.c:19:
    kernel/sched/MuQSS.h:270:0: warning: "task_rq" redefined
    #define task_rq(p) cpu_rq(task_cpu(p))

    kernel/sched/MuQSS.h:262:0: note: this is the location of the previous definition
    #define task_rq(p) (uprq)
    ===

    Should "#define task_rq(p) cpu_rq(task_cpu(p))" be moved under #else section (where the code for CONFIG_SMP=y variant is defined)?

    ReplyDelete
  2. Oleksandr Natalenko16 August 2017 at 02:06

    Like this: https://gist.github.com/423338a9f73ca01a3e6071afdd7db758

    ?

    ReplyDelete
    Replies
    1. graysky16 August 2017 at 07:25

      @ck - Is ck2 setup correctly to use bfq as the default scheduler?

      % cat /sys/block/sda/queue/scheduler
      [mq-deadline] kyber bfq none

      Yet:

      zgrep -i bfq /proc/config.gz
      CONFIG_DEFAULT_BFQ=y
      CONFIG_DEFAULT_IOSCHED="bfq"
      CONFIG_IOSCHED_BFQ=y
      CONFIG_BFQ_GROUP_IOSCHED=y

      % zgrep -i deadline /proc/config.gz
      CONFIG_IOSCHED_DEADLINE=y
      # CONFIG_DEFAULT_DEADLINE is not set
      CONFIG_MQ_IOSCHED_DEADLINE=y

      Delete
    2. Con Kolivas16 August 2017 at 08:23

      It's set but it's very easy to override the default setting when inheriting old configs.

      Delete
    3. Con Kolivas16 August 2017 at 15:42

      Yes that looks about right PF.

      Delete
    4. Anonymous16 August 2017 at 18:34

      Please see https://bbs.archlinux.org/viewtopic.php?pid=1730573#p1730573 Edit 8 onwards for why the config option has no effect.

      Delete
    5. Tom17 August 2017 at 17:13

      There was a patch somewhere in the mailing list to implement DEFAULT_MQ_IOSCHED which I haven't seen pushed yet when I was looking to maintain the AUR package for linux-bfq-mq.

      You can use:

      sudo tee/sys/block/sda/queue/scheduler <<< bfq
      echo bfq > /sys/block/sda/queue/scheduler

      in your rc.local or related startup script.

      Delete
    6. Oleksandr Natalenko18 August 2017 at 02:01

      Don't do this, you have udev rules for it.

      Delete
  3. Jristz J Random17 August 2017 at 17:17

    Well look like the merged bfq is a block-device that only can be enabled using udev rules and not honout elevator and aparently in some forums user claim that it modprobe-able...

    so the bfq mailined eternally look realy like a diferent thing so my question is: Does the mailined bfq is the same as you has developed?

    ReplyDelete
    Replies
    1. Tom17 August 2017 at 18:09

      Paolo Valente developed bfq (I apologize, I have to give credit to his amazing work).

      As of 4.12, bfq in mainline is strictly bfq-mq and not the single-queue iosched that ck has added out-of-tree. Patches for the single-queue elevator bfq-sq has added in the main bfq-mq repository and is probably planned for mainline 4.13.

      Delete
    2. Oleksandr Natalenko18 August 2017 at 02:02

      BFQ-SQ will never enter upstream kernel. It is deprecated.

      Delete
    3. Tom18 August 2017 at 16:23

      Ah right, blk is getting deprecated.

      Delete
  4. Anonymous19 August 2017 at 00:59

    I just want to say thank you for your amazing work. I've been using your kernel for so many years now and can't imagine using anything else.

    Everybody who compiles code on a regular basis will notice a dramatic difference between this kernel and mainline in terms of responsiveness when using something like make -j 8.

    ReplyDelete
  5. Unknown19 August 2017 at 07:57

    After upgrade to 4.12 from 4.11 my computer does not wake up from sleep. I am running Intel CPU and AMD GPU.

    ReplyDelete
    Replies
    1. Anonymous19 August 2017 at 13:51

      Apparently, some users on Archlinux reddit found out about this problem due to blk-mq when using BFQ.

      https://www.reddit.com/r/archlinux/comments/6s26ua/is_suspend_broken_for_anyone_else_when_using_bfq/dla0l1v/

      Delete
    2. Unknown28 August 2017 at 06:26

      After applying mentioned patches I am still having the same problem.

      Delete
    3. Unknown28 August 2017 at 06:59

      Looks like it's not related to MuQSS.

      Delete
  6. Unknown19 August 2017 at 13:48

    This comment has been removed by the author.

    ReplyDelete
  7. Anonymous21 August 2017 at 00:29

    Hi, thanks for your work, much appreciated :-)
    However, I am getting hard CPU lock-ups after applying both -ck1 and -ck2 patches to 4.12. It's an AMD X6 processor from a while back.

    I can reproduce this easily by compiling the kernel with 'make -j 6 rpm-pkg' and then playing back some video with VLC.

    dmesg output: "[ 1265.189377] NMI watchdog: Watchdog detected hard LOCKUP on cpu 2" If needed, I saved more dmesg info. I am not able to reproduce without -ck2 patch applied. (It happens both with BFQ and CFQ io schedulers.)

    ReplyDelete
  8. Anonymous29 August 2017 at 03:45

    The load average seems to be broken after waking the laptop after suspend to ram:

    19:42:11 up 3:12, 1 user, load average: 4686378937.86, 1114499707436.02, 2827926430752.02


    Any more information I can provide?

    Linux flxtp 4.12.9-2-ck-nehalem #1 SMP PREEMPT Fri Aug 25 15:31:46 EDT 2017 x86_64 GNU/Linux

    ReplyDelete
  9. Anonymous26 September 2017 at 23:10

    Thinkpad X230
    4.12.14-1-ck-ivybridge
    mq-deadline kyber [bfq] none

    I am experiencing the same broken suspend problem as mentioned earlier. The system wakes up and instantly freezes on the login screen. Keyboard, mouse etc unresponsive. Can't switch into tty either. Also nothing interesting shows up in journalctl. Only solution is hard reset.

    ReplyDelete
    Replies
    1. Oleksandr Natalenko27 September 2017 at 03:15

      You are free to follow relevant discussion in linux-block mailing list. The issue is not fixed yet in the upstream, but there are some patches circulating around, and some were merged into -pf making suspend-resume with blk-mq reliable.

      Delete
    2. Anonymous28 September 2017 at 14:46

      Thanks for your reply Oleksandr. Can you please let me know if there is any Arch repo that provides cpu optimized linux-pf or linux-zen packages like repo-ck?

      Delete
    3. Oleksandr Natalenko28 September 2017 at 18:22

      I build it myself for Silvermont, Skylake and generic x86_64, links are there on pf-kernel site. If you need it for another architecture — you are on your own.

      Delete
  10. Anonymous29 September 2017 at 17:05

    I somehow managed to get my personal PKGBUILD for linux-pf into some shape so I can share it on the internet. You might wanna try using the AUR package https://github.com/pinkfluid/linux-mpf . It will autodetect your local CPU and build for that platform.

    ReplyDelete
    Replies
    1. Anonymous29 September 2017 at 18:14

      This was supposed to be the answer to the thread above about the Arch repo for linux-pf.

      Delete