Thanks for this benchmark have you used the last commit? We made some changes from mtp int 4 to much more! If you like, leave an issue so we can work on it! Thank you so much!