from what I saw in your code, you used the threadpool executor, that will increase the model predict time as explained in the article. try using the process pool :)