You have 2cores @2ghz.. probably with only 8gb ram and HDD.. that would justify slow rebuild.
Definitely more RAM and faster SSDs would speed it up. Imho majority of the jobs during rebuild are singlethreaded.
But the only proper solution is a two container setup.