Forum › Forums › Discussion › Multiple CPU core use
This topic contains 14 replies, has 6 voices, and was last updated by Vixen 2 years, 11 months ago.
-
AuthorPosts
-
November 25, 2021 at 11:32 pm #33482
As things get more complex with each update and extra supported skill, the crafting calculation is slowing to a crawl. As such, I wanted to ask if there were plans to support use of multiple CPU cores to speed it up? Some complex things, already take an hour to calculate, but only one core is used. On this PC, there are 15 other cores available, and spreading the task across them would enhance performance.
It is my understanding that Miqo is made in AutoIt, which does not support multi core use natively, but I do know there are workarounds for it.
Alternatively, would it be possible to store craft calculations? I am aware this would take a lot of storage space, but that is not an issue for me with lots of storage on cloud. On the other hand, recipes I craft a lot, and being able to just load in the recipe, would save a lot of time.November 26, 2021 at 8:11 am #33485Using additional threads would imply parallel processing, while Crafting Solver is a strictly sequential algorithm.
Solver states are sorted in a strictly determined order, and each subsequent state depends on previous calculations. Parallel processing would only make things worse and slow the algorithm down 100-200 times.We are very sorry to disappoint, but the Crafting Solver algorithm is already optimized as much as possible.
Because of this optimization, its performance is equivalent to 100-200 threads of a parallel algorithm.November 26, 2021 at 8:13 am #33486Some complex things, already take an hour to calculate
This issue usually indicates that you have enabled too many CPU intensive options.
There is very little benefit in activating all options at the same time. You can find the list of recommended settings in the patch notes for Crafting Solver upgrade:
Miqobot v1.3.34 – Patch NotesIt is my understanding that Miqo is made in AutoIt
All time critical components, including Crafting Solver, are implemented in C++.
Alternatively, would it be possible to store craft calculations?
Yes, this feature has already been requested:
Is there a reason Miqo doesn’t store solved recipes somewhere?November 26, 2021 at 3:26 pm #33487I just want to point out that on the multi-star level 80 crafts that I’ve done, with manipulation and innovation, on 2:1 chunks, I don’t think I’ve ever waited for even thirty seconds for the solver. I don’t know what options you’re using, but taking over an hour suggests that not only are you probably using options you really don’t need (waste not triples solver time and only gives an average 0.5% improvement) but also you may be doing lots of other high-CPU tasks at the same time. It might be worth pulling up task manager and checking the performance tab to see what your CPU usage graph looks like before you start crafting; maybe you can shut down or pause some tasks to give Miqo more power to work with.
November 26, 2021 at 4:31 pm #33488Some complex things, already take an hour.
On this PC, there are 15 other cores available
Considering this, I’d say threading was the least of your worries.
In my puny Ryzen 5 2600X, it takes at most (if I really want to push it) 1-2mins on an expert recipe. So if you’re getting an HOUR on some random thing, then look inwards to fix the issue, cuz no one else has that issue from what I’ve seen.
November 27, 2021 at 6:00 pm #33512Some complex things, already take an hour.
On this PC, there are 15 other cores available
Considering this, I’d say threading was the least of your worries.
In my puny Ryzen 5 2600X, it takes at most (if I really want to push it) 1-2mins on an expert recipe. So if you’re getting an HOUR on some random thing, then look inwards to fix the issue, cuz no one else has that issue from what I’ve seen.
I have a Ryzen 7 5800h, the problem is not that it’s weak. It works perfectly fine on high end benchmarking. The problem is that it has 16 threads, and that makes it take a significant time, as only a fraction of its capability is used. When going for expert crafts, with all settings active, it takes an incredible amount of time, far more than it should, because the single thread, about 6% of the CPU, is capped. Even with less settings, it takes 3-4 times the estimated time. Stats also matter a lot. I get almost guaranteed maxed out expert recipes, and have max CP, with food active. More steps with more CP results in longer calculation. Max CP + food + syrup + specialist, and the estimated time goes to over 10 minutes. Once it’s done, it fails to max out about 1 in 10, and complete fails around 1-2%. Just takes ages to get there. It’s not some random thing, it’s expert recipes with stats that are good enough to cap the quality rather consistently, and even the estimated time is higher than 1-2 min, closer to 12 min.
November 27, 2021 at 6:10 pm #33513November 27, 2021 at 9:22 pm #33514with all settings active
Disable Waste Not and set CP to 4:1. Thats all you need for expert.
November 27, 2021 at 10:03 pm #33515And I’m saying you must be doing something wrong, because if you have a 5800H and you’re getting “Almost an hour” and I’m sitting pretty here with my 2600X and getting at max two minutes per solver, there’s no other way to see it.
If you only have 2 minutes, you don’t have the full settings, nor the full stats.
November 28, 2021 at 12:18 am #33516And I’m saying you must be doing something wrong, because if you have a 5800H and you’re getting “Almost an hour” and I’m sitting pretty here with my 2600X and getting at max two minutes per solver, there’s no other way to see it.
If you only have 2 minutes, you don’t have the full settings, nor the full stats.
You really don’t need all settings active to do expert crafts, unless your gear is just downright inferior. Do what Lyfox said, those are my settings as well. If I set CP to 2:1 and turn on Waste Not, my estimated time goes from 40 seconds to 5.3 minutes and RAM usage skyrockets from 150 mb to over a gig.
November 28, 2021 at 1:36 am #33517All settings is basically user error, honestly.
And I’m in penta melded gear, literally BiS for crafters, so uh… Stats? I got ’em. :v
- This reply was modified 2 years, 11 months ago by Andylynyn.
November 28, 2021 at 11:14 am #33522All settings is basically user error, honestly.
And I’m in penta melded gear, literally BiS for crafters, so uh… Stats? I got ’em. :v
Doubt. You can be penta melded, and still not have good stats, or far lower CP. Did you follow a guide for the melds, or just slap random ones on? Or did you calculate yourself exactly how much you need of craftmanship before it no longer saves steps, which changes based on recipe? How much CP? 554, like one of the guides that’s popular tells you? Which is great for normal crafts, but 660 CP is better for consistency with expert recipes, and thats a big difference in the amount of steps. More steps means more chances for beneficial RNG.
Saying “literally BiS” is saying you don’t know what BiS is for crafting, because there is no single solution, BiS for one recipe is not BiS for another.The reason I prefer all settings is simple, I want optimal efficiency in terms of success rate, and everything specializes in that. I don’t want failures, and even if the failure rate is reduced by a small amount, I feel it’s worth it. Using a feature that the bot has, even if unneeded, isn’t an error, it’s a choice.
November 28, 2021 at 11:50 am #33523November 28, 2021 at 4:35 pm #33526All settings is basically user error, honestly.
And I’m in penta melded gear, literally BiS for crafters, so uh… Stats? I got ’em. :v
Doubt. You can be penta melded, and still not have good stats, or far lower CP. Did you follow a guide for the melds, or just slap random ones on? Or did you calculate yourself exactly how much you need of craftmanship before it no longer saves steps, which changes based on recipe? How much CP? 554, like one of the guides that’s popular tells you? Which is great for normal crafts, but 660 CP is better for consistency with expert recipes, and thats a big difference in the amount of steps. More steps means more chances for beneficial RNG.
Saying “literally BiS” is saying you don’t know what BiS is for crafting, because there is no single solution, BiS for one recipe is not BiS for another.The reason I prefer all settings is simple, I want optimal efficiency in terms of success rate, and everything specializes in that. I don’t want failures, and even if the failure rate is reduced by a small amount, I feel it’s worth it. Using a feature that the bot has, even if unneeded, isn’t an error, it’s a choice.
This is irrelevant. BiS is BiS, it’s called Best in Slot because people have made the math for it and have found out that generally this is the best you can get out of every single combination of gear/meld in the game.
You can dance around this all you want, having more CP but not having enough control for example is not going to offset the increase you get in CP due to the lack of efficiency in the touch actions. So yeah, you can get 660CP all you want, if you sacrifice craftsmanship and control for it, you’re losing more than you’re gaining so it’s actually pointless.
Stats are stats, they’re hard math. I’ve done most resplendent tools, and those are currently the hardest craft in the game, iirc. And my solver for those took 2 mins max.
Again, this is user error, or as Lyfox said, choice. But it’s not the way the solver was designed to work, spending weeks working on fully threading the solving engine when there’s actually an incredibly small niche use for it is not worth the development cycles, imo.
But Miqo has a request topic every now and again, throw your suggestion at them and the community in general and see how people feel, but seeing the usecase considering the other options like QoL and getting everything up to speed for Endwalker, I doubt you’ll have much luck.
November 29, 2021 at 11:54 pm #33532 -
AuthorPosts
You must be logged in to reply to this topic.