Multiple CPU core use

Forum Forums Discussion Multiple CPU core use

This topic contains 14 replies, has 6 voices, and was last updated by Vixen Vixen 2 years, 11 months ago.

Viewing 15 posts - 1 through 15 (of 15 total)
  • Author
    Posts
  • #33482
    soviras
    soviras
    Participant
    0

    As things get more complex with each update and extra supported skill, the crafting calculation is slowing to a crawl. As such, I wanted to ask if there were plans to support use of multiple CPU cores to speed it up? Some complex things, already take an hour to calculate, but only one core is used. On this PC, there are 15 other cores available, and spreading the task across them would enhance performance.
    It is my understanding that Miqo is made in AutoIt, which does not support multi core use natively, but I do know there are workarounds for it.
    Alternatively, would it be possible to store craft calculations? I am aware this would take a lot of storage space, but that is not an issue for me with lots of storage on cloud. On the other hand, recipes I craft a lot, and being able to just load in the recipe, would save a lot of time.

    #33485
    Miqobot
    Miqobot
    Keymaster
    1+

    Using additional threads would imply parallel processing, while Crafting Solver is a strictly sequential algorithm.
    Solver states are sorted in a strictly determined order, and each subsequent state depends on previous calculations. Parallel processing would only make things worse and slow the algorithm down 100-200 times.

    We are very sorry to disappoint, but the Crafting Solver algorithm is already optimized as much as possible.
    Because of this optimization, its performance is equivalent to 100-200 threads of a parallel algorithm.

    #33486
    Miqobot
    Miqobot
    Keymaster
    1+

    Some complex things, already take an hour to calculate

    This issue usually indicates that you have enabled too many CPU intensive options.
    There is very little benefit in activating all options at the same time. You can find the list of recommended settings in the patch notes for Crafting Solver upgrade:
    Miqobot v1.3.34 – Patch Notes

    It is my understanding that Miqo is made in AutoIt

    All time critical components, including Crafting Solver, are implemented in C++.

    Alternatively, would it be possible to store craft calculations?

    Yes, this feature has already been requested:
    Is there a reason Miqo doesn’t store solved recipes somewhere?

    #33487
    Vixen
    Vixen
    Participant
    0

    I just want to point out that on the multi-star level 80 crafts that I’ve done, with manipulation and innovation, on 2:1 chunks, I don’t think I’ve ever waited for even thirty seconds for the solver. I don’t know what options you’re using, but taking over an hour suggests that not only are you probably using options you really don’t need (waste not triples solver time and only gives an average 0.5% improvement) but also you may be doing lots of other high-CPU tasks at the same time. It might be worth pulling up task manager and checking the performance tab to see what your CPU usage graph looks like before you start crafting; maybe you can shut down or pause some tasks to give Miqo more power to work with.

    #33488

    Andylynyn
    Participant
    0

    Some complex things, already take an hour.

    On this PC, there are 15 other cores available

    Considering this, I’d say threading was the least of your worries.

    In my puny Ryzen 5 2600X, it takes at most (if I really want to push it) 1-2mins on an expert recipe. So if you’re getting an HOUR on some random thing, then look inwards to fix the issue, cuz no one else has that issue from what I’ve seen.

    #33512
    soviras
    soviras
    Participant
    0

    Some complex things, already take an hour.

    On this PC, there are 15 other cores available

    Considering this, I’d say threading was the least of your worries.

    In my puny Ryzen 5 2600X, it takes at most (if I really want to push it) 1-2mins on an expert recipe. So if you’re getting an HOUR on some random thing, then look inwards to fix the issue, cuz no one else has that issue from what I’ve seen.

    I have a Ryzen 7 5800h, the problem is not that it’s weak. It works perfectly fine on high end benchmarking. The problem is that it has 16 threads, and that makes it take a significant time, as only a fraction of its capability is used. When going for expert crafts, with all settings active, it takes an incredible amount of time, far more than it should, because the single thread, about 6% of the CPU, is capped. Even with less settings, it takes 3-4 times the estimated time. Stats also matter a lot. I get almost guaranteed maxed out expert recipes, and have max CP, with food active. More steps with more CP results in longer calculation. Max CP + food + syrup + specialist, and the estimated time goes to over 10 minutes. Once it’s done, it fails to max out about 1 in 10, and complete fails around 1-2%. Just takes ages to get there. It’s not some random thing, it’s expert recipes with stats that are good enough to cap the quality rather consistently, and even the estimated time is higher than 1-2 min, closer to 12 min.

    #33513

    Andylynyn
    Participant
    1+

    And I’m saying you must be doing something wrong, because if you have a 5800H and you’re getting “Almost an hour” and I’m sitting pretty here with my 2600X and getting at max two minutes per solver, there’s no other way to see it.

    #33514
    Lyfox
    Lyfox
    Participant
    0

    with all settings active

    Disable Waste Not and set CP to 4:1. Thats all you need for expert.

    #33515
    soviras
    soviras
    Participant
    0

    And I’m saying you must be doing something wrong, because if you have a 5800H and you’re getting “Almost an hour” and I’m sitting pretty here with my 2600X and getting at max two minutes per solver, there’s no other way to see it.

    If you only have 2 minutes, you don’t have the full settings, nor the full stats.

    #33516
    jponry
    jponry
    Participant
    0

    And I’m saying you must be doing something wrong, because if you have a 5800H and you’re getting “Almost an hour” and I’m sitting pretty here with my 2600X and getting at max two minutes per solver, there’s no other way to see it.

    If you only have 2 minutes, you don’t have the full settings, nor the full stats.

    You really don’t need all settings active to do expert crafts, unless your gear is just downright inferior. Do what Lyfox said, those are my settings as well. If I set CP to 2:1 and turn on Waste Not, my estimated time goes from 40 seconds to 5.3 minutes and RAM usage skyrockets from 150 mb to over a gig.

    #33517

    Andylynyn
    Participant
    1+

    All settings is basically user error, honestly.

    And I’m in penta melded gear, literally BiS for crafters, so uh… Stats? I got ’em. :v

    • This reply was modified 2 years, 11 months ago by  Andylynyn.
    #33522
    soviras
    soviras
    Participant
    0

    All settings is basically user error, honestly.

    And I’m in penta melded gear, literally BiS for crafters, so uh… Stats? I got ’em. :v

    Doubt. You can be penta melded, and still not have good stats, or far lower CP. Did you follow a guide for the melds, or just slap random ones on? Or did you calculate yourself exactly how much you need of craftmanship before it no longer saves steps, which changes based on recipe? How much CP? 554, like one of the guides that’s popular tells you? Which is great for normal crafts, but 660 CP is better for consistency with expert recipes, and thats a big difference in the amount of steps. More steps means more chances for beneficial RNG.
    Saying “literally BiS” is saying you don’t know what BiS is for crafting, because there is no single solution, BiS for one recipe is not BiS for another.

    The reason I prefer all settings is simple, I want optimal efficiency in terms of success rate, and everything specializes in that. I don’t want failures, and even if the failure rate is reduced by a small amount, I feel it’s worth it. Using a feature that the bot has, even if unneeded, isn’t an error, it’s a choice.

    #33523
    Lyfox
    Lyfox
    Participant
    2+

    I agree its a choice. If you want +1% quality output and dont mind waiting 20 minutes instead of 2 then you have every right to make this choice.

    #33526

    Andylynyn
    Participant
    1+

    All settings is basically user error, honestly.

    And I’m in penta melded gear, literally BiS for crafters, so uh… Stats? I got ’em. :v

    Doubt. You can be penta melded, and still not have good stats, or far lower CP. Did you follow a guide for the melds, or just slap random ones on? Or did you calculate yourself exactly how much you need of craftmanship before it no longer saves steps, which changes based on recipe? How much CP? 554, like one of the guides that’s popular tells you? Which is great for normal crafts, but 660 CP is better for consistency with expert recipes, and thats a big difference in the amount of steps. More steps means more chances for beneficial RNG.
    Saying “literally BiS” is saying you don’t know what BiS is for crafting, because there is no single solution, BiS for one recipe is not BiS for another.

    The reason I prefer all settings is simple, I want optimal efficiency in terms of success rate, and everything specializes in that. I don’t want failures, and even if the failure rate is reduced by a small amount, I feel it’s worth it. Using a feature that the bot has, even if unneeded, isn’t an error, it’s a choice.

    This is irrelevant. BiS is BiS, it’s called Best in Slot because people have made the math for it and have found out that generally this is the best you can get out of every single combination of gear/meld in the game.

    You can dance around this all you want, having more CP but not having enough control for example is not going to offset the increase you get in CP due to the lack of efficiency in the touch actions. So yeah, you can get 660CP all you want, if you sacrifice craftsmanship and control for it, you’re losing more than you’re gaining so it’s actually pointless.

    Stats are stats, they’re hard math. I’ve done most resplendent tools, and those are currently the hardest craft in the game, iirc. And my solver for those took 2 mins max.

    Again, this is user error, or as Lyfox said, choice. But it’s not the way the solver was designed to work, spending weeks working on fully threading the solving engine when there’s actually an incredibly small niche use for it is not worth the development cycles, imo.

    But Miqo has a request topic every now and again, throw your suggestion at them and the community in general and see how people feel, but seeing the usecase considering the other options like QoL and getting everything up to speed for Endwalker, I doubt you’ll have much luck.

    #33532
    Vixen
    Vixen
    Participant
    0

    Miqo has already said that threading the solver won’t make things any faster due to the design of the engine, and would in fact make things slower by at least two orders of magnitude. It’s the second post in this thread.

Viewing 15 posts - 1 through 15 (of 15 total)

You must be logged in to reply to this topic.