Message Boards Message Boards

GROUPS:

Issue with Parallel processing

Posted 1 year ago
1821 Views
|
3 Replies
|
0 Total Likes
|

Hi,

I'm running Mathematica 12.0 with a license for 8 kernels. Recently when I run a parallel process (typically with Method->"CoarsestGrained") only 4 of the kernels (sometimes less) are being used when it is clear that much more than half the tasks are left. In the past all 8 would be active. What is going on and how can I get all 8 kernels to be used?

Thank you, Troy Wahl

POSTED BY: Troy Wahl
3 Replies
Posted 1 year ago

Hi Troy,

Have you checked the configuration settings as described in this support article? What does the following evaluate to?

Parallelize[Map[{#, $KernelID} &, Range[12]], Method -> "CoarsestGrained"]
POSTED BY: Updating Name
Posted 1 year ago

Hi,

I have checked and Parallel Kernel Configuration (local) reads:

Automatic: 8 kernels Number of processor cores is 8 "Limit by license availability (8)" is checked "Use hard limit:16 + -" is checked

The rest in that block is unchecked.

I'll have to run your test program when my current computation is done (could be a few days).

POSTED BY: Troy Wahl
Posted 1 year ago

Hi,

I just ran your code and got:

In[30]:= Parallelize[Map[{#, $KernelID} &, Range[12]], 
 Method -> "CoarsestGrained"]

Out[30]= {{1, 1}, {2, 1}, {3, 2}, {4, 2}, {5, 3}, {6, 3}, {7, 4}, {8, 
  4}, {9, 5}, {10, 6}, {11, 7}, {12, 8}}

Which is as it should be, but the things I'm running are huge (functional arrays 100's wide, and over 30,000 long) yet not all the kernels are involved...

POSTED BY: Updating Name
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard

Group Abstract Group Abstract