srun: job 788139 queued and waiting for resources
srun: job 788139 has been allocated resources

* Info: Detected 112 Lprof instances in c489: processes-per-node/ppn set accordingly.
If this is incorrect, rerun with an explicit value for this setting

* Info: Selecting the 'perf-high-ppn' engine for node c489

* Info: Process launched (host c489, process 32149)
* Info: Process launched (host c489, process 32151)
* Info: Process launched (host c489, process 32153)
* Info: Process launched (host c489, process 32155)
* Info: Process launched (host c489, process 32157)
* Info: Process launched (host c489, process 32158)
* Info: Process launched (host c489, process 32159)
* Info: Process launched (host c489, process 32162)
* Info: Process launched (host c489, process 32161)
* Info: Process launched (host c489, process 32164)
* Info: Process launched (host c489, process 32165)
* Info: Process launched (host c489, process 32167)
* Info: Process launched (host c489, process 32172)
* Info: Process launched (host c489, process 32174)
* Info: Process launched (host c489, process 32176)
* Info: Process launched (host c489, process 32177)
* Info: Process launched (host c489, process 32178)
* Info: Process launched (host c489, process 32182)
* Info: Process launched (host c489, process 32184)
* Info: Process launched (host c489, process 32185)
* Info: Process launched (host c489, process 32187)
* Info: Process launched (host c489, process 32188)
* Info: Process launched (host c489, process 32189)
* Info: Process launched (host c489, process 32191)
* Info: Process launched (host c489, process 32192)
* Info: Process launched (host c489, process 32194)
* Info: Process launched (host c489, process 32198)
* Info: Process launched (host c489, process 32202)
* Info: Process launched (host c489, process 32204)
* Info: Process launched (host c489, process 32206)
* Info: Process launched (host c489, process 32207)
* Info: Process launched (host c489, process 32208)
* Info: Process launched (host c489, process 32212)
* Info: Process launched (host c489, process 32214)
* Info: Process launched (host c489, process 32216)
* Info: Process launched (host c489, process 32217)
* Info: Process launched (host c489, process 32219)
* Info: Process launched (host c489, process 32222)
* Info: Process launched (host c489, process 32223)

* Info: Process launched (host c489, process 32225)* Info: Process launched (host c489, process 32224)

* Info: Process launched (host c489, process 32230)* Info: Process launched (host c489, process 32229)
* Info: Process launched (host c489, process 32231)
* Info: Process launched (host c489, process 32232)
* Info: Process launched (host c489, process 32233)
* Info: Process launched (host c489, process 32234)
* Info: Process launched (host c489, process 32235)
* Info: Process launched (host c489, process 32236)
* Info: Process launched (host c489, process 32237)
* Info: Process launched (host c489, process 32238)
* Info: Process launched (host c489, process 32239)
* Info: Process launched (host c489, process 32240)
* Info: Process launched (host c489, process 32241)
* Info: Process launched (host c489, process 32281)
* Info: Process launched (host c489, process 32242)
* Info: Process launched (host c489, process 32243)
* Info: Process launched (host c489, process 32289)
* Info: Process launched (host c489, process 32244)
* Info: Process launched (host c489, process 32245)
* Info: Process launched (host c489, process 32246)
* Info: Process launched (host c489, process 32247)
* Info: Process launched (host c489, process 32248)
* Info: Process launched (host c489, process 32249)
* Info: Process launched (host c489, process 32250)
* Info: Process launched (host c489, process 32251)
* Info: Process launched (host c489, process 32252)
* Info: Process launched (host c489, process 32253)
* Info: Process launched (host c489, process 32255)
* Info: Process launched (host c489, process 32254)
* Info: Process launched (host c489, process 32256)
* Info: Process launched (host c489, process 32257)
* Info: Process launched (host c489, process 32258)
* Info: Process launched (host c489, process 32259)
* Info: Process launched (host c489, process 32260)
* Info: Process launched (host c489, process 32261)
* Info: Process launched (host c489, process 32262)
* Info: Process launched (host c489, process 32263)
* Info: Process launched (host c489, process 32266)
* Info: Process launched (host c489, process 32268)
* Info: Process launched (host c489, process 32275)
* Info: Process launched (host c489, process 32277)
* Info: Process launched (host c489, process 32279)
* Info: Process launched (host c489, process 32288)
* Info: Process launched (host c489, process 32295)
* Info: Process launched (host c489, process 32297)
* Info: Process launched (host c489, process 32300)
* Info: Process launched (host c489, process 32308)
* Info: Process launched (host c489, process 32309)
* Info: Process launched (host c489, process 32326)
* Info: Process launched (host c489, process 32329)
* Info: Process launched (host c489, process 32330)
* Info: Process launched (host c489, process 32332)
* Info: Process launched (host c489, process 32333)
* Info: Process launched (host c489, process 32338)
* Info: Process launched (host c489, process 32340)
* Info: Process launched (host c489, process 32341)
* Info: Process launched (host c489, process 32345)
* Info: Process launched (host c489, process 32344)
* Info: Process launched (host c489, process 32350)
* Info: Process launched (host c489, process 32352)
* Info: Process launched (host c489, process 32354)
* Info: Process launched (host c489, process 32355)
* Info: Process launched (host c489, process 32356)
* Info: Process launched (host c489, process 32361)
* Info: Process launched (host c489, process 32360)
* Info: Process launched (host c489, process 32362)
* Info: Process launched (host c489, process 32363)
* Info: Process launched (host c489, process 32367)
* Info: Process launched (host c489, process 32371)
* Info: Process launched (host c489, process 32372)
* Info: Process launched (host c489, process 32375)
* Info: Process finished (host c489, process 32344)
* Warning: (host c489, process 32344) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.
0

* Info: Process finished (host c489, process 32363)
* Warning: (host c489, process 32363) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32260)
* Warning: (host c489, process 32260) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32250)
* Warning: (host c489, process 32250) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32234)
* Warning: (host c489, process 32234) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32245)
* Warning: (host c489, process 32245) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32178)
* Warning: (host c489, process 32178) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32297)
* Info: Process finished (host c489, process 32356)
* Warning: (host c489, process 32297) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32356) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32333)
* Warning: (host c489, process 32333) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32217)
* Warning: (host c489, process 32217) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32194)
* Info: Process finished (host c489, process 32202)
* Warning: (host c489, process 32202) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32194) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32242)
* Warning: (host c489, process 32242) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32261)
* Warning: (host c489, process 32261) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32165)
* Warning: (host c489, process 32165) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32375)
* Warning: (host c489, process 32375) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32216)
* Warning: (host c489, process 32216) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32230)
* Warning: (host c489, process 32230) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32243)
* Info: Process finished (host c489, process 32239)
* Warning: (host c489, process 32243) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32239) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32225)
* Warning: (host c489, process 32225) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32151)
* Warning: (host c489, process 32151) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32258)
* Warning: (host c489, process 32258) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32263)
* Warning: (host c489, process 32263) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32256)
* Warning: (host c489, process 32256) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32249)
* Warning: (host c489, process 32249) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32354)
* Warning: (host c489, process 32354) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32158)
* Warning: (host c489, process 32158) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32350)
* Warning: (host c489, process 32350) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32361)
* Warning: (host c489, process 32361) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32268)
* Warning: (host c489, process 32268) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32355)
* Warning: (host c489, process 32355) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32184)
* Warning: (host c489, process 32184) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32167)
* Warning: (host c489, process 32167) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32176)
* Warning: (host c489, process 32176) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32219)
* Warning: (host c489, process 32219) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32340)
* Warning: (host c489, process 32340) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32204)
* Info: Process finished (host c489, process 32162)
* Warning: (host c489, process 32162) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32204) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32362)
* Warning: (host c489, process 32362) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32367)
* Warning: (host c489, process 32367) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32159)
* Warning: (host c489, process 32159) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32244)
* Warning: (host c489, process 32244) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32233)
* Warning: (host c489, process 32233) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32236)
* Info: Process finished (host c489, process 32277)
* Warning: (host c489, process 32277) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32236) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32206)
* Warning: (host c489, process 32206) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32208)
* Info: Process finished (host c489, process 32198)
* Warning: (host c489, process 32208) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32198) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32212)
* Warning: (host c489, process 32212) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32254)
* Warning: (host c489, process 32254) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32232)
* Info: Process finished (host c489, process 32246)
* Warning: (host c489, process 32246) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32332)
* Warning: (host c489, process 32332) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32266)
* Info: Process finished (host c489, process 32229)
* Warning: (host c489, process 32229) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32185)
* Warning: (host c489, process 32185) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32338)
* Warning: (host c489, process 32338) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32149)
* Warning: (host c489, process 32149) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32177)
* Warning: (host c489, process 32177) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32224)
* Info: Process finished (host c489, process 32259)
* Info: Process finished (host c489, process 32251)
* Warning: (host c489, process 32251) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32223)
* Warning: (host c489, process 32223) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32255)
* Warning: (host c489, process 32255) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32300)
* Warning: (host c489, process 32300) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32308)
* Warning: (host c489, process 32308) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32232) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32266) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32192)
* Warning: (host c489, process 32192) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32326)
* Info: Process finished (host c489, process 32352)
* Warning: (host c489, process 32224) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32259) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32372)
* Warning: (host c489, process 32372) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32161)
* Warning: (host c489, process 32161) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32188)
* Warning: (host c489, process 32188) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32352) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32326) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32172)
* Warning: (host c489, process 32172) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32309)
* Warning: (host c489, process 32309) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32289)
* Warning: (host c489, process 32289) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32157)
* Warning: (host c489, process 32157) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32222)
* Info: Process finished (host c489, process 32253)
* Warning: (host c489, process 32253) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32222) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32345)
* Warning: (host c489, process 32345) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32155)
* Warning: (host c489, process 32155) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32237)
* Info: Process finished (host c489, process 32164)
* Warning: (host c489, process 32164) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32279)
* Info: Process finished (host c489, process 32252)
* Info: Process finished (host c489, process 32174)
* Warning: (host c489, process 32174) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32182)
* Warning: (host c489, process 32182) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32329)
* Info: Process finished (host c489, process 32189)
* Warning: (host c489, process 32189) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32187)
* Info: Process finished (host c489, process 32191)
* Warning: (host c489, process 32191) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32288)
* Warning: (host c489, process 32288) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32241)
* Info: Process finished (host c489, process 32330)
* Warning: (host c489, process 32330) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32238)
* Warning: (host c489, process 32238) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32248)
* Info: Process finished (host c489, process 32371)
* Warning: (host c489, process 32371) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32207)
* Warning: (host c489, process 32207) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32231)
* Warning: (host c489, process 32231) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32275)
* Warning: (host c489, process 32275) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32214)
* Info: Process finished (host c489, process 32240)
* Info: Process finished (host c489, process 32262)
* Info: Process finished (host c489, process 32341)
* Info: Process finished (host c489, process 32257)
* Warning: (host c489, process 32257) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32235)
* Warning: (host c489, process 32235) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32153)
* Warning: (host c489, process 32153) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32247)
* Info: Process finished (host c489, process 32360)
* Warning: (host c489, process 32360) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32295)
* Warning: (host c489, process 32237) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32279) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32329) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32187) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32252) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32241) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32248) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32262) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32214) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32247) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32295) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32240) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Warning: (host c489, process 32341) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.

* Info: Process finished (host c489, process 32281)
* Warning: (host c489, process 32281) Observed more threads (4) than expected (1): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=4.


Info: 111/112 lprof instances finished


Your experiment path is /home_nfs/bsergentm/workspace/projects/2023/emopass/nemo-4.2.1/nemo-gaston-scripts/scripts/logs__Intel_8480_2s_56c_2t_hdr100_512GB_4800-BENCH__2023-07-28_15-01-17/BENCH/Intel_8480_2s_56c_2t_hdr100_512GB_4800/OMPI/1/maqao-logs/tools/lprof_npsu_run_0

To display your profiling results:
####################################################################################################################################################################################################################################################################################################################
#    LEVEL    |     REPORT     |                                                                                                                                      COMMAND                                                                                                                                      #
####################################################################################################################################################################################################################################################################################################################
#  Functions  |  Cluster-wide  |  maqao lprof -df xp=/home_nfs/bsergentm/workspace/projects/2023/emopass/nemo-4.2.1/nemo-gaston-scripts/scripts/logs__Intel_8480_2s_56c_2t_hdr100_512GB_4800-BENCH__2023-07-28_15-01-17/BENCH/Intel_8480_2s_56c_2t_hdr100_512GB_4800/OMPI/1/maqao-logs/tools/lprof_npsu_run_0      #
#  Functions  |  Per-node      |  maqao lprof -df -dn xp=/home_nfs/bsergentm/workspace/projects/2023/emopass/nemo-4.2.1/nemo-gaston-scripts/scripts/logs__Intel_8480_2s_56c_2t_hdr100_512GB_4800-BENCH__2023-07-28_15-01-17/BENCH/Intel_8480_2s_56c_2t_hdr100_512GB_4800/OMPI/1/maqao-logs/tools/lprof_npsu_run_0  #
#  Functions  |  Per-process   |  maqao lprof -df -dp xp=/home_nfs/bsergentm/workspace/projects/2023/emopass/nemo-4.2.1/nemo-gaston-scripts/scripts/logs__Intel_8480_2s_56c_2t_hdr100_512GB_4800-BENCH__2023-07-28_15-01-17/BENCH/Intel_8480_2s_56c_2t_hdr100_512GB_4800/OMPI/1/maqao-logs/tools/lprof_npsu_run_0  #
#  Functions  |  Per-thread    |  maqao lprof -df -dt xp=/home_nfs/bsergentm/workspace/projects/2023/emopass/nemo-4.2.1/nemo-gaston-scripts/scripts/logs__Intel_8480_2s_56c_2t_hdr100_512GB_4800-BENCH__2023-07-28_15-01-17/BENCH/Intel_8480_2s_56c_2t_hdr100_512GB_4800/OMPI/1/maqao-logs/tools/lprof_npsu_run_0  #
#  Loops      |  Cluster-wide  |  maqao lprof -dl xp=/home_nfs/bsergentm/workspace/projects/2023/emopass/nemo-4.2.1/nemo-gaston-scripts/scripts/logs__Intel_8480_2s_56c_2t_hdr100_512GB_4800-BENCH__2023-07-28_15-01-17/BENCH/Intel_8480_2s_56c_2t_hdr100_512GB_4800/OMPI/1/maqao-logs/tools/lprof_npsu_run_0      #
#  Loops      |  Per-node      |  maqao lprof -dl -dn xp=/home_nfs/bsergentm/workspace/projects/2023/emopass/nemo-4.2.1/nemo-gaston-scripts/scripts/logs__Intel_8480_2s_56c_2t_hdr100_512GB_4800-BENCH__2023-07-28_15-01-17/BENCH/Intel_8480_2s_56c_2t_hdr100_512GB_4800/OMPI/1/maqao-logs/tools/lprof_npsu_run_0  #
#  Loops      |  Per-process   |  maqao lprof -dl -dp xp=/home_nfs/bsergentm/workspace/projects/2023/emopass/nemo-4.2.1/nemo-gaston-scripts/scripts/logs__Intel_8480_2s_56c_2t_hdr100_512GB_4800-BENCH__2023-07-28_15-01-17/BENCH/Intel_8480_2s_56c_2t_hdr100_512GB_4800/OMPI/1/maqao-logs/tools/lprof_npsu_run_0  #
#  Loops      |  Per-thread    |  maqao lprof -dl -dt xp=/home_nfs/bsergentm/workspace/projects/2023/emopass/nemo-4.2.1/nemo-gaston-scripts/scripts/logs__Intel_8480_2s_56c_2t_hdr100_512GB_4800-BENCH__2023-07-28_15-01-17/BENCH/Intel_8480_2s_56c_2t_hdr100_512GB_4800/OMPI/1/maqao-logs/tools/lprof_npsu_run_0  #
####################################################################################################################################################################################################################################################################################################################