Loop id | Source Location | Source Function | Level | Max Thread Time / Walltime orig_0 (%) | Exclusive Coverage orig_0 (%) | Inclusive Coverage orig_0 (%) | Max Exclusive Time Over Threads orig_0 (s) | Max Inclusive Time Over Threads orig_0 (s) | Exclusive Time w.r.t. Wall Time orig_0 (s) | Inclusive Time w.r.t. Wall Time orig_0 (s) | Nb Threads orig_0 | GFLOPS orig_0 | Vectorization Ratio (%) | Vector Length Use (%) | Speedup If No Scalar Integer | Speedup If FP Vectorized | Speedup If Fully Vectorized | Speedup If Perfect Load Balancing orig_0 | Stride 0 | Stride 1 | Stride n | Stride Unknown | Stride Indirect | Array Access Efficiency |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
557 | libggml-cpu.so - mmq.cpp:1138-2101 [...] | ggml_backend_amx_mul_mat(ggml_compute_params const*, ggml_tensor*)::{lambda(int, int)#3}::operator()(int, int) const::{lambda()#1}::operator()() const | Single | 4.20 | 6.92 | 6.92 | 1.40 | 1.40 | 1.13 | 1.13 | 189 | 997.84 | NA | NA | NA | NA | NA | 1.24 | NA | NA | NA | NA | NA | 0.00 |
2663 | libggml-cpu.so - sgemm.cpp:144-399 [...] | void (anonymous namespace)::tinyBLAS<16, float __vector(16), float __vector(16), unsigned short, unsigned short, float>::gemm<4, 6, 2>(long, long, long) | Innermost | 0.42 | 0.49 | 0.49 | 0.14 | 0.14 | 0.08 | 0.08 | 192 | 2768.99 | NA | NA | NA | NA | NA | 1.78 | NA | NA | NA | NA | NA | 0.00 |
681 | exec - | __intel_avx_rep_memcpy | Single | 0.18 | 0.14 | 0.14 | 0.06 | 0.06 | 0.02 | 0.02 | 189 | 16.61 | 100 | 50 | 1 | 1 | 2 | 2.7 | 0 | 2 | 0 | 0 | 0 | 100.00 |
638 | libggml-cpu.so - mmq.cpp:303-1392 [...] | void parallel_for<(anonymous namespace)::convert_B_packed_format<block_q8_0, 32>(void*, block_q8_0 const*, int, int)::{lambda(int, int)#1}>(int, (anonymous namespace)::convert_B_packed_format<block_q8_0, 32>(void*, block_q8_0 const*, int,... | Innermost | 0.16 | 0.11 | 0.11 | 0.06 | 0.06 | 0.02 | 0.02 | 173 | 0.00 | 90.91 | 38.76 | 1.33 | 1 | 1.45 | 2.81 | 19 | 0 | 0 | 5 | 0 | 89.58 |
2662 | libggml-cpu.so - sgemm.cpp:144-464 [...] | void (anonymous namespace)::tinyBLAS<16, float __vector(16), float __vector(16), unsigned short, unsigned short, float>::gemm<4, 6, 2>(long, long, long) | InBetween | 0.15 | 0.10 | 0.59 | 0.05 | 0.16 | 0.02 | 0.10 | 192 | 4119.56 | 79.34 | 29.86 | 1.1 | 1.47 | 2.37 | 3.05 | NA | NA | NA | NA | NA | 50.00 |