Skip to content

DetailedResults

Jump to bottom
Eike Broda edited this page Jun 8, 2016 · 2 revisions

Results

Results Subdivided by Test Problem.

The tables below show the performance of the [HeuristicsDescription tested dispatching rules], measured by the Mean Flow Time (MFT) and the Performance Index (PI), i.e. the mean flow time normalised by the performance of the SPT rule, for each of the [ProblemsDescription 16 test problems]. The first table shows the results relating to the eight job shop problems, followed by an analog table for the flow shop problems.

An insightful information regarding dispatching rules generated by hyper-heuristics concern the training problems, i.e. the problems that have been used by the hyper-heuristic to evaluate candidate rules. These training problems are indicated in the tables by a quadruple, representing the four experimental factors used in this study, i.e.

  • processing order: job shop (JS) or flow shop (FS),

  • number of operations per job,

  • processing time distribution,

  • utilisation,

where an * indicates that all settings that occur in the test problems for this factor have been used in the generation of the respective dispatching rule.

== Job Shop Problems ==

|| || Test Problems: || Number of operations per job || 2–10 || 2–10 || 2–10 || 2–10 || 10 || 10 || 10 || 10 || || || || Processing time distribution || U[1, 49] || U[1, 49] || U[15, 35] || U[15, 35] || U[1, 49] || U[1, 49] || U[15, 35] || U[15, 35] || || || || Utilisation || 80% || 95% || 80% || 95% || 80% || 95% || 80% || 95% || || Dispatching Rule || Hyper-Heuristic || Training Problems || MFT (PI) || MFT (PI) || MFT (PI) || MFT (PI) || MFT (PI) || MFT (PI) || MFT (PI) || MFT (PI) || || EC2014-TREE_BASE_NORM_ND-Rule || GP_NORM_ND || JS; 10; U[1, 49]; 95% || 366.96 (0.9509) || 787.74 (0.7975) || 346.80 (0.9284) || 738.80 (0.7664) || 592.85 (0.9522) || 1218.27 (0.8236) || 551.96 (0.9300) || 1047.22 (0.7926) || || EC2014-TREE_EXT_NORM_ND-Rule || GP_NORM_ND || JS; 10; U[1, 49]; 95% || 368.17 (0.9540) || 792.83 (0.8027) || 353.38 (0.9460) || 738.40 (0.7659) || 595.97 (0.9572) || 1216.73 (0.8225) || 566.85 (0.9551) || 1038.34 (0.7859) || || GECCO2010-genSeed-2reps || GP || JS; *; U[1, 49]; * || 366.27 (0.9491) || 794.40 (0.8043) || 344.41 (0.9220) || 743.41 (0.7711) || 592.43 (0.9515) || 1221.86 (0.8260) || 548.26 (0.9237) || 1029.68 (0.7793) || || GECCO2010-genSeed-10reps || GP || JS; *; U[1, 49]; * || 366.07 (0.9486) || 798.58 (0.8085) || 343.67 (0.9200) || 748.42 (0.7763) || 591.81 (0.9505) || 1233.49 (0.8339) || 547.95 (0.9232) || 1052.51 (0.7966) || || IFT−UIT+NPT || - || - || 364.26 (0.9439) || 824.21 (0.8344) || 339.09 (0.9077) || 764.26 (0.7928) || 586.96 (0.9427) || 1247.79 (0.8435) || 536.83 (0.9045) || 1049.92 (0.7946) || || EC2014-LIN_BASE-Rule || CMA-ES || JS; 10; U[1, 49]; 95% || 377.47 (0.9781) || 845.58 (0.8561) || 354.20 (0.9482) || 775.99 (0.8049) || 607.93 (0.9764) || 1301.07 (0.8796) || 562.30 (0.9474) || 1092.49 (0.8269) || || 2PT+WINQ+NPT || - || - || 382.67 (0.9916) || 880.04 (0.8910) || 352.41 (0.9434) || 788.39 (0.8178) || 614.81 (0.9875) || 1361.64 (0.9205) || 557.00 (0.9385) || 1100.49 (0.8329) || || ASP2013-Rule #6 || MOGP || JS; 2–14; U[1, 49]; 70%, 80% || 382.74 (0.9918)|| 898.82 (0.9100) || 361.38 (0.9674) || 825.96 (0.8568) || 615.33 (0.9883) || 1385.16 (0.9364) || 568.12 (0.9572) || 1126.81 (0.8528) || || PT+WINQ || - || - || 385.61 (0.9992) || 944.36 (0.9561) || 351.23 (0.9402) || 803.12 (0.8331) || 622.15 (0.9992) || 1468.70 (0.9929) || 556.66 (0.9379) || 1126.45 (0.8526) || || SPT || - || - || 385.91 (1.0000) || 987.73 (1.0000) || 373.56 (1.0000) || 964.04 (1.0000) || 622.62 (1.0000) || 1479.24 (1.0000) || 593.53 (1.0000) || 1321.25 (1.0000) || || Tie-Breaker || - || - || 496.99 (1.2878) || 1509.34 (1.5281) || 411.80 (1.1024) || 1120.54 (1.1623) || 798.18 (1.2820) || 2199.00 (1.4866) || 647.88 (1.0916) || 1446.77 (1.0950) ||

== Flow Shop Problems ==

|| || Test Problems: || Number of operations per job || 2–10 || 2–10 || 2–10 || 2–10 || 10 || 10 || 10 || 10 || || || || Processing time distribution || U[1, 49] || U[1, 49] || U[15, 35] || U[15, 35] || U[1, 49] || U[1, 49] || U[15, 35] || U[15, 35] || || || || Utilisation || 80% || 95% || 80% || 95% || 80% || 95% || 80% || 95% || || Dispatching Rule || Hyper-Heuristic || Training Problems || MFT (PI) || MFT (PI) || MFT (PI) || MFT (PI) || MFT (PI) || MFT (PI) || MFT (PI) || MFT (PI) || || EC2014-TREE_BASE_NORM_ND-Rule || GP_NORM_ND || JS; 10; U[1, 49]; 95% || 347.38 (0.9671) || 787.15 (0.8360) || 312.10 (0.9658) || 727.69 (0.8289) || 506.46 (0.9872) || 1159.27 (0.9295) || 381.40 (0.9977) || 779.84 (0.9604) || || EC2014-TREE_EXT_NORM_ND-Rule || GP_NORM_ND || JS; 10; U[1, 49]; 95% || 348.43 (0.9700) || 791.74 (0.8409) || 315.13 (0.9751) || 730.64 (0.8322) || 507.67 (0.9895) || 1168.53 (0.9370) || 382.62 (1.0009) || 791.49 (0.9747) || || GECCO2010-genSeed-2reps || GP || JS; *; U[1, 49]; * || 348.55 (0.9704) || 799.87 (0.8495) || 312.83 (0.9680) || 740.83 (0.8438) || 510.49 (0.9950) || 1177.82 (0.9444) || 384.22 (1.0051) || 801.92 (0.9876) || || GECCO2010-genSeed-10reps || GP || JS; *; U[1, 49]; * || 346.64 (0.9651) || 800.10 (0.8498) || 311.12 (0.9627) || 742.04 (0.8452) || 505.77 (0.9858) || 1187.17 (0.9519) || 380.17 (0.9945) || 785.23 (0.9670) || || IFT−UIT+NPT || - || - || 345.70 (0.9624) || 832.86 (0.8846) || 308.57 (0.9548) || 753.88 (0.8587) || 506.10 (0.9865) || 1202.10 (0.9639) || 381.24 (0.9973) || 790.48 (0.9735) || || EC2014-LIN_BASE-Rule || CMA-ES || JS; 10; U[1, 49]; 95% || 355.93 (0.9909) || 867.47 (0.9213) || 316.74 (0.9801) || 774.48 (0.8822) || 513.62 (1.0011) || 1298.25 (1.0410) || 381.16 (0.9971) || 811.59 (0.9995) || || 2PT+WINQ+NPT || - || - || 358.08 (0.9969) || 880.40 (0.9351) || 316.42 (0.9791) || 774.19 (0.8818) || 515.51 (1.0048) || 1327.86 (1.0647) || 381.01 (0.9967) || 815.14 (1.0039) || || ASP2013-Rule #6 || MOGP || JS; 2–14; U[1, 49]; 70%, 80% || 356.91 (0.9936)|| 912.58 (0.9693) || 320.84 (0.9928) || 834.38 (0.9504) || 513.28 (1.0005) || 1264.82 (1.0142) || 381.35 (0.9976) || 810.86 (0.9986) || || PT+WINQ || - || - || 357.53 (0.9954) || 906.18 (0.9625) || 316.13 (0.9782) || 782.94 (0.8918) || 513.04 (1.0000) || 1247.14 (1.0000) || 382.27 (1.0000) || 812.01 (1.0000) || || SPT || - || - || 359.19 (1.0000) || 941.53 (1.0000) || 323.16 (1.0000) || 877.92 (1.0000) || 513.04 (1.0000) || 1247.14 (1.0000) || 382.27 (1.0000) || 812.01 (1.0000) || || Tie-Breaker || - || - || 460.99 (1.2834) || 1589.33 (1.6880) || 356.57 (1.1034) || 1117.48 (1.2729) || 624.66 (1.2176) || 2115.55 (1.6963) || 393.81 (1.0302) || 945.03 (1.1638) ||

Clone this wiki locally