Adding compilation mode

[pnikolic-amd]

Motivation

Adding compilation mode which defines factor between compilation time and quality of model optimization. This is defined by compile option "compile_mode" which is defined by int value 0-100 (0 - fast, minimal/no optimization, 100 slow, best optimization quality).

Technical Details

compile_mode is represented by enum class compile_modes, and int value is mapped in the closest value. There are three modes defined for now (more fine-grained system can be implemented later):

• BALANCED (50) - Default execution of model compilation
• MAX (100) - Default execution with exhaustive_tune flag enabled
• EAGER (0) - Removed most of gpu independent passes except fusions and normalize_ops and skiped benchmarking for gpu kernels

Tested on both platforms, Eager mode improves compilation time up to 10x while decreasing inference performance for 20-50%.

Changelog Category

Add a CHANGELOG.md entry for any option other than Not Applicable

• • Added: New enum class compile_modes that define compile options
• • Added: New param compile_mode in compile_options struct
• • Added: Added support to set compile mode using all supported APIs and added flag for migraphx-driver app.
• • Changed: Changed get passes function for gpu target, to support execution in defined modes.
• • TODO: Add support to skip fusions in eager mode
• • TODO: Re-run mgx tests in eager mode

---