forked from zhoulin/zl_bench
feat: make the harness backend-agnostic
Everything about which accelerator a run targets was previously spelled CUDA: device discovery went through nvidia-smi, pinning through CUDA_VISIBLE_DEVICES, the vendor guard only recognised NVIDIA, and the -p plugin list was hardcoded in run_pytest.sh with no way to drop the CUDA-only members. Running the same operator corpus on another vendor's device therefore meant editing the drivers. The selection now hangs off one ZL_BACKEND variable (cuda/musa/rocm/ascend, with the usual aliases): - backends/ owns per-backend device enumeration, visibility env keys and capability flags, so nothing above it names a vendor; - plugin_plan.py derives the -p list from those capabilities instead of a hardcoded array, which is what lets a non-CUDA run omit the graph-capture and cluster-fix plugins rather than watch them fail; - _timing_plugin selects the timer from the same capabilities: CUDA keeps graph capture with its per-shape fallback, other backends stay on upstream do_bench and record timer=direct, because capture-then-fallback on a device without graph support only produces noise; - _device_setup_plugin replaces the NVIDIA-only vendor guard; - providers/flaggems.py resolves the pytest node, so a caller may pass TEST_NODE directly instead of the OP/OP_FILE pair, and SHAPE_MODE=upstream can defer to FlagGems' own core_shapes; - _run_identity.py writes run_identity.json next to each run, recording backend, device, timer, autotune mode and the resolved test node. Two runs whose calibers differ are otherwise indistinguishable after the fact. run_batch gains --backend and --devices (--gpus kept as an alias) and carries backend/device/timer into ops_status.csv. test_backends.py covers the registry, alias resolution, visibility env and plugin planning. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
1 parent
35a928a516
commit
c8ea586d0f
24 files changed
+1448
-159
No files matched your search
+21
-5
@@ -402,17 +402,33 @@ def _dump_ttgir(cache_dir: str, dump_dir: str) -> None:
|
||||
|
||||
def pytest_configure(config):
|
||||
global _dump_enabled
|
||||
import triton
|
||||
import triton.runtime.autotuner as _autotuner
|
||||
from _term_style import tag
|
||||
try:
|
||||
import triton
|
||||
import triton.runtime.autotuner as _autotuner
|
||||
except Exception as exc:
|
||||
print(f"{tag('[ir-meta-plugin]')} Triton knobs unavailable ({exc}); "
|
||||
"IR collection disabled", file=sys.stderr, flush=True)
|
||||
return
|
||||
if not hasattr(triton, "knobs"):
|
||||
print(f"{tag('[ir-meta-plugin]')} triton.knobs missing; "
|
||||
"IR collection disabled", file=sys.stderr, flush=True)
|
||||
return
|
||||
|
||||
prev = triton.knobs.compilation.listener
|
||||
try:
|
||||
compilation = triton.knobs.compilation
|
||||
prev = compilation.listener
|
||||
except Exception as exc:
|
||||
print(f"{tag('[ir-meta-plugin]')} compilation listener unavailable "
|
||||
f"({exc}); IR collection disabled", file=sys.stderr, flush=True)
|
||||
return
|
||||
if prev is None:
|
||||
triton.knobs.compilation.listener = _compile_listener
|
||||
compilation.listener = _compile_listener
|
||||
else:
|
||||
def chained(**kwargs):
|
||||
prev(**kwargs)
|
||||
_compile_listener(**kwargs)
|
||||
triton.knobs.compilation.listener = chained
|
||||
compilation.listener = chained
|
||||
|
||||
dump_dir = os.environ.get(_DUMP_DIR_ENV, "").strip()
|
||||
if dump_dir:
|
||||
|
||||
Reference in new issue
Block a user