- Direct Known Subclasses:
OnnxInferenceBenchmark_jmhType_B1
public class OnnxInferenceBenchmark
extends Object
JMH Microbenchmark measuring single-row inline ONNX inference latency (P50, P90, P99)
versus simulated HTTP REST inference overhead.
-
Constructor Summary
Constructors
-
Method Summary
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
Constructor Details
-
OnnxInferenceBenchmark
public OnnxInferenceBenchmark()
-
Method Details
-
-
tearDown
public void tearDown()
-
benchmarkInlineOnnxRuleExecution
- Throws:
Exception
-
benchmarkSimulatedRestInference
public Object benchmarkSimulatedRestInference()