Class OnnxInferenceBenchmark

java.lang.Object
com.helix.experiments.benchmarks.OnnxInferenceBenchmark
Direct Known Subclasses:
OnnxInferenceBenchmark_jmhType_B1

public class OnnxInferenceBenchmark extends Object
JMH Microbenchmark measuring single-row inline ONNX inference latency (P50, P90, P99) versus simulated HTTP REST inference overhead.
  • Constructor Details

    • OnnxInferenceBenchmark

      public OnnxInferenceBenchmark()
  • Method Details

    • setup

      public void setup() throws Exception
      Throws:
      Exception
    • tearDown

      public void tearDown()
    • benchmarkInlineOnnxRuleExecution

      public ExecutionResult benchmarkInlineOnnxRuleExecution() throws Exception
      Throws:
      Exception
    • benchmarkSimulatedRestInference

      public Object benchmarkSimulatedRestInference()