A JIT Compiler for Neural Network Inference

1 code implementation • 13 Jun 2019 • Felix Thielke, Arne Hasselbring

This paper describes a C++ library that compiles neural network models at runtime into machine code that performs inference.