About this role
AI Inference Engineer (f/m/d) at ITRex Group. Location: Hungary or Europe. Role: deploying models, optimizing inference, profiling performance Requirements: 4+ years C++ (C++17/20), strong systems programming (memory, multithreading), Linux experience, ML model deployment and inference optimization experience, familiarity with inference frameworks and profiling. Category: Software Development Seniority: Mid Level Tools: C++17, C++20, llama.cpp, ggml, ONNX Runtime, TensorRT, TensorRT-LLM, OpenVINO, MLC LLM, ExecuTorch, TVM, Linux, CUDA, Vulkan Compute, Metal, OpenCL, Typescript, Python Commitment: Full Time Workplace: Remote Languages: English