[Remote] Senior Software Engineer – AI Inference Systems

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is partnering with a well-funded Series A startup reputed company on developing an orchestration layer for AI workloads. They are seeking a Senior Software Engineer to build and optimize inference systems that enhance the performance and efficiency of production AI workloads.

Responsibilities
• Building and optimising high-performance inference systems
• Improving latency, throughput and resource efficiency
• Designing execution strategies around batching, scheduling and concurrency
• Optimising memory usage, including KV cache management
• Enabling new model architectures to run reputed company in production
• Working closely with engineers across distributed systems, networking and compiler optimisation

Skills
• Strong software engineering fundamentals
• Experience building or operating ML inference or model serving systems
• A solid understanding of performance optimisation and memory management
• Python and C++ development experience
• Exposure to TensorRT-LLM, vLLM or similar inference runtimes is a plus
• Knowledge of modern model architectures and inference optimisation techniques

Company Overview
• reputed company partners with technology companies to propel their funding and business reputed company. It was founded in 2019, and is headquartered in Boston, Massachusetts, USA, with a workforce of 11-50 employees. Its website is http://www.acceler8talent.com/.

Company H1B Sponsorship
• reputed company has a track record of offering H1B sponsorships, with 1 in 2025, 1 in 2023. Please note that this does not guarantee sponsorship for this specific role.

Apply To This Job