Software/ML Engineer

We're assembling a group of senior software and ML engineers to work on one of the hardest open problems in AI today: how well can frontier models reason about LLM inference systems, GPU-level performance optimization, and model-serving architecture? You'll help design evaluation scenarios, write reference solutions, and grade model outputs on real systems-engineering problems - the same class of problems you likely work on day-to-day.

This is a research-and-evaluation role, not a traditional engineering job - you won't be shipping production code for us, you'll be defining what "correct" and "excellent" look like for AI models tackling the problems you already know deeply.

Responsibilities

• What You'll Do Design realistic technical scenarios and problem sets in LLM inference optimization, GPU kernel design, and systems performance engineering

Required qualifications

• Bachelor's degree or higher in Computer Science, Computer Engineering, Electrical Engineering, or a related field
• Strong, hands-on background in one or more of: GPU inference optimization, custom CUDA kernel development, model-serving systems (e.g., vLLM, TensorRT-LLM, SGLang), quantization, or optimizer design
• Experience at a recognized technology or AI company, in a role with real systems-engineering ownership
• Strong written communication - you'll be authoring technical explanations and feedback, not just code

Preferred qualifications

• Direct experience with SGLang, Mamba/Mamba2 architectures, or IBM Granite-family models
• Open-source contributions to inference/serving frameworks (vLLM, SGLang, TensorRT-LLM, etc.)
• Experience with distributed inference (tensor/expert parallelism, continuous batching, KV-cache optimization)

Why apply

• Remote, contract, part-time
• Flexible - work on your own schedule

Where you can work

This role is 100% remote: you can work from any country except Andorra, Afghanistan, Angola, Argentina, Azerbaijan, Barbados, Bangladesh, Burkina Faso, Burundi, Bolivia, Brazil, Belarus, Belize, DR Congo, Central African Republic, Congo (Republic), Chile, Cameroon, China, Colombia, Cuba, Cape Verde, Djibouti, Dominica, Dominican Republic, Egypt, Eritrea, Fiji, Micronesia, Gabon, Grenada, Georgia, Ghana, Gibraltar, Guinea, Equatorial Guinea, Guinea-Bissau, Honduras, Haiti, Iraq, Iran, Japan, Kyrgyzstan, Cambodia, Kiribati, Comoros, St. Kitts and Nevis, North Korea, South Korea, Kazakhstan, Laos, Lebanon, Liberia, Lesotho, Libya, Monaco, Montenegro, Marshall Islands, Mali, Myanmar, Macau, Mauritania, Maldives, Malawi, Niger, Nigeria, Nicaragua, Nepal, Nauru, Papua New Guinea, Palestine, Palau, Paraguay, Russia, Saudi Arabia, Solomon Islands, Seychelles, Sudan, Sierra Leone, San Marino, Somalia, Suriname, South Sudan, São Tomé and Príncipe, Syria, Eswatini, Chad, Togo, Tajikistan, Timor-Leste, Turkmenistan, Tonga, Tuvalu, Ukraine, Uganda, Uruguay, Vatican City, St. Vincent and Grenadines, Venezuela, Vanuatu, Samoa, Yemen, Zambia and Zimbabwe.