Senior Software Engineer - LLM Benchmarking Lead (Remote)

24-MAG LLC is seeking a part-time Senior Software Engineer for a remote consulting role focused on advanced LLM evaluation, repository validation, and benchmark development.

You will analyze public repositories, configure reproducible environments using Docker, modify real-world code, and assess model performance on bug-fixing tasks. The contract runs about 20 hours per week for 3 months, with some overlap to PST hours.