Companies you'll love to work for

Be placed in the Kapor Talent Network talent network for opportunities from 100+ startups solving real-world problems.

Software Engineer, LLM Frameworks and Tools



Software Engineering
San Francisco, CA, USA
Posted on Wednesday, May 8, 2024

With AI, the world is changing. 92% of employees want to use AI to enhance some part of their jobs. At Asana, this means that it isn’t just an exciting technology, but a seismic shift for our business – we deeply believe in its power to help teams work together more effectively, and we’re committed to building safe and ethical solutions to do so.

Within the AI Org at Asana, the LLM Frameworks and Tooling Team is responsible for supporting and scaling Large Language Model (LLM) development across all of Asana. We are a team with a broad charter that serves multiple customers – we manage the infrastructure that powers all LLM-based user features at Asana, build the code-level abstractions that enable Asana engineers to use that infrastructure easily, and innovate on tools that allow Asana engineers and product leaders to develop, test, observe, and evaluate new AI features safely, quickly, and with high quality.

This role is based in our San Francisco office with an office-centric hybrid schedule. The standard in-office days are Monday, Tuesday, and Thursday. Most Asanas have the option to work from home on Wednesdays. Working from home on Fridays depends on the type of work you do and the teams with which you partner. If you're interviewing for this role, your recruiter will share more about the in-office requirements.

What you’ll achieve

  • Build scalable infrastructure that balance Asana’s costs, values and brand responsibly
  • Simplify AI feature development by creating seamless code-level interfaces with LLMs
  • Create an ecosystem of in-house and third-party tools to enable rapid testing and evaluation of LLM prompts
  • Define and benchmark performance for large-scale Retrieval Augmented Generation (RAG) systems.
  • Analyze problems, consider alternative solutions/trade-offs, and make key technical implementation decisions to help guide the vision of AI development at Asana.
  • Solve scalability challenges to create a best-in-class engineering experience.
  • Support design reviews, communicate constraints, and help engineers make the right trade-offs to develop high-quality code.
  • Evangelize good code, solid engineering and operational excellence.

About you

  • 3 to 5 years of experience building software solutions for internal teams and performance optimization work
  • Has worked directly with internal customers to develop a strong understanding of customer needs, and are equally comfortable using the tools they use
  • Good judgment in mitigating risks and building reliable, scalable, and performant systems
  • Excellent communication skills; can effectively explain the “why” behind your decision-making
  • Others around you learn about new technology from your contributions
  • Passionate about creating a superlative user experience for our engineers and PMs
  • Excited to work in an environment where you and your teammates empower one another to become the best versions of yourselves

At Asana, we're committed to building teams that include a variety of backgrounds, perspectives, and skills, as this is critical to helping us achieve our mission. If you're interested in this role and don't meet every listed requirement, we still encourage you to apply.

What we’ll offer

Our comprehensive compensation package plays a big part in how we recognize you for the impact you have on our path to achieving our mission. We believe that compensation should be reflective of the value you create relative to the market value of your role. To ensure pay is fair and not impacted by biases, we're committed to looking at market value which is why we check ourselves and conduct a yearly pay equity audit.

For this role, the estimated base salary range is between $171,000 - $209,000. The actual base salary will vary based on various factors, including market and individual qualifications objectively assessed during the interview process. The listed range above is a guideline, and the base salary range for this role may be modified.

In addition to base salary, your compensation package may include additional components such as equity, sales incentive pay (for most sales roles), and benefits. If you're interviewing for this role, speak with your Talent Acquisition Partner to learn more about the total compensation and benefits for this role.

We strive to provide equitable and competitive benefits packages that support our employees worldwide and include:

  • Mental health, wellness & fitness benefits
  • Career coaching & support
  • Inclusive family building benefits
  • Long-term savings or retirement plans
  • In-office culinary options to cater to your dietary preferences

These are just some of the benefits we offer, and benefits may vary based on role, country, and local regulations. If you're interviewing for this role, speak with your Talent Acquisition Partner to learn more about the total compensation and benefits for this role.

About us

Asana helps teams orchestrate their work, from small projects to strategic initiatives. Millions of teams around the world rely on Asana to achieve their most important goals, faster. Asana has been named a Top 10 Best Workplace for 5 years in a row, is Fortune's #1 Best Workplace in the Bay Area, and one of Glassdoor’s and Inc.’s Best Places to Work. After spending more than a year physically distanced, Team Asana is safely and mindfully returning to in-person collaboration, incorporating flexibility that adds hybrid elements to our office-centric culture. With 11+ offices all over the world, we are always looking for individuals who care about building technology that drives positive change in the world and a culture where everyone feels that they belong.

We believe in supporting people to do their best work and thrive, and building a diverse, equitable, and inclusive company is core to our mission. Our goal is to ensure that Asana upholds an inclusive environment where all people feel that they are equally respected and valued, whether they are applying for an open position or working at the company. We provide equal employment opportunities to all applicants without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by law. We also comply with the San Francisco Fair Chance Ordinance and similar laws in other locations.