PromptFooAI

• PromptFooAI

  • PromptFoo - Testing framework for LLM applications
    • PromptFoo is a testing framework for LLM applications that helps detect prompt injection attacks and other security vulnerabilities
    • Has evals (like LangSmith)

  • Mentions

    • Person/Shawn @swyx Wang mentioned PromptFoo in Latent Space/Pod episode about Sander Schulhoff's The Prompt Report
      • Consistently use the OpenAI playground for prompting. (50sec)
      • swyx called out specialists in this area: PromptLayerAI, BraintrustAI, PromptFooAI, HumanloopAI