2025-11-06 Thu

• Langsmithery

  • LangSmith/Eval/Q/Can an Annotation Queue be attached to an Evaluator
  • Discovered that Custom Output Rendering is possible on a LangSmith/Annotation/Queue; see LangSmith/Docs/Custom Output Rendering
  • LangSmith/Eval/Idea/Store One Annotation Queue Per Behavior
  • LangSmith/Resource/Tag/Q/What types of resource tags are there
  • LangSmith/Annotation/Queue/Q/What goes in the default dataset

• GitHubbery

  • GitHub/Codespace/Q/Can OIDC Grant Access to AWS Bedrock as in GitHub Actions for Claude Code

• AWSery

  • AWS/Solutions Library/Sample/Guidance for Claude Code with Amazon Bedrock created to document the AWS Solutions Library sample repository that demonstrates secure enterprise authentication for Amazon Bedrock using OIDC identity providers and AWS services
  • AWS/IAM/Identity Center/Technique/Long-Lived Temporary Credentials - Notes on using AWS IAM Identity Center as an alternative to role chaining for longer-lived temporary credentials (1-12 hours vs 1 hour limit)

• AI Security

  • PromptFooAI - Testing framework for LLM applications that helps detect prompt injection attacks and other security vulnerabilities