Connect Braintrust to Openlayer

Both apps 43Braintrust 19Openlayer 24

• Trigger
  New Event

  Triggers when an automation creates a new event.

• Trigger
  New Project

  Triggers when a new project is created.

• Action
  Add dataset

  Create a new Braintrust dataset. POST /v1/dataset

• Action
  Add experiment

  Create a new Braintrust experiment. POST /v1/experiment

• Action
  Add project

  Create a new Braintrust project. POST /v1/project

• Action
  Add prompt

  Create a new Braintrust prompt. POST /v1/prompt

• Action
  Delete project

  Delete a Braintrust project. DELETE /v1/project/{project_id}

• Action
  Get dataset

  Retrieve a Braintrust dataset by id. GET /v1/dataset/{dataset_id}

• Action
  Get experiment

  Retrieve a Braintrust experiment by id. GET /v1/experiment/{experiment_id}

• Action
  Get project

  Retrieve a Braintrust project by id. GET /v1/project/{project_id}

• Action
  Get prompt

  Retrieve a Braintrust prompt by id. GET /v1/prompt/{prompt_id}

• Action
  Insert dataset events

  Insert one or more rows/events into a Braintrust dataset. POST /v1/dataset/{dataset_id}/insert

• Action
  Insert experiment events

  Insert one or more events (spans/rows) into a Braintrust experiment. POST /v1/experiment/{experiment_id}/insert

• Action
  Insert project logs events

  Insert one or more log events into a Braintrust project's logs. POST /v1/project_logs/{project_id}/insert

• Action
  List datasets

  List Braintrust datasets. GET /v1/dataset

• Action
  List experiments

  List Braintrust experiments. GET /v1/experiment

• Action
  List projects

  List all Braintrust projects. GET /v1/project

• Action
  List prompts

  List Braintrust prompts. GET /v1/prompt

• Action
  Update project

  Partially update a Braintrust project. PATCH /v1/project/{project_id}

• Trigger
  New Project

  Triggers when a new project is created in your Openlayer workspace.

• Trigger
  New Test Result

  Triggers when a new test result is available for a data source. Useful for alerting on passing or failing model tests.

• Action
  Create Data Source

  Creates a new data source in a project for streaming production data to Openlayer.

• Action
  Create Project

  Creates a new AI or ML project in your Openlayer workspace.

• Action
  Create Test

  Creates a data quality test in a project. Checks for duplicate rows, null values, or row counts.

• Action
  Delete Inference Pipeline

  Delete an inference pipeline by its ID. DELETE /inference-pipelines/{id}

• Action
  Delete Project

  Delete a project by its ID. DELETE /projects/{id}

• Action
  Delete Test

  Delete a test by its ID. DELETE /tests/{testId}

• Action
  Evaluate Test

  Evaluates a test for a specific time range. Use after publishing records to get immediate results.

• Action
  Find Data Source

  Finds a data source (inference pipeline) by name in a project.

• Action
  Find Project

  Finds a project by name in your Openlayer workspace.

• Action
  Find Test Result

  Finds test results for a data source, including whether each test passed or failed. Filter by outcome or test type to branch an automation on the result.

• Action
  Get Inference Pipeline

  Retrieve the details around a specific inference pipeline. GET /inference-pipelines/{id}

• Action
  Get Project

  Retrieves one project by its id. Openlayer has no single-project endpoint, so this reads the workspace's first 100 projects and returns the one matching the id.

• Action
  Get Test

  Retrieve a test by ID. GET /tests/{testId}

• Action
  Get Test Result

  Retrieves one test result by its id. Openlayer has no single-result endpoint, so this reads the data source's 100 most recent results and returns the matching one.

• Action
  List Inference Pipelines

  List the authenticated user's inference pipelines under a project. GET /projects/{id}/inference-pipelines

• Action
  List Projects

  Lists the projects in your Openlayer workspace, optionally narrowed to one kind of project. Returns up to 100 projects.

• Action
  List Test Results

  List all results for a test/goal under an inference pipeline. GET /inference-pipelines/{id}/results or GET /tests/{id}/results

• Action
  List Tests

  Lists the tests in a project, optionally narrowed by kind, archived state or monitoring mode. Returns up to 100 tests.

• Action
  Publish Record

  Publishes an LLM inference record to a data source for monitoring. Streams the model input, output, and metadata to Openlayer.

• Action
  Update Inference Pipeline

  Update an inference pipeline. PUT /inference-pipelines/{id}

• Action
  Update Project

  Update a project. PUT /projects/{id}

• Action
  Update Test

  Update a test (partial updates allowed). PUT /tests/{testId}

No trigger or action matches that. Ask your agent to add it: it reads the API documentation and builds what you describe.