App
Openlayer
Openlayer is a platform for monitoring, evaluating, and testing AI and ML models in production.
What your agent can do with Openlayer
Triggers and actions 2 triggers · 22 actions
- TriggerNew Project
Triggers when a new project is created in your Openlayer workspace.
- TriggerNew Test Result
Triggers when a new test result is available for a data source. Useful for alerting on passing or failing model tests.
- ActionCreate Data Source
Creates a new data source in a project for streaming production data to Openlayer.
- ActionCreate Project
Creates a new AI or ML project in your Openlayer workspace.
- ActionCreate Test
Creates a data quality test in a project. Checks for duplicate rows, null values, or row counts.
- ActionDelete Inference Pipeline
Delete an inference pipeline by its ID. DELETE /inference-pipelines/{id}
- ActionDelete Project
Delete a project by its ID. DELETE /projects/{id}
- ActionDelete Test
Delete a test by its ID. DELETE /tests/{testId}
- ActionEvaluate Test
Evaluates a test for a specific time range. Use after publishing records to get immediate results.
- ActionFind Data Source
Finds a data source (inference pipeline) by name in a project.
- ActionFind Project
Finds a project by name in your Openlayer workspace.
- ActionFind Test Result
Finds test results for a data source, including whether each test passed or failed. Filter by outcome or test type to branch an automation on the result.
- ActionGet Inference Pipeline
Retrieve the details around a specific inference pipeline. GET /inference-pipelines/{id}
- ActionGet Project
Retrieves one project by its id. Openlayer has no single-project endpoint, so this reads the workspace's first 100 projects and returns the one matching the id.
- ActionGet Test
Retrieve a test by ID. GET /tests/{testId}
- ActionGet Test Result
Retrieves one test result by its id. Openlayer has no single-result endpoint, so this reads the data source's 100 most recent results and returns the matching one.
- ActionList Inference Pipelines
List the authenticated user's inference pipelines under a project. GET /projects/{id}/inference-pipelines
- ActionList Projects
Lists the projects in your Openlayer workspace, optionally narrowed to one kind of project. Returns up to 100 projects.
- ActionList Test Results
List all results for a test/goal under an inference pipeline. GET /inference-pipelines/{id}/results or GET /tests/{id}/results
- ActionList Tests
Lists the tests in a project, optionally narrowed by kind, archived state or monitoring mode. Returns up to 100 tests.
- ActionPublish Record
Publishes an LLM inference record to a data source for monitoring. Streams the model input, output, and metadata to Openlayer.
- ActionUpdate Inference Pipeline
Update an inference pipeline. PUT /inference-pipelines/{id}
- ActionUpdate Project
Update a project. PUT /projects/{id}
- ActionUpdate Test
Update a test (partial updates allowed). PUT /tests/{testId}
No trigger or action matches that. Ask your agent to add it: it reads the API documentation and builds what you describe.
Not listed?
Need a trigger or action that is not here?
Ask your agent. Describe what you need in plain language and it reads the Openlayer API documentation, builds the operation at whatever depth the API allows, tests every branch and ships it. The list above is what exists today, not the limit.