Alauda AI

Install TrustyAI

In Alauda AI 2.8.x, Alauda Build of TrustyAI is installed and managed by Alauda AI. The trustyAI component in the cluster-scoped default AmlCluster defaults to Unmanaged; set it to Managed, and you do not need to install the Operator from OperatorHub manually. After the component is reconciled, TrustyAI custom resources can be created to use its capabilities.

TOC

Upload the Operator PackageEnable TrustyAIVerify the InstallationNext steps

Upload the Operator Package

Download the TrustyAI Operator package, then upload the package following Upload Packages.

Enable TrustyAI

In Administrator view:

  1. Open Marketplace > OperatorHub.
  2. Select the target cluster and open Alauda AI.
  3. Open the All Instances tab and edit the default AmlCluster instance.
  4. Set spec.components.trustyAI.managementState to Managed.
  5. Save the AmlCluster instance and wait for the TrustyAI Operator to become ready.

You can apply the component setting in the AmlCluster YAML:

spec:
  components:
    trustyAI:
      managementState: Managed

Verify the Installation

Check the AmlCluster status and the TrustyAI Operator:

kubectl get amlcluster default

kubectl get pods -n trustyai-operator-system

The AmlCluster should report Phase=Ready, and the TrustyAI Operator controller pod should be in Running state. The TrustyAI CRDs are registered once the operator is ready.

Next steps

After the component is enabled, users can use CRDs such as TrustyAIService, LMEvalJob, GuardrailsOrchestrator, and NemoGuardrails to deploy inference monitoring (TrustyAI Service), run model evaluation tasks, and manage AI guardrails orchestration (both FMS Guardrails and NeMo Guardrails).

See Deploy TrustyAI Service and Bias and Drift Monitoring, Evaluate LLM, AI Guardrails for LLM safety, and NeMo Guardrails for details.