VarolioVarolio Docs
Deployment scenarios

Cloud-Prem

Full Varolio deployment inside the customer's own cloud account — AWS, GCP, or Azure

Cloud-Prem

Cloud-Prem is Varolio's deployment model for organizations that require their data and compute to remain in their own cloud account. The customer owns the account; Varolio provisions and operates the platform inside it through a revocable operator identity the customer creates and controls.

The software running in the customer's account is functionally identical to Cloud SaaS — same services, same data layer, same AI surface. The difference is that the entire stack is single-tenant, dedicated, and bounded by the customer's cloud account.

Unlike vendor-locked offerings, Cloud-Prem is cloud-agnostic: the customer chooses the vendor, and Varolio deploys on AWS, GCP, or Azure. Select your provider to see the architecture, terminology, and provisioning steps for that cloud:

Cloud provider:
Varolio Operations
SSO-gated · short-lived credentials
Customer Users
Customer AWS Account
Cross-account IAM role
trust policy · sts:ExternalId
AWS WAF + Application Load Balancer
Data stores — customer AWS account
Amazon RDS
Amazon RDS
PostgreSQL
Amazon S3
Amazon S3
object storage
OpenSearch Service
OpenSearch Service
or self-managed ECK
ElastiCache
ElastiCache
Redis
Amazon EKS clustercontainer images deployed via Helm · GitOps
Engine
API service · control-plane access
Agent
AI orchestration · retrieval
Worker
Temporal workflow worker
MCP Server
MCP endpoint
Temporal (self-hosted)
workflow orchestration
AI Providers
Amazon Bedrock
Amazon Bedrock
in-account
Vertex AI (Gemini)
Vertex AI (Gemini)
via customer egress

How it works

A dedicated AWS account holds the Varolio environment: a VPC, an Amazon EKS cluster, Amazon RDS for PostgreSQL, search (Amazon OpenSearch Service, or self-managed Elasticsearch via the ECK operator in the cluster), ElastiCache for Redis, Amazon S3 object storage, and AWS Secrets Manager. The customer creates a cross-account IAM role that Varolio uses to provision (infrastructure as code) and operate (Helm-driven deploys) the environment.

The customer's data never leaves their account, except for HTTPS calls to AI model providers. On AWS, Amazon Bedrock can be invoked directly in the customer's account, so those model calls don't have to leave it; calls to other providers (e.g. Vertex AI for Gemini) cross the customer's egress.

What runs in your cluster

Varolio's services ship as signed container images and are deployed into the Kubernetes cluster via Helm and GitOps — each as a standard Kubernetes workload in its own namespace:

WorkloadRole
EngineAPI service — terminates all traffic, the only service with control-plane (PostgreSQL) access
AgentAI orchestration and retrieval — the only service that talks to Elasticsearch, reached via the Engine
WorkerExecutes asynchronous Temporal workflows
MCP ServerModel Context Protocol endpoint
TemporalSelf-hosted workflow orchestration (replaces Temporal Cloud used in Varolio-hosted models)

What's the same as Cloud SaaS

  • Every service runs unchanged: engine (API), agent (AI orchestration), worker (Temporal workflows), archiver, MCP server, web applications.
  • The data layer is the same shape: PostgreSQL, Elasticsearch, object storage, Redis, Temporal (self-hosted in the cluster).
  • The release pipeline is the same: CI-gated, peer-reviewed builds; the customer's cluster pulls signed container images from Varolio's registry.

What's different

Cloud SaaSCloud-Prem
TenancyMulti-tenantSingle-tenant, dedicated
Cloud accountVarolio'sCustomer's
Cloud vendorAWS + GCPCustomer's choice: AWS, GCP, or Azure
RegionEU (Frankfurt)Customer's choice
Operator accessVarolio internal SSOVarolio SSO + customer-created revocable identity
Egress to model providersVia Varolio's NATVia customer's NAT
Cloud billIncluded in subscriptionDirect to customer
Upgrade cadenceRolling, gated by CI + reviewScheduled with customer

Operator access model

Varolio never receives standing user accounts in the customer's cloud. Access is granted through one identity, created by the customer and revocable at any time:

The customer creates a cross-account IAM role in the deployment account with a trust policy toward Varolio's deploy account, conditioned on an sts:ExternalId unique to the engagement. Varolio's operator tooling assumes the role with short-lived STS credentials — no long-lived access keys, no IAM users. Every operator action is recorded in the customer's own AWS CloudTrail under the assumed-role session identity.

On top of the cloud identity, day-to-day operation of the cluster uses scoped Kubernetes RBAC — Varolio's operational tooling is limited to the namespaces and resources of the Varolio deployment.

What Varolio can doProvision and update the platform's infrastructure (tagged/prefixed resources only), deploy and roll back application releases, read platform logs and metrics, manage platform secrets
What Varolio cannot doAccess resources outside the Varolio deployment's scope, create cloud users, or reach the account from anywhere but its SSO-gated operator tooling — all operator access is outbound-only with short-lived credentials
How you revoke itDisable the trust policy / federation / role assignment — a one-line change on your side. The deployment continues to run; Varolio loses the ability to operate it until the grant is restored

Account requirements

  • A dedicated AWS account for the deployment, separate from the customer's primary production workloads.
  • A region where Amazon EKS, Amazon RDS for PostgreSQL, and Amazon S3 are available.
  • Sufficient service quotas for the EKS cluster, RDS instances, and NAT Gateway egress before provisioning.
  • AWS Organizations SCPs are supported; Varolio publishes the IAM actions the deployment requires so they can be allow-listed.

Network and connectivity

Ingress. Public access is fronted by AWS WAF on an Application Load Balancer inside the customer's account, with TLS 1.2+ enforced at the edge. The public hostname is scoped per engagement — either a {customer}.varolio.io subdomain managed by Varolio or a customer-owned domain.

Egress. All outbound traffic exits via the customer's NAT Gateway. The AI model provider endpoints and the integration endpoints the customer activates (Microsoft Graph, Gmail, WhatsApp, Recall.ai) must be reachable from the customer's egress.

Customer data sources. The deployment reaches the customer's mail tenant and other SaaS integrations over their public APIs with OAuth credentials the customer authorizes — the same as every other deployment model.

Encryption

LayerDefaultCustomer-managed key option
Databases and search at restAES-256, AWS-managedAWS KMS customer-managed key, configurable per engagement
Object storage (S3)AES-256, AWS-managed (SSE-S3)AWS KMS customer-managed key (SSE-KMS)
Application secretsAWS Secrets ManagerCustomer KMS-key-wrapped secrets
In transitTLS 1.2+ at every hopn/a

Because the account is customer-owned, customer-managed encryption keys (BYOK) are supported — the keys remain under the customer's control at all times.

Provisioning lifecycle

  1. Kickoff. Customer provides the AWS account ID and chosen region. Varolio provides the infrastructure-as-code module and the IAM role definition (permission set + trust policy) for review.
  2. Identity grant. Customer creates the cross-account IAM role with the published, least-privilege permission set and the engagement-specific sts:ExternalId.
  3. Provisioning. Varolio applies the infrastructure-as-code: VPC, EKS cluster, RDS, search, ElastiCache, S3 buckets, Secrets Manager entries.
  4. Install. Varolio installs the platform via Helm, pinned to a known release; secrets sync from Secrets Manager into the cluster.
  5. Identity onboarding. SSO is configured against the customer's IdP; the first admin user is invited.
  6. Cutover. The customer begins using the deployment. Varolio operates and monitors it on a cadence agreed with the customer.

When to choose a different model

  • Choose Dedicated Cloud if you need single-tenant isolation and region choice but prefer Varolio to own and bill the cloud account.
  • Choose BYO Data Store if hosting the content data plane (search, LLM, object storage) is sufficient and you don't need the full stack in your account.

AI Tools

Ask ChatGPTAsk Claude

On this page