The “AI as a Service” playbook

Using Tanzu to complete the VCF AI story



Coté

VMUG Connect Amsterdam · March 18, 2026

💾 AI in apps...

IMC Insurance telematics dashboard

👩‍💻 Code-assisted...

Claude Code ChatDM

👔 Agentic normie'ing...

Claude Code demo

Your customers have changed

You used to serve developers. Now you also serve normals.

💾 AI in apps...

  • Sales assistants.
  • Sloppy integration.
  • Science-ing.
  • ???

👩‍💻 Code-assisted...

  • New & old code.
  • SDLC juicing.
  • Trad'l “data science.”
  • Making pptx?

👔 Agentic normie'ing...

  • Your own ChatGPT.
  • Customer service.
  • Better search.
  • Chat-as-UI
Blinking terminal cursor

This is your new problem with AI

  • You can stand up a service
  • ..but then it's just a blinking cursor.
  • You need actual appdev on top.
  • ...and normie dev.
  • I'm going to tell you how VCF with Tanzu does that.

How we got here, fast

🎨 Image gen 2022
🔧 MCP / tool use 2024
👔 Agentic era 2025+
💬 Chat 2022-23
💻 Code gen 2024-25

Sad trombone 😢

There is much power, but much problems.

IDC: 53% AI dev on-prem, 49% AI deploy on-prem
Tanzu AI Services architecture
Coté bio
What's in the box? Platform Engineering.
Tanzu Platform

The one thing you must do right now.

Developer 1 Developer 2 Developer 3 Developer 4

Standards for AI integration, like model context protocol (MCP), are very early; it's a fast-moving world, but they're not all enterprise-ready yet. The solution that Tanzu Platform provides fills the gaps in these enterprise standards while delivering the telemetry we need to understand adoption, usage and continually improve our services.”

Alan Davidson, CIO, Broadcom

Tanzu Platform MCP broker architecture

We are building this platform not for us, we are building it for Mercedes-Benz developers.”

Thomas Müller, Mercedes-Benz

Thomas Müller

💾 AI in apps...

IMC Insurance telematics dashboard

👩‍💻 Code-assisted...

Claude Code ChatDM

👔 Agentic normie'ing...

Claude Code demo

Note: audio, pictures, video are omitted.
Sources: Tanzu customers; “AI at Goldman,” FT, September 14th, 2025; “Leverage Generative AI to Streamline the Software Development Lifecycle,” Banu Parasuraman, Andrew Berenato, Explore 2025, August, 2025. “AI? Who me, insecure?” Coté & David Zinzian, Tanzu Catsup, March 2026.

Your customers have changed

You used to serve developers. Now you also serve normals.

💾 AI in apps...

  • Sales assistants.
  • Sloppy integration.
  • Science-ing.
  • ???

👩‍💻 Code-assisted...

  • New & old code.
  • SDLC juicing.
  • Trad'l “data science.”
  • Making pptx?

👔 Agentic normie'ing...

  • Your own ChatGPT.
  • Customer service.
  • Better search.
  • Chat-as-UI

New things platform engineers will likely do with and for AI

  • Hosting models.
  • Gateways, brokers.
  • Application Frameworks
  • ¿Curating models?
  • Hosting models with self-service access.
  • AIFinOpsBizSREDevOpsEng.
  • ¿Eval, testing, safety?
  • Audit and compliance.
  • Data access.
  • Registries - MCP, prompts, integrations.

What app teams and platform teams need from AI

App Teams
Access curated, secure AI tools/models
Agents accelerate the SDLC
Ensure AI-generated code meets security standards
Quickly deliver new/refactor apps with AI
Platform/AI Teams
Centrally manage MCP servers
Autoscale and easily deploy MCP servers
Enforce governance, tuning, and model compliance
Establish golden path for modernized code deployment
App & Platform/AI Teams
Built-in governance de-risks dev and ops
Secure, governed access for coding assistants
Secure pipeline for rapid, safe innovation
Centralized observability optimizes model usage
AI model provider logos

Supports all major frontier & open source models

  • Model Context Protocol
  • Tool/Function Calling
  • Model Eval
  • Public & private cloud
  • Chat Conversation Memory
  • Vector Databases
  • RAG
  • Embeddings
  • Structured Outputs
Spring AI
  • ChatClient API
  • Chat Completion
  • Text to Speech
  • Text to Image
  • Audio Transcription
  • Moderation
  • Observability
  • Advisors API
  • ETL

Tanzu Platform developer services: Rapid agentic development with Spring AI

Agentic Workflows
Chains, parallelization, routing, orchestrator, patterns in Java
</>
Native MCP/A2A Support
Build and consume MCPs quickly in Spring Boot; connect with A2A
💬
Chat Client API
Fluent API for AI chat model communication; portable across models
Tools/Function calling and Skills
Enables model to execute client-side tools; native Skills integration
📊
Observability
Insights into AI-related operations
📄
Document ingestion
ETL framework for data engineering tasks
🔍
AI model evaluation
Utilities for evaluating generated content
🗄
Vector database support
Compatible with major vector database providers
💭
Chat Memory Support
Support for conversation memory
🔧
AI Config
Update prompts and more with redeploys with Spring Config
Better outcomes for AI-coding assistants

What CIOs are actually prioritizing

Top Ranked IT Initiatives Over The Next 12 Months - Forrester

This is aligned with what CIOs want

What developers need and what you provide are the same thing

What developers need

  • Model access
  • Frameworks (Spring AI)
  • Self-service catalog
  • Fast iteration & sandboxes
  • “AI inference endpoint” not GPU VM tickets

What ops/platform provides

  • Governance & security
  • Cost controls & quotas
  • Approved model catalog
  • Infrastructure (VCF)
  • Tanzu Application Catalog + AI Gateway

“Stop giving developers blinking cursors. Give them a platform.”

Thanks!

🌐 cote.io  ·  🏢 cote@broadcom.com

VMUG survey - take the survey in the mobile app