Lab 2 Β· UOB Workshop

πŸŽ“ Capstone Β· Teams of 4–5 Β· Build Kit take-home

πŸ’‘ Agentic Pilot Canvas

You've learned what makes a system agentic, the workflow patterns, the Quick stack, and built an agent hands-on. Now design a real agentic pilot for your own team's payments workflow β€” and score it on autonomy, tools, guardrails, and impact.

⏱ 60 min πŸ‘₯ Teams of 4–5 πŸ’³ Your Real Workflow πŸ€– Agent Design πŸ“¦ Take-Home Build Kit

Capstone Overview

Across Day 2 you've gone from "why a chatbot isn't enough" to building a working Dispute Triage agent and flow in Amazon Quick. This capstone is where you turn that into a pilot proposal for your own team's workflow β€” designed as an agent, not just a prompt.

You'll work in cross-functional teams to fill an Agentic Pilot Canvas β€” a one-page framework that captures the workflow, the agent design (autonomy level + the perceive-reason-act loop + workflow pattern), the tools and actions it uses, the guardrails and human oversight, and the business impact. Then you submit it for scoring, then take home a Build Kit to stand it up in Amazon Quick.

🧭 In plain terms β€” what's going on here:

Now it's your turn. Your team takes a real headache from your own work β€” the dispute backlog you triage by hand, the reports you consolidate every Monday, the KYC checks that eat your week β€” and sketches on one page how an AI assistant could help: what it should do, what it must never do, and how you'd trial it safely. A scoring rubric then gives you feedback and a score. Why it matters: you walk out with a concrete, right-sized idea you could actually pitch to your manager next week β€” not just theory.
πŸŽ“ Lab Outcomes β€” what you'll be able to do afterwards

β€’ Tell an agentic workflow apart from a one-off prompt
β€’ Design an agent β€” set its autonomy level, perceive-reason-act loop, and workflow pattern
β€’ Define guardrails and a clear human-in-the-loop boundary (assist, never decide, on fraud/dispute/credit)
β€’ Estimate business impact and judge what's realistically buildable in Amazon Quick
β€’ Walk away with a scored, pitch-ready pilot and a downloadable Build Kit for your own team
πŸ”— Bridge from Lab 1

Remember the Pilot Advisor answer you generated at the end of Lab 1? That grounded sketch of your own team's problem is the perfect seed for this canvas. Pull it up β€” you'll reuse it here.
StepWhat you doDuration
1Form teams & pick an agentic workflow5 min
2Fill the Agentic Pilot Canvas (your own thinking β€” no AI)15 min
3✨ Reveal AI refinement β†’ sharpen the design15 min
4Submit for scoring + leaderboard10 min
5πŸ“¦ Realize it in Quick β€” stand up your agent from the Build Kit15 min*

*Step 5 is "build as far as you can in the room, then take the kit home to wire it to your real data." The Build Kit is your tangible takeaway.

πŸ“¦ What you take home

By the end you'll have a downloadable Build Kit for your own team's agent β€” paste-ready blocks for every Quick surface your pilot needs: a Space setup, a Chat Agent brief, a Flow brief, a Quick Research objective, and a Quick App prompt β€” in the same format you used to build the Dispute Triage agent in Lab 1. Stand up the shell in Quick during the session, then point it at your real documents back at the office.
πŸ† Two-round scoring

Round 1: Submit your canvas from your own team discussion (no AI help). See how your human agent-design thinking scores.
Round 2: In Step 3, reveal the refinement prompt and use AI to sharpen your agent design, then resubmit for an improved score.

The leaderboard keeps your best score. Teams that reason well about autonomy and guardrails in Round 1 start ahead.

Step 1: Pick Your Agentic Workflow

Click a workflow that resonates with your team β€” or pick "Custom". Each one maps to an agent pattern you saw in Modules 2–6. Your selection pre-fills the canvas context in Step 2.

πŸ’‘ What makes a good agentic pilot (vs just a GenAI prompt)?

Pick a workflow that is (1) multi-step β€” not a single question, (2) recurring β€” happens weekly or daily, (3) needs the agent to take an action or use a tool (look something up, post a result, cross-reference data), and (4) has a clear human-in-the-loop safety boundary. In payments the best pilots remove the invocation, not the decision β€” the human still owns every fraud, dispute, and credit call.
πŸ™‹ Don't see your workflow? Pick "Custom Agentic Workflow" at the bottom and describe your own. The strongest pilots come from a process you personally run every week.

Step 2: Fill the Agentic Pilot Canvas (Your Own Thinking)

Fill this out as a team, using your own knowledge β€” no AI yet. This is where you reason through the agent design yourself. Short answers in each field are fine.

⚠️ Round 1: Human thinking only

Don't paste this into Quick or any AI tool yet. The goal is to capture your team's real understanding of the workflow and how you'd design an agent for it. AI-written answers score well but don't prove you understand autonomy and guardrails. AI-assisted refinement (Step 3) is Round 2 β€” do it after you submit.
Agentic Pilot Canvas β€” Fill as a team
# Agentic Pilot Canvas ## 1. Workflow & Trigger - Workflow: [What multi-step process are we automating?] - Who does it today: [Which roles/team?] - Frequency: [Daily, weekly, per-event?] - Trigger: [What kicks the agent off β€” a file arrives, a schedule, a question?] - Time spent today: [Hours per occurrence] ## 2. Agent Design - Autonomy level: [Assisted / Workflow-automation / Partial-autonomy / Full-autonomy β€” and why] - Perceive: [What inputs does the agent read?] - Reason: [What does it decide / classify / cross-reference?] - Act: [What does it produce or do?] - Pattern: [Prompt chaining / Routing / Parallelisation / Orchestration] ## 3. Tools & Actions - Reads from: [Spaces, knowledge bases, documents, dashboards] - Actions it takes: [MCP/connector calls, create/update/notify] - Data sources: [Named systems where the data lives] ## 4. Guardrails & Human Oversight - Agent must NEVER: [Hard limits β€” what it must not decide/do] - Human reviews when: [Specific triggers β€” severity, value, ambiguity] - Audit trail: [What gets logged for traceability?] ## 5. Business Impact - Time saved: [Hours Γ— people Γ— frequency] - Risk/quality improvement: [What gets safer or more consistent?] - Success metric: [One measurable: "reduce X from Y to Z in 30 days"] ## 6. Build Plan in Quick (30 Days) - Quick layers: [Space / Chat Agent / Flow / MCP β€” which ones?] - Pilot scope: [One team, one segment, one document type] - Go/No-Go: [What result = expand vs stop?]
βœ… Tips for a strong agentic canvas
  • 🎚️ Justify the autonomy level β€” match it to the risk. Fraud/dispute/credit β†’ lower autonomy + human gate.
  • πŸ”Œ Name the actions β€” "calls list_disputes then posts to Teams" beats "the agent does stuff".
  • πŸ›‘οΈ Make guardrails specific β€” "never auto-decide a dispute; a Resolutions Officer reviews all escalations" not "be safe".
  • 🧩 Name the pattern β€” chaining, routing, orchestration (from Module 3).
  • πŸ“ Quantify impact β€” hours Γ— people Γ— frequency, plus one clear success metric.

Step 3: Refine with AI β†’ Sharpen the Design

After you submit your Round 1 canvas and see your score, reveal the AI-assisted refinement prompt below. It's pre-filled for the workflow you picked in Step 1 β€” paste it into Amazon Quick Chat and the AI reviews and sharpens your agent design, asking one clarifying question at a time, then hands back a tighter canvas ready to resubmit for a higher score. You'll turn that finished canvas into a paste-ready Amazon Quick Build Kit in Step 5.

πŸ’‘ Do Round 1 first

Fill the canvas from your own team discussion (Steps 1–2) and submit it in Step 4 to get your Round 1 score. Then reveal the refinement prompt below to sharpen your design with AI for Round 2.

The prompt is tailored to the workflow you selected in Step 1 β€” reselect any workflow to update it.

Step 4: Submit & Score Your Agent Design

Submit your Agentic Pilot Canvas for scoring. It's evaluated on 5 agent-specific dimensions, 1–5 each (25 max). The full rubric is shown below the submit box, so nothing about the score is a black box.

πŸ“€ Submit Your Agentic Pilot Canvas

Submit as a team or individually. Resubmitting with the same name keeps your best entry.

πŸ” Full scoring transparency β€” exactly how the score is computed

Your canvas is scored by a live LLM-as-Judge (Claude on Amazon Bedrock) against the transparent 5-dimension rubric below, and your entry joins the shared workshop leaderboard that your facilitator can review. It rewards specificity: a justified autonomy level, named tools/actions, specific guardrails, a realistic Quick build, and quantified impact. If the scoring service can't be reached, it falls back to an on-device rubric so you still get a score β€” that offline entry stays on your device, so resubmit from the workshop website to add it to the leaderboard.
The 5 dimensions (each scored 1–5)
DimensionMaxWhat a 5 looks like
Autonomy Design5The autonomy level (assisted / workflow / partial / full) fits the task's risk and is justified; the perceive-reason-act loop is clear; the act-vs-escalate boundary is explicit.
Tools & Actions5What the agent READS (Spaces, KBs, docs) and DOES (MCP/connector actions) is named; the right workflow pattern (chaining / routing / parallelisation / orchestration) is chosen; it can finish the task end-to-end.
Guardrails & Human Oversight5"Must NOT" rules are specific to regulated payments work; human-in-the-loop checkpoints have triggers; there's an audit trail and a clear "never auto-decide" boundary β€” an auditor or compliance reviewer would be satisfied.
Feasibility5Honestly buildable on Amazon Quick (Spaces / Chat Agents / Flows / MCP), 30-day scope is realistic, and the data actually exists β€” a team could start next week.
Business Impact5Value is quantified (hours Γ— people Γ— frequency, or risk/error reduction) with one clear, measurable success metric and a Go/No-Go criterion a sponsor could validate.
How each dimension is scored (1–5)
ScoreMeaning
1Missing or completely generic β€” could apply to any company or any task
2Present but vague ("the agent helps", "saves time", "it's autonomous")
3Reasonable, but lacks specificity in autonomy, tools, or oversight
4Strong β€” specific agent design and named actions, with minor gaps
5Exceptional β€” explicit autonomy boundaries, named tools/actions, payments-grounded guardrails, quantified impact
Total β†’ verdict
TotalVerdictWhat it means
21–25πŸ₯‡ Pilot-ReadyA sponsor could fund this agent pilot next week
16–20πŸ₯ˆ Strong ConceptSolid agent design β€” address the feedback and it's ready
11–15πŸ₯‰ Good StartRight direction; sharpen autonomy, tools, or guardrails
Below 11πŸ”„ Needs RefinementAdd specifics β€” the written feedback tells you where
πŸ“ˆ How to score well: the rubric rewards specificity over polish. "Never auto-decide a dispute; a Resolutions Officer reviews all escalations; agent calls get_dispute then flags the 3-in-30 pattern" beats "the agent is safe and helpful" every time. Name your autonomy level, name your tools/actions, quantify the impact, and ground the guardrails in your real workflow.

Note: a rubric score is a fast, consistent coach β€” not an infallible authority. Two near-identical canvases can land a point apart, and the written feedback matters more than the exact number. Use it to sharpen your thinking, then trust your own judgement in the pitch.

πŸ† Leaderboard

Submissions ranked by score across the whole workshop. Resubmitting under the same team name keeps your best entry.

Loading leaderboard...

Step 5: πŸ“¦ Realize It in Quick β€” Your Take-Home Build Kit

Your canvas is a design. This step turns it into paste-ready prompts β€” one per Quick surface β€” generated from your canvas answers. Stand up the agent shell in the room, take the kit home to point it at your real data, and use the leadership-pitch app to present the idea to your sponsor.

🎁 This is your takeaway. Paste-ready blocks for every Quick build surface β€” a Space setup, a Chat Agent brief, a Flow brief, a Quick Research objective, and a Quick App prompt β€” everything you need to recreate your pilot in Amazon Quick after the workshop.
How the kit works β€” driven by your canvas. Paste your completed canvas and each block is tailored to your answers (leave it blank and it uses the selected workflow's starter values). You get one paste-ready prompt per Quick build surface, each downloadable as its own .md: A Space Β· B Chat Agent Β· C Flow Β· D Quick Research Β· E Quick App (ops tool) Β· F Quick App (leadership pitch β€” a one-page app to present the idea to your sponsor) Β· G a step-by-step deploy guide. A and B are the core; the rest are optional depending on your pilot. Follow the checklist below.

πŸ› οΈ Generate your Build Kit

Paste your completed canvas (from Step 3/4) so the kit is tailored to your answers β€” or leave it blank to use the selected workflow's starter values. You'll get one paste-ready prompt per Quick surface, each downloadable as its own .md.

πŸ› οΈ Generate builds an instant, offline starter kit from your canvas (each block downloadable as its own .md). For a sharper, reasoned kit, use the β€œLet Amazon Quick build your kit” meta-prompt just below β€” Amazon Quick does the thinking, not our servers.

πŸ€– Or: let Amazon Quick build your kit

No server, no wait on us β€” Amazon Quick itself generates your kit. Copy the meta-prompt below, paste it into Amazon Quick Chat (attach your Space if you have one), then paste your completed canvas where marked. Quick returns all seven paste-ready build blocks. Same structured approach as the Step 3 design-refinement prompt, but focused purely on producing the build kit.

Meta-prompt β€” paste into Amazon Quick Chat, then add your canvas
You are an Amazon Quick build-kit generator for a payments & merchant-services company (AnyCompany Payments). I will give you my Agentic Pilot Canvas. Turn it into a paste-ready Amazon Quick BUILD KIT β€” one block per Quick build surface β€” that a non-developer can paste straight into Amazon Quick. Produce EXACTLY these seven blocks, each self-contained and paste-ready (roughly 120–220 words each): A. Space Setup β€” the knowledge Space: a name, a system-prompt description, and what (synthetic) documents to upload. B. Chat Agent β€” persona, goal, knowledge source (the Space), named actions/tools, guardrails, and 4–5 suggested prompts. C. Flow β€” numbered steps: trigger/input β†’ pull Space data β†’ run the chat agent β†’ a condition / human-review gate β†’ action. D. Quick Research β€” a cited, structured report objective with deliverables (can be scheduled). E. Quick App (Ops Tool) β€” an internal screen: input, a results panel with citations, a "needs human review" list, an impact strip. F. Quick App (Leadership Pitch) β€” a one-page, boardroom-ready app to present the idea to leadership: exec summary, an autonomy badge, a Trigger β†’ Perceive β†’ Reason β†’ Act β†’ Human-checkpoint flow strip, guardrails & oversight, an impact big-number panel, a 30-day plan, and a "why fund this now" panel. G. Deploy in Quick β€” short, numbered steps to build Aβ†’F in order (build the shell with synthetic data in the room; swap in real data later). Rules: the company is always "AnyCompany Payments"; refer to people by ROLE only (no invented names). Assist, never decide β€” a qualified human owns every fraud / dispute / credit outcome, so bake a human-in-the-loop gate into B, C, and F. Synthetic data only; mask card numbers (e.g. β€’β€’β€’β€’4921). Never invent a metric β€” write [NEED: data] where a number is missing. Label each block clearly A–G so I can copy them one at a time. MY AGENTIC PILOT CANVAS: [PASTE YOUR COMPLETED CANVAS HERE]
βœ… Why this is the win-win: the reasoning happens inside Amazon Quick (the tool you're here to learn) β€” nothing is sent to any workshop server, and there's no endpoint or infrastructure to secure.

Stand It Up in Quick (same moves as Lab 1)

If you have time in the room, build the agent shell now. Otherwise this is your at-the-office checklist.

β‘  Create the Space β€” Quick β†’ Spaces β†’ Create space. Use the Space Setup from your kit as the name + description. Upload a few representative documents (sample now, real set later).
β‘‘ Build the Chat Agent β€” Quick β†’ Chat agents β†’ Create chat agent β†’ paste your kit's Chat Agent Brief β†’ Generate β†’ confirm the Space is attached β†’ Update preview β†’ test β†’ Launch chat agent.
β‘’ (Optional) Add the Flow β€” Quick β†’ Flows β†’ Create flow β†’ Natural language β†’ paste your kit's Flow Brief β†’ Generate β†’ run it once β†’ schedule or share with your team as Viewer.
β‘£ (Optional) Add Quick Research β€” Quick β†’ Research β†’ paste your kit's Research Objective β†’ run it β†’ if it should recur, save it as a scheduled research agent. Best for open-ended, cited investigation workflows (vendor risk, market/scheme landscape).
β‘€ (Optional) Quick App β€” operations tool β€” Quick β†’ Apps β†’ describe your app β†’ paste block E β†’ Generate β†’ iterate in the live preview β†’ Publish. A clickable front-end screen for running the workflow.
β‘₯ Quick App β€” leadership pitch β€” Quick β†’ Apps β†’ paste block F β†’ Generate β†’ refine β†’ Publish and share the link with your sponsor. A one-page, boardroom-ready app to present the agent idea to leadership.
⚠️ Data reality check. In the room you likely won't have your real team documents loaded β€” that's fine. Build the agent shell now to prove the design works, then back at the office swap in your actual files (and add an MCP integration if you need live system data). The kit is the recipe; your data is the ingredients. And remember: all sample data here is synthetic (masked PANs like β€’β€’β€’β€’4921, synthetic IDs) β€” never load real cardholder data into a pilot.

πŸŽ“ What You Just Did β€” and Where Next

In one capstone you took everything from Day 2 β€” the LLM-to-agent shift, the perceive-reason-act loop, the four workflow patterns, the Quick automation stack, and the hands-on build β€” and turned it into a fundable pilot for your own team's payments workflow.

πŸ“Œ Take your canvas home. It's not a workshop artifact β€” it's a deployment blueprint. The build plan maps directly onto Quick: a Space for knowledge, a Chat Agent for the reasoning, a Flow to automate it, an MCP integration when you need live system data. You can prototype it in an afternoon.

↩ Back to Workshop Home