← One-pagersDescargar PDF
PayJoy
PayJoy, Inc. · AI Conversational Agent — Pilot RFIConfidential — shared externally for vendor evaluation

AI Conversational Agent — Pilot RFI

How to respond

  1. Complete the matrix in Section 6, marking each row Native / Supported, Partial or via workaround, Not supported or Not applicable in the Response column, and a short note in Detail.
  2. Provide the additional materials requested in Section 7.
  3. Please let us know if you have any questions.

1. Project Context

PayJoy is evaluating AI conversational agent platforms to handle inbound customer conversations on WhatsApp (and potentially other channels) at scale, with a controlled hand-off path to human agents for cases the AI cannot or should not resolve on its own.

The pilot is inbound-first: customers reply to messages PayJoy already sends them. The AI agent picks up those replies, resolves the common ones end-to-end, and escalates the rest to specialized human teams (collections negotiation, customer support, fraud, legal) with full conversation context.


2. Current Messaging Stack

LayerToolRole
Channel gatewayInfobipWhatsApp Business API, SMS, Voice. Connection to the carrier / Meta.
OrchestratorCustomer.ioTriggers outbound campaigns (collections reminders, onboarding, product comms). Decides what message goes out, when, and to whom. Delivers via Infobip.
Data warehouseDatabricks(Migrating from Snowflake.) Source of truth for customer state: loan status, DPD, device status, payment history, segment, country.

The WhatsApp number we use today is provisioned through Infobip. Any solution we adopt must reuse this number — happy to explore alternatives if feasible.

Reference Architecture

The pilot introduces an AI conversational agent to handle inbound WhatsApp messages from customers that today go unanswered. The design reuses the existing stack and splits responsibilities by message direction:

  • Outbound (current state, unchanged): Databricks feeds segments and triggers; Customer.io orchestrates what is sent, when, and to whom; Infobip (WhatsApp Business API, existing number) delivers the message to the customer.
  • Inbound (new in the pilot): when the customer replies, Infobip fires a webhook to the AI conversational agent. The agent detects intent, fetches customer context from Databricks (balance, due date, DPD), and responds — including a payment link — back through Infobip.
  • Coexistence: Customer.io still owns outbound and the AI owns inbound; they sync (pause journey / notify outcome) to avoid double-messaging.
  • Human hand-off: on low confidence, out of scope, negotiation, complaints, fraud, or legal, the agent escalates to the human team with a summary and conversation context; the conversation can return to the AI.

Key principles:

  • Reuse the existing Infobip WhatsApp number (no re-provisioning).
  • Any response with numeric data (amounts, dates) must be backed by a tool-call against Databricks — not generated freely by the LLM.
  • Databricks is the source of truth for customer context.
  • Pilot scope: inbound only, Mexico, default segment Collections DPD 0–30.

3. Problem Statement

Today our customer messaging is essentially one-way (outbound). Customer.io triggers millions of messages per month through Infobip, but when a customer replies, no one is on the other side.

Inbound replies on WhatsApp and SMS are not systematically monitored across countries. The current outcomes are: the customer calls our voice support line (expensive, long queue); the customer abandons the conversation and the underlying intent (pay, get info, raise a complaint) goes unresolved; operationally critical signals (e.g. a customer saying “I already paid”, “wrong number”, “the device is broken”) never reach the right team.

We have no agent pool large enough to staff inbound WhatsApp on the volumes we generate, and we do not want to build one. We want an AI agent to handle the long tail of low-complexity intents and route the rest to the humans who can solve them.


4. MVP Scope — What “Pilot Success” Looks Like

The MVP is intentionally narrow. We want to validate in one country, one customer segment, before scaling.

In scope for the pilot

  1. Channel: WhatsApp inbound on the existing Infobip number.
  2. Country: Mexico.
  3. Customer segment: default — collections DPD 0–30.
  4. Intents the AI must resolve end-to-end:
    • “How much do I owe?” / current balance
    • “When is my next payment due?”
    • “How / where can I pay?” (generate payment link or instructions)
    • “I already paid — why am I getting reminders?”
    • “My device is locked — help me unlock it after I pay” (top-level feasibility)
    • “Update my contact info” (acknowledge + route to system of record)
    • Basic FAQs (interest, fees, contract terms)
  5. Hand-off to human when:
    • Intent is out of scope (negotiation, complaint, fraud, legal threat).
    • Customer explicitly asks for a human.
    • AI confidence is below threshold.
    • Hand-off must include a conversation summary and customer context for the agent picking up.
  6. Basic analytics: volume, resolution rate, hand-off rate, CSAT, response time.

Out of scope for the pilot (but in scope for v2)

  • Outbound conversations initiated by the AI (we want Customer.io to keep owning outbound for now).
  • Voice channel (WhatsApp voice notes or phone IVR).
  • Full Databricks personalization (we can start with a smaller context payload via API).
  • Multi-country rollout.

Stretch goals (nice-to-have, won’t block pilot)

  • Native Databricks / Snowflake connector for live customer context.
  • Bidirectional sync with Customer.io (e.g. pause an outbound journey when the AI takes over the conversation).
  • Multi-topic on the same number (collections + customer support + general inquiries).
  • Maintenance / device-status questions answered from internal product data.

5. Sizing

The numbers below frame expected pilot and steady-state volumes. Inbound figures are estimated using industry-typical reply rates for WhatsApp Business in financial services (8–12%); we will refine with actual Infobip inbound data before contract.

Outbound message volume (current state, via Customer.io → Infobip)

MetricValueNotes
Outbound WhatsApp messages / day (Mexico)~14,725Baseline pulled from Customer.io webhook deliveries
Outbound WhatsApp messages / month (Mexico)~441,75014,725 × 30
Estimated inbound reply rate8–12%Industry typical for fintech WhatsApp Business; to be validated against Infobip inbound logs
Estimated inbound replies / day~1,200–1,80014,725 × 8–12%
Estimated inbound replies / month~36,000–53,000

Pilot sizing (proposed)

MetricValue
Pilot duration8 weeks (live)
Pilot countryMexico
Pilot customer segmentdefault: collections DPD 0–30
Outbound messages during pilot window~825,000 (14,725 × 56 days)
Expected conversations / day during pilot1,200–1,800
Expected conversations during pilot window~70,000–100,000
Target AI resolution rate (no human hand-off)60–70% (Phase 1), 75–85% (steady state)
Target hand-off latency (AI → human)< 15 minutes business hours

Steady-state sizing (post-pilot, if we expand globally)

MetricValue
Countries in scopeMX, PH, CO, BR (others TBD)
Active customer base1M+ (tiers below)

Steady-state volume tiers (1M+ active users)

Tiers assume ~1 outbound message per active user per month (to be refined with actual Customer.io delivery data) and the same 8–12% inbound reply rate used above.

Active usersOutbound messages / monthInbound conversations / monthInbound conversations / day
1,000,000~1.0M~80,000–120,000~2,700–4,000
2,000,000~2.0M~160,000–240,000~5,300–8,000
5,000,000~5.0M~400,000–600,000~13,300–20,000
10,000,000~10.0M~800,000–1,200,000~26,700–40,000

6. Technical Evaluation Matrix

Vendors should respond per row with one of: Native / Supported · Partial or via workaround · Not supported · Not applicable. Add a short comment in the “Detail” column.

6.1 Channel Integration

#RequirementResponseDetail
1.1Native integration with Infobip (WhatsApp Business API)
1.2Can operate on PayJoy's existing WhatsApp number without re-provisioning
1.3Bidirectional webhook with Infobip (inbound messages + delivery receipts)
1.4Multi-channel support on the same number (WhatsApp + SMS + Voice as roadmap)
1.5Conversation handling within WhatsApp's 24-hour session window

6.2 Coexistence with Customer.io (Outbound Orchestrator)

#RequirementResponseDetail
2.1Can coexist with Customer.io-driven outbound campaigns without disrupting them
2.2Can pause / suppress a Customer.io journey when the AI takes over a conversation
2.3API or webhook to notify Customer.io of conversation outcome (resolved / escalated / no response)
2.4Avoid double-messaging the customer when AI and Customer.io would both fire

6.3 Customer Context (Data Layer)

#RequirementResponseDetail
3.1Native connector to Databricks (preferred) or Snowflake
3.2Alternative: REST API lookup with sub-2s latency for live context
3.3PII handling: masking, configurable retention, data residency per country
3.4Multi-country / multi-product context isolation (MX, PH, CO, BR)
3.5Personalization tokens in agent responses (e.g. customer name, balance, due date)

6.4 AI Agent Capabilities

#RequirementResponseDetail
4.1Modern LLM backbone (Claude, GPT-4o-class, Gemini, or comparable); upgrade path
4.2Multi-language: Spanish (MX), English (PH), Portuguese (BR), as a minimum
4.3Intent detection beyond decision trees (handles paraphrasing, slang, typos)
4.4Conversation memory within a session and across sessions (per customer)
4.5Tool / function calling (e.g. fetch balance, generate payment link, open a ticket)
4.6Configurable guardrails (forbidden topics, tone, max length, escalation triggers)

6.5 Knowledge Base

#RequirementResponseDetail
5.1KB ingestion from common formats (Markdown, PDF, Google Sheets, URLs)
5.2KB versioning + ability to A/B test responses
5.3Source citations (the agent reports which KB article informed its answer)
5.4KB updates without redeploy and without engineering involvement

6.6 Human Hand-off (Loop)

#RequirementResponseDetail
6.1Automatic trigger on low confidence or out-of-scope intent
6.2Explicit trigger on customer request (“I want to talk to a person”)
6.3Hand-off includes a conversation summary + customer context for the human agent
6.4Routing by skill / team (collections, support, fraud, legal)
6.5Supervisor view of the queue with SLA and prioritization
6.6Ability to return the conversation back to the AI after the human resolves
6.7Hand-off can target an existing agent desk (Zendesk, Freshdesk, Salesforce, etc.) — please list supported

6.7 Operations & Maintenance

#RequirementResponseDetail
7.1No-code / low-code UI to edit prompts, flows, KB
7.2Role-based permissions so ops / product can edit without engineering
7.3Staging / sandbox environment to test changes before production
7.4Change log (who changed what, when)

6.8 Analytics & Monitoring

#RequirementResponseDetail
8.1Dashboard for volume, resolution rate, hand-off rate, CSAT
8.2Drill-down to individual conversations for QA
8.3Alerts on degradation (e.g. hand-off spike, CSAT drop)
8.4Raw data export to Snowflake / Databricks for our own analysis

6.9 Quality & QA

#RequirementResponseDetail
9.1Sampled conversations for human review
9.2Detection of hallucinated or off-policy responses
9.3Ability to flag conversations for retraining / prompt refinement
9.4Feedback loop from human agent corrections back into the AI

6.10 Security & Compliance

#RequirementResponseDetail
10.1SOC 2 Type II and/or ISO 27001
10.2Compliance with local regulations (LFPDPPP MX, DPA PH, LGPD BR, POPIA ZA, GDPR)
10.3Encryption in transit and at rest
10.4Signable DPA; transparent list of subprocessors
10.5Configurable conversation retention (target ≤ 90 days)
10.6Data residency options per country

6.11 Access Control

#RequirementResponseDetail
11.1SSO (Google Workspace / Okta)
11.2Granular RBAC (admin, ops, analyst, viewer)
11.3Audit log of administrative actions
11.4PII visibility controls (who can see customer data in conversations)

6.12 Pricing & Scalability

#RequirementResponseDetail
12.1Clear pricing model (per conversation / per message / per MAU / flat)
12.2Pricing scoped to PayJoy pilot volumes (see Section 5)
12.3Uptime SLA ≥ 99.9%
12.4Support SLA (response and resolution times by severity)
12.5Reference customers in fintech / LATAM, ideally with WhatsApp + Infobip

7. Information We Need From the Vendor

Beyond the matrix in Section 6, please include in your response:

  1. Pricing for the pilot volume in Section 5, plus a forecast for steady-state.
  2. Reference architecture diagram for the Infobip + Customer.io + Databricks scenario.
  3. Time-to-live estimate for the MVP scope in Section 4.
  4. Two reference customers we can talk to, ideally fintech in LATAM with Infobip, or with other Meta Business Partners (e.g. Twilio, Sinch).
  5. Sample conversation transcripts (anonymized) from a similar deployment.
  6. Access to a live demo or production-like environment where PayJoy can interact directly with an AI solution deployed with existing clients.
  7. Roadmap items relevant to our stretch goals (Section 4).