Skip to content
Auf Deutsch ansehen

AI · AI at work

Adopting AI at work: From a pilot to a service you can run

Measure an AI pilot against the time it takes to produce a usable result. Compare platforms, calculate the cost per case and put AI literacy into practice.

By Boaz Lichtenstein Prefer us on Google

Article image: Adopting AI at work: From a pilot to a service you can run
In this article
  1. Design a pilot that can fail cheaply
  2. Four platforms and four questions for procurement
  3. Calculate the cost of a usable reply
  4. Give people practice and give the system boundaries
  5. Decide what to do with the results

Reviewed on 4 November 2026. A support team wants to spend less time answering routine questions. Measure the time from opening a ticket to having a correct reply ready to send. Timing the model’s first draft misses the work that a plausible but wrong answer creates.

Design a pilot that can fail cheaply

Pick a task whose output a named person can judge. Establish how long it takes today, which errors occur and what data it actually needs. A returns enquiry may require the approved policy and the status of a particular order. It rarely needs the customer’s entire history.

Build a small evaluation set with ordinary and difficult cases. Include an expired returns window, a goodwill exception and a message with no order number. Ask staff which answers they would send. Keep some cases out of development and check whether the time saving and quality hold up on those, too. Planning an SME pilot · Adoption within the team

Four platforms and four questions for procurement

Platform When a pilot makes sense What the proposal should explain
Microsoft Copilot Studio Approved data and workflows already live in Microsoft 365 or Power Platform. Which capabilities consume Copilot Credits, what do existing licences cover, and how are peaks billed?
Salesforce Agentforce The agent will work on cases or CRM records in Salesforce. Are you paying per action, conversation or user? Which additional services does that same case consume?
Google Gemini Enterprise Staff need permission-aware search across company sources or access to custom agents. Which edition and licences cover the team? Are additional resources metered separately?
ServiceNow Otto The task runs through existing IT or employee-service workflows. Which Otto capabilities does your contract include, who can enable them, and how is usage measured?

Ask each supplier to price the same job: read an enquiry, retrieve two sources and draft a reply. Find out who grants source access, how staff permissions are revoked when roles change and how to export the process. The price of one credit tells you little until you know how many that job consumes. Microsoft · Salesforce · Google · ServiceNow

Calculate the cost of a usable reply

Suppose the team handles 600 cases per month at six minutes each. At a fully loaded €30 per hour that costs €1,800. In a pilot, 480 cases take three minutes each, including review. The other 120 take eight minutes because someone discards the draft. That adds up to 40 hours or €1,200. Assume another €300 for licences and usage. That leaves €300 per month to cover integration, ongoing operation and any additional exceptions before the saving disappears.

Count the discarded outputs. Caching can help when context repeats, while batch processing can suit work with a flexible deadline. Actual rates depend on the model, plan and billing route. A cheaper model that creates more review work can increase the total cost. How AI costs add up · Context engineering

Give people practice and give the system boundaries

Article 4 of the EU AI Act requires measures to support AI literacy, taking account of experience, the setting and the people affected. Give the support team an invented refund policy to spot. A recruitment team also needs to understand when a tool’s scores influence candidate selection. Written rules about inputs are useful to both teams, but each deployment needs its own assessment. Article 4 as amended · AI Act dates and duties

Start with read access limited to the sources the pilot needs. An incoming email might claim that a customer has approved payment to a new bank account. Even if the model follows that instruction, the tool should have no way to change the account details. If you later add payments, show the amount, recipient and purpose at the approval step. That gives you a concrete permissions test to run before launch. Research on separating data and control · Prompt injection and agent security

Decide what to do with the results

Agree before the first test who can own the service and what result would justify expansion. The support team might approve drafts for standard cases while keeping goodwill decisions manual. Once you know correction time, quality, cost and access requirements for each group, you can decide whether to extend the pilot to another workflow.

FAQ

Frequently asked questions

Which process makes a good first pilot?

Pick a frequent, verifiable task where mistakes can be corrected before they reach a customer. For support replies, staff can grade old cases blind, measure editing time and approve every outgoing response.

How do I know if the pilot pays off?

Divide licensing, usage, integration and review costs by the number of usable outcomes. Compare with the current workflow, including rework. Counting generated drafts alone misses the cost of correcting them.

How do the platforms charge?

Microsoft meters certain Copilot Studio features in credits. Salesforce offers options including Flex Credits, conversations and user licences. At Google, edition, licences and extra capacity can all matter. Identify the billable activity in your own contract.

Do we need the same AI training course for everyone?

Article 4 requires providers and deployers to take measures to support AI literacy. Appropriate measures depend on the work and the people affected. The law does not prescribe a uniform course or a guaranteed level of personal proficiency.

When should an agent get write access?

First define the records and actions it may touch, enforce that boundary outside the model and make errors detectable and reversible. Payments and changes to bank details need their own controls.

On this learning path

Running agentsStation 7 of 7

Last station

That is the whole path. The practice pack holds one exercise per station and the answers to every self-test.