Copilot Studio Agent Development

AI agents grounded in your Dynamics 365, Dataverse and SharePoint knowledge, connected to real business actions and governed properly, by senior Power Platform consultants.

Solzet designs and builds Microsoft Copilot Studio agents grounded in your Dynamics 365, Dataverse, SharePoint and website knowledge, connected to real actions in your CRM or ERP through Power Automate, and deployed to Teams, websites and Microsoft 365 Copilot. For knowledge-base agents that legal must approve, vague answers are a design choice, not a given: we use extractive-only answers, grounded retrieval that cites its source and declines when nothing matches, or AI drafts that a person approves. We clean multilingual knowledge spread across legacy systems, write acceptance tests legal can sign, and scope a board demo that shows refusals and handoffs as well as answers. We recommend a custom build when Copilot Studio is not the right tool.

What can a Copilot Studio agent do for a mid-market business?

The strongest Copilot Studio use cases pair a clear, repetitive question with knowledge or an action the organization already has. We start with one of these, prove it works with real users, then extend.

  • Employee help desk: answer HR, IT and policy questions from SharePoint and internal documentation inside Microsoft Teams.
  • Customer service deflection: answer common questions on your website from published knowledge articles and hand over to a live agent in Dynamics 365 Customer Service when needed.
  • Sales assistant: look up account, opportunity and order information from Dataverse for sellers working in Teams.
  • Field technician support: find procedures, asset history and work order details while on site.
  • Request intake: collect structured information through conversation and create records or start approval flows.

How do agents use your Dynamics 365 and Dataverse data?

Copilot Studio agents answer from knowledge sources you connect, such as SharePoint sites, files, public websites and Dataverse tables, and they act through tools built on Power Automate flows and connectors. We design which data each agent may read, which actions it may perform, and whose permissions it runs with, so an agent never shows a user information they could not see in Dynamics 365 themselves. Where an action changes data, such as updating a case or creating a lead, we build it as a governed flow with validation and logging rather than giving the agent open access. Where the data an agent needs sits in Business Central or Finance and Operations, the same rules apply to the flows that reach it.

Can a Copilot Studio agent resolve customer service cases end to end, or only deflect them?

It can resolve a narrow set of cases end to end today, and it should hand the rest to a person with full context. Against Dynamics 365 Customer Service an agent can retrieve case and account context for a verified customer, take bounded actions through tools you define, such as checking an order status, rebooking an appointment or updating a case, and hand off to a human with the transcript and what it already tried. The guardrails make that safe: read-only first, explicit approval before any financial or record-changing action, an audit trail of every decision, and a scope of your top few intents rather than everything. Most projects also have to fix the knowledge base before launch.

That answer is written for the service leader who has been promised an intelligent assistant, has a knowledge base nobody fully trusts, no AI delivery experience in house and a quarter to show something. A quarter is enough for a credible first release if the scope is narrow: pick the handful of intents that make up a large share of your contact volume and that follow a known resolution path, prove them with real customers, and leave everything else routed to people exactly as it is now. An agent that tries to cover every question in its first release deflects conversations it cannot resolve, which is how customer satisfaction falls while the containment figure on the dashboard rises.

The difference between resolving and deflecting is whether the agent can finish the job. Deflection answers a question with an article link and hopes. Resolution confirms who the customer is, reads their actual case or order, performs the step a first-line agent would perform, and confirms the outcome. The table shows what each part needs in a Dynamics 365 Customer Service environment.

CapabilityWhat the agent doesWhat has to exist first
Answer from knowledgeAnswers how-to and policy questions from published knowledge articles, citing the article.Current articles with owners, one article per question, and internal-only content kept out of what customers can see.
Resolve identityMatches the person to a contact through portal sign-in or a verification step, never from a name typed into chat.An authentication route for the channel and a reliable contact record, without duplicates that split one customer into two.
Retrieve contextReads the customer's open cases, entitlements, orders or bookings and states them back before acting.Read access through a defined tool, limited to the records belonging to the verified customer.
Take bounded actionsPerforms a specific step such as rebooking, adding information to a case, or creating a case with the right category.One governed Power Automate flow or connector action per step, with validation, logging and fixed inputs.
Hand offTransfers to a live agent with the full handoff packet when it cannot finish, or whenever the customer asks.Routing to the right queue in Customer Service, or a documented handoff route into whichever desk the case belongs to.
  • Read-only first. The first release retrieves and explains; actions are added once reviewers agree the retrieval and answers are accurate on real conversations.
  • Approval gates before anything financial or record-changing. Refunds, credits, cancellations and changes to contract or entitlement data go to a person for confirmation, or are not offered by the agent at all.
  • An audit trail of every decision. Transcripts retained deliberately, each action run through a flow that logs its inputs and outcome, and Dataverse auditing on the tables the agent can change.
  • A narrow scope of top intents. Each intent has a named owner, a known resolution path and a test set of real customer phrasings, and anything outside the list is routed to a person rather than guessed at.

What usually has to be fixed in the knowledge base first

Be honest about this before the quarter starts, because it is where the time goes. Duplicate articles that give different answers to the same question, articles that were written as internal notes rather than customer answers, procedures that changed without the article changing, and no owner or review date on most of the content. An agent grounded in that content will repeat its contradictions fluently. The practical fix is scoped to the chosen intents: one owned, current, customer-ready article per intent, with everything else left out of the agent's knowledge sources until it is cleaned.

The wider governance around any AI assistant over Dynamics 365 data, including the staged move from read-only to acting, compliance review, audit evidence and consumption cost, is covered in our guide to governing Copilot and AI agents over Dynamics 365 data and is not repeated here.

Are AI agents on a Dynamics 365 knowledge base usable yet, and which answer patterns will legal sign off?

Yes, if the answer pattern is chosen for the risk rather than for the demo. Vague, hedged or invented answers come from letting a model paraphrase freely over a knowledge base nobody curated. Legal teams do not object to AI as such; they object to answers nobody can trace back to approved wording. Three patterns hold up, and one agent can use different patterns for different topics.

Whichever pattern you choose, set the agent so it answers only from the knowledge sources you connect, with its general model knowledge switched off for those topics, and so that when nothing relevant is found it says so and offers a person instead of guessing. The data exposure side, meaning which Dynamics 365 records an agent may read at all, is covered in our guide to governing Copilot and AI agents over Dynamics 365 data; this section is about the quality and defensibility of the answers.

PatternWhat the user getsWhy legal can approve itBest for
Extractive-only answersThe approved passage from the article, quoted as written, with a link to the full article. No paraphrase.Every word shown was written and approved by a person; the agent only finds and returns it.Terms, policies, eligibility, regulated wording and anything a customer could rely on.
Grounded retrieval with citationsA short generated answer built only from retrieved articles, with the source articles cited, and a decline when nothing matches.Each answer is traceable to its sources, and the agent does not answer outside them.How-to and product questions where a summary helps and the sources are current.
AI drafts with human approvalA draft reply prepared for a service agent, who edits and sends it.A named person approves every word before it reaches the customer.Complex or sensitive cases, complaints and anything with commercial consequence.
  • Clean a multilingual knowledge base before connecting it. Inventory every source, such as Dynamics 365 knowledge articles, SharePoint, old intranets and PDFs, keep one master article per question, link translations to their source article rather than keeping unrelated copies per language, and give each article an owner, a review date, a language and an audience tag (internal or customer).
  • Retire rather than hide. Duplicate and outdated articles in legacy systems are left out of the agent's sources until they are merged or deleted, because an agent grounded in two versions of a policy will quote either.
  • Decide how other languages are answered. Answering from an approved translation is defensible; translating an English article on the fly is a separate decision legal should take explicitly.
  • Write acceptance tests legal can sign. A test set of real customer questions in each language, each with the article that should answer it; out-of-scope questions that must be declined or handed off; and adversarial prompts, such as requests for legal advice, other customers' data or attempts to override instructions, that must be refused. Legal agrees the pass criteria before testing, and the set is re-run after every change to content or configuration.
  • Scope the board demo honestly. One language, one product area, a few dozen real questions from the test set, run live in Teams rather than on a slide, showing a cited answer, a refusal and a handoff to a person. A demo that shows the agent saying no is more convincing to a board, and to legal, than one that only shows it saying yes.

When the agent worked in testing and then fails in production

Answer quality is one risk; deployment is another. If an agent that passed its tests stops answering once it is published to Teams or a website, the cause is usually authentication, connections or environment configuration rather than the knowledge. Our guide to Copilot Studio agents that work in test but fail in Teams covers that diagnosis.

How should a Copilot Studio agent hand off to a human without the customer repeating themselves?

A handoff is only smooth if the human starts where the agent stopped. Copilot Studio can transfer a conversation to live agents in Dynamics 365 Customer Service with the conversation context carried across, and it can hand off to other engagement hubs through an integration built for that desk. Whichever desk receives it, design the handoff packet first and the channel second, so a customer who moves from the agent to a person, or from one support system to another, never has to repeat themselves.

The escape to a human has to be obvious and unconditional. Customers should be able to ask for a person at any point and be routed without being asked to rephrase, and the agent should hand off on its own when it fails to understand twice, when the customer expresses frustration, when an action needs approval, or when the intent is outside its scope. If your agents work across several support systems at once, the desk that receives the handoff matters as much as the packet, and our guide to unifying the agent desktop across legacy systems covers that side.

Whatever the channel, the handoff packet should carry:

  • The full transcript, attached to the case or conversation record rather than pasted as a note.
  • The resolved identity: the matched contact and account, and how the customer was verified, so the human does not verify again.
  • The detected intent and the details already collected, such as order number, product or appointment.
  • The attempted resolution: which articles were offered, which actions ran and their outcome, and which action is waiting for approval.
  • The reason for handoff, such as customer request, failed understanding, approval needed or out of scope, which is also what you report on.

How do you measure deflection that does not hurt customer satisfaction?

Measure outcomes rather than containment alone. A conversation that ends without a person is not resolved if the customer calls back the next day.

MeasureWhat it tells youWarning sign
Confirmed resolutionThe share of agent conversations where the customer confirmed the outcome or the action completed.Containment rising while confirmed resolution stays flat.
Repeat contactWhether the same customer comes back on the same issue through any channel within a set window.Customers who left the agent reappearing on the phone or by email.
AbandonmentConversations the customer left without resolution or handoff.Abandonment concentrated in one intent, which usually points to a knowledge gap.
Handoff reason and qualityWhy conversations were escalated, and whether human agents had to ask for information again.Human agents re-verifying identity or asking what the customer already told the bot.
Satisfaction by routeSurvey results for agent-resolved, handed-off and human-only conversations, compared side by side.Handed-off conversations scoring well below human-only ones, a sign the handoff arrives too late.

How do we govern and secure Copilot Studio agents?

Agents are easy to create and easy to create badly, so governance is part of the build rather than an afterthought. We use the same discipline as any Power Platform solution: separate development, test and production environments, solutions and deployment pipelines as described in our Power Platform ALM guide, data loss prevention policies that control which connectors agents may use, authentication for anything beyond public information, and analytics reviewed regularly to see which questions fail. Copilot Studio is licensed by capacity, so we also estimate usage during design to avoid surprises.

How does a Copilot Studio project run?

We start with a short discovery to choose the first use case and confirm the knowledge and data it needs are in usable shape, because an agent can only be as good as its sources. We then build a pilot for a small group of real users, measure resolution and escalation rates, refine the topics, knowledge and actions, and roll out in stages. Afterwards we support and extend the agent as your content and processes change, often alongside wider Power Platform and Power Automate work.

How do you find and vet Copilot Studio builders who have shipped, not just presented?

Copilot Studio is new enough that many people offering it have built demos rather than agents in production. A slide deck and a polished demo agent answering questions about a public website prove very little. What you need to know is whether the builder can ground an agent on your own content and data, connect it safely to the systems behind it, put it through environments and solutions, and measure whether it actually resolves anything. Vet for that directly, and structure the first engagement so a wrong choice costs weeks rather than a year.

A good vetting step is a small paid task: build a narrow agent over a sample of your real documents, with one action that reads data through a connector or flow, deployed as a solution to a test environment, together with an evaluation set of real questions and a short write-up of where the agent fails and why. Ask to see production analytics from agents they have run, how they handled authentication and data loss prevention, and how a conversation hands over to a human. If they cannot show or explain those, they have presented, not shipped.

  • Milestone-based contract. Pay against milestones with acceptance criteria agreed up front: discovery and an evaluation question set; a prototype in a development environment that meets an agreed pass rate on that set; a pilot with real users and analytics; then production. Each milestone ends with a go or no-go decision, so you are never committed beyond the next one.
  • Compliance guardrails to require. Authentication for anything beyond public information, data loss prevention policies restricting which connectors the agent may use, knowledge sources limited to approved content, generative answers and moderation settings reviewed, transcript retention and data location agreed with your compliance lead, a human handoff path, and agent configuration kept in solutions under source control.
  • Isolate the legacy platform behind a mediation layer. The agent should never call an old system directly. Put a narrow API between them, such as an Azure Function, a custom connector or a Power Automate flow with a fixed contract, start read-only, validate every input, log every call and limit the rate. The layer protects the legacy system from the agent, and lets you replace that system later without rebuilding the agent.
  • A 90-day prototype plan. Days 1 to 30: choose one use case, clean the knowledge it depends on, write the evaluation set and agree the mediation layer contract. Days 31 to 60: build in development, pass the evaluation set, and pilot with a small group of real users. Days 61 to 90: harden governance and monitoring, fix what the pilot exposed, and decide on a staged rollout using the analytics rather than impressions.

How Solzet delivers Copilot Studio work

Our senior Power Platform consultants build agents as part of the same Dataverse, Power Automate and Dynamics 365 solutions they already deliver, so environments, solutions, connectors and security are handled as engineering rather than added afterwards. We are happy to do the paid vetting task above, work to milestones with written acceptance criteria, and build the mediation layer in code where it belongs. The same applies when an agent works over Business Central or Finance and Operations data connected through Dataverse. Where the question is whether the underlying Dynamics 365 data is fit for AI at all, start with our guide to governing Copilot and AI agents over Dynamics 365 data.

When is Copilot Studio not the right tool?

When the task needs a structured application rather than a conversation, when answers must be fully deterministic and auditable at every step, or when the organization cannot adopt Microsoft licensing at all. In those cases a Power App, an automated flow, or a custom-built application or CRM is usually the better answer. We recommend the right solution, whether that is Dynamics 365, Power Platform, or a custom build.

What do buyers ask us?

What is Microsoft Copilot Studio?

Copilot Studio is Microsoft's platform for building AI agents. Agents answer questions from knowledge sources you connect, such as SharePoint, websites and Dataverse, perform actions through Power Automate flows and connectors, and can be deployed to Microsoft Teams, websites and Microsoft 365 Copilot. It is part of the wider Power Platform.

Can a Copilot Studio agent use our Dynamics 365 data?

Yes. Agents can read Dataverse tables and act on Dynamics 365 records through governed flows. We design permissions so the agent respects the same security as the user, and we build any data-changing action with validation and logging rather than open access.

Do we need extra licences for Copilot Studio?

Copilot Studio is licensed separately from Dynamics 365 and Microsoft 365, based on capacity for the messages agents handle, and some scenarios are covered for Microsoft 365 Copilot users. The right option depends on who uses the agent and how often, so we estimate usage during design and help you choose before you commit.

How do you stop an agent from giving wrong or unsafe answers?

By grounding it in curated knowledge sources, limiting which topics and actions it may use, requiring authentication for anything beyond public information, applying data loss prevention policies, testing it against real questions before launch, and reviewing analytics after launch to fix the questions it fails. An agent is only as reliable as its sources, so content quality is part of the project.

Are AI agents for a Dynamics knowledge base usable yet, or do they just give vague answers?

They are usable when the answer pattern fits the risk. Vague answers come from free paraphrasing over an uncurated knowledge base. Use extractive-only answers for policy and regulated wording, grounded retrieval with citations and a decline when nothing matches for how-to questions, and AI drafts approved by a person for sensitive cases, with the agent limited to the sources you connect.

How do we get legal to approve a Copilot Studio knowledge agent?

Give legal something concrete to sign: the answer pattern per topic, the approved knowledge sources with owners and review dates, how other languages are answered, and an acceptance test set of real questions with expected source articles, out-of-scope questions that must be declined and adversarial prompts that must be refused. Legal sets the pass criteria before testing, and the tests are re-run after every content or configuration change.

What should a board demo of a Copilot Studio knowledge agent show?

A narrow, honest slice: one language, one product area and a few dozen real questions from the acceptance test set, run live in Teams. Show a cited answer, a question the agent declines and a handoff to a person. Showing the agent refusing to guess builds more confidence with a board and with legal than a script of perfect answers.

How long does it take to build a Copilot Studio agent?

A focused pilot for one use case with existing, well-organized knowledge can be ready for real users in weeks. Agents that perform actions in Dynamics 365, need authentication, or draw on knowledge that must first be cleaned up take longer, and we phase them so users see value early.

Can Copilot Studio hand a conversation over to a human agent?

Yes. Agents can escalate to live agents, including agents working in Dynamics 365 Customer Service, passing the conversation context so the customer does not have to repeat themselves. We design the escalation rules so hand-over happens when the agent is not confident rather than after the customer is frustrated.

Can a Copilot Studio agent resolve Dynamics 365 Customer Service cases end to end?

For a narrow set of intents, yes. The agent verifies the customer, retrieves their case, order or booking context through defined tools, performs a bounded step such as rebooking or updating a case through a governed flow, and confirms the outcome. Anything financial or record-changing goes through an approval gate, every action is logged, and anything outside the chosen intents is handed to a person with the transcript, the resolved identity and what the agent already tried.

What should be in the handoff from an AI agent to a human service agent?

The full transcript attached to the case or conversation, the resolved identity and how the customer was verified, the detected intent and details already collected, the articles offered and actions attempted with their outcome, and the reason for the handoff. With that packet a human agent in Dynamics 365 Customer Service, or in another desk the conversation is routed to, starts where the agent stopped and the customer does not repeat themselves.

How do we find experts who really know Copilot Studio?

Ask for evidence of agents running in production rather than demos: analytics from a live agent, how authentication and data loss prevention were set up, how the agent was moved between environments, and how it hands over to a human. Then commission a small paid task over your own documents, with one data action and an evaluation set of real questions, and judge the write-up of where the agent fails as much as the answers it gets right.

What should a first Copilot Studio contract look like?

Milestone-based, with acceptance criteria agreed before work starts: discovery and an evaluation question set, a prototype that meets an agreed pass rate, a pilot with real users, then production. Include the compliance guardrails you require, ownership of the solution and configuration, and a go or no-go decision at each milestone so you are never committed beyond the next step.

How do we measure chatbot deflection without hurting customer satisfaction?

Do not report containment on its own. Track confirmed resolution, repeat contact on the same issue through any channel within a set window, abandonment by intent, handoff reasons and whether human agents had to ask for information again, and satisfaction compared across agent-resolved, handed-off and human-only conversations. If containment rises while repeat contact rises too, the agent is deflecting rather than resolving, and the scope or knowledge needs fixing before it grows.

Ready to start?

Contact Solzet for a free consultation. A senior consultant replies within one business day with a recommendation: Dynamics 365 Customer Engagement, Business Central, Finance and Operations, Power Platform, or a custom-built CRM.