Ron Mills, Definity & Anand Nimkar, Deloitte | Google Cloud Next ’24

[Savannah Peterson]

Intro

Good afternoon, nerd fam, and welcome back to Las Vegas, Nevada. We’re midway through day one of Google Cloud Next here. My name’s Savannah Peterson, joined by my brilliant co-host, Rebecca Knight. Rebecca, how are you doing this afternoon? I am very good, Savannah.

[Rebecca Knight]

Gen AI in the Call Center

Gen AI is the topic du jour. We cannot get enough of it here on theCUBE.

[Savannah Peterson]

Du jour, du week, du everything, I think, at this point.

[Rebecca Knight]

It’s true, it’s true. And one of the most salient places that Gen AI is having a lot of benefits is in the call center, and that’s what leads us to talk to our next guest.

[Savannah Peterson]

DFINITY and Deloitte Partnership

I know, very excited to have Anand and Ron here with us to talk about Gen AI. We’ve got two Canadians in the house. How’s the show going for you so far?

[Ron Mills]

Yeah, it’s great. We’re loving the weather.

[Savannah Peterson]

I can imagine. So, Ron, just in case folks are not familiar, give us a little background on DFINITY.

[Ron Mills]

DFINITY Background

Yeah, so DFINITY is a Canadian-based P&T insurance company.

[00:01:01]

We offer traditional lines, digital, pet insurance, commercial insurance, so a wide spectrum of products.

[Savannah Peterson]

That’s awesome. And you have a very unique title as chief architect of Gen AI at Deloitte. I’m curious, actually, just before we dig in, how long have you had that?

[Anand Nimkar]

Anand’s Role at Deloitte

How long has that role existed at Deloitte? Let’s start there. It’s been about a year, actually.

[Savannah Peterson]

So fresh. And tell us what your day-to-day is like.

[Anand Nimkar]

So I work with clients to do Gen AI-based implementations, many of them on Google, and we’re looking at solving very challenging business problems. So it’s a problem where we need to leverage AI to either re-engineer processes, or whether it’s process efficiency or maybe generating new revenue through marketing or other channels. So it’s an exciting space. We’re learning more about the tech every day, and it’s evolving. Just the announcements today in the keynote, I’m learning a lot about what’s coming, and we’re really excited about it, too.

[Rebecca Knight]

Well, we’re really excited to have you on because we love customer stories here because there’s so much talk about the technology, the TCUs, the PCUs, but we want to know, really, how are companies using this technology to improve the workflows for their employees, but also improve the experiences for their customers?

[00:02:16]

DFINITY’s Contact Center Project

So Dfinity went live with the contact center at the end of 2023. Why don’t you start from the beginning about what was the impetus for this project?

[Ron Mills]

Yeah, well, I think you touched on it, right? How do we improve the customer experience? How do we improve the employee experience? Leveraging some of the new technology that’s in market. So some of the things we looked at are, what were the long poles in those experiences or in that journey? And a lot of it having to do with call wrap-up, having to do with authentication, right? So what are things that are taking a lot of time from an agent’s perspective, but not adding a lot of value? And then working with partners like Deloitte, starting to build out what that solution could look like and how we can drive more efficiencies.

[Savannah Peterson]

Deloitte’s Advantage for DFINITY

How long have you two been working together?

[Ron Mills]

I would say two to three years now. Yeah, yeah.

[00:03:01]

[Savannah Peterson]

And what’s the advantage for you as a customer working with Deloitte?

[Ron Mills]

Yeah, I think for us, we want to go fast, we want to go far, but we know to do that, we can’t do it alone, right? And so partnering with folks like Deloitte, folks like Google, really brings that relationship to fruition, and we’re able to take up new concepts like CCAI and some of the cool things we saw in the keynote today. So yeah, I think it’s really about leveraging that expertise that’s in market, but also then bringing it home with our team as well.

[Rebecca Knight]

Pain Points for Agents and Customers

Yeah. So going back to the impetus for the project, what were the pain points that you were seeing, both for the agents and also for the customers?

[Ron Mills]

Yeah, I think call center has call variability.

[Rebecca Knight]

We’ve all been on, we’ve all dealt with it.

[Ron Mills]

So being able to manage the scaling or the volatility in call demands is a big thing for us, right? So how can we drive more efficiency away from the call agent, right? So when you actually want to reach someone, you want to have that person-to-person conversation, not be waiting in the queue because someone’s doing authentication or because the agent’s trying to wrap up the call, right?

[00:04:00]

So we tried to take out some of those low-value interactions so we can have more high-value face-to-face, but person-to-person interactions.

[Savannah Peterson]

Well, you want it to feel face-to-face. Yes. You want it to feel that personable, so I don’t think there’s anything wrong with that.

Trends in Gen AI Adoption

Anand, I’m curious, you see a lot of different customers and across verticals. I can imagine you’re a very popular person these days within the organization. You’re having a bit of a moment, if you will. What are some of the trends that you’re seeing in general? Is everyone kind of in a similar place across verticals? Are there some categories and spaces that you’re seeing run ahead perhaps because of their agility or maybe even smaller size?

[Anand Nimkar]

Yeah, so I see a lot of opportunity. Many of our clients, especially in financial services, are focused on knowledge retrieval or removing information disparity in our organization. They want employees to have access to information instantly, relevant to their context, so that they can just move on with whatever tasks they’re doing and actually produce more at the end of the day.

[00:05:02]

In the call center, this shows up in a very interesting way. Agents, when they’re on a call with a customer, they’re often navigating multiple applications. The most I’ve ever seen in one flow was over 30 applications that an agent had to do to execute an interaction. If you can remove some of that through automation, through generative AI, moving from the front office into the back office, doing some of that straight-through processing with generative AI, we’re seeing customers experiment with that and also leveraging information retrieval and knowledge retrieval throughout that journey.

[Rebecca Knight]

Companies’ Journey with Gen AI

And where are they in this phase? Because one of the things that has really come through, at least in the keynote, is that we’ve gone from, it was about a year and a half when ChatGPT was unleashed into the world to here we are today, where companies really are just going from, oh wow, here’s this new bright, shiny toy, to let’s really integrate this into our systems. Where do you think companies are in their journey?

[Anand Nimkar]

Yeah, so I’d say the past year, or at least in 2023, there was a focus on POCs.

[00:06:03]

A lot of companies were like, here’s this new hammer, and what are all the possible things we can do with it? And this year, the focus is really about moving from POCs into production. A lot of companies are looking at low-value, high-volume processes and looking to re-engineer them from the ground up with generative AI, and they’re building business cases usually based on either cost savings you do, improvement of utilization of talent, or maybe there is new capabilities that they want to enable, new products that they want to enable with this technology. So there’s a huge push around impactful, focused deployments of generative AI that then you can build as a foundation upon which you can scale. And ultimately, I think the future operating model for an organization is one where you have AI agents, like we saw today at the keynote, interacting with humans in a collaboration.

[00:07:01]

So a request coming in, going through a collaboration or orchestration of that. And so, over the next few years, I think we’re going to see a lot of new capabilities, new entrants into existing long-standing industries where there’s incumbents, just trying to come to market with new processes.

[Savannah Peterson]

Challenges and Advice for Companies

What are some of the challenges there? You just described that as a very smooth process which, given that you’re a consultant, is sort of the name of the game. But I mean, obviously there’s best practices and there’s a great way to do this. What’s your advice to folks? And actually, Ron, I’ll turn this to you first. To companies who are embarking on this journey, we’re all still in kind of the sandbox stage. How do they get to that at-scale moment of realization like you’ve achieved?

[Ron Mills]

Yeah, I think maybe if we take a step back, for us it was even what preceded this, right? And so we had just gone through our data transformation journey, which allowed us to be ready for this. So the timing was great. We had just moved to cloud, moved our data platforms to cloud, made the data available for these types of programs.

[00:08:02]

Then I think it’s really about finding your right risk tolerance, right? What’s your organizational risk appetite? Do you want to do something that’s internal facing, that’s lower risk? Do you want to do something similar to maybe what we did, which was, again, not directly interacting with the customer from that sense of kind of responding and response? Yeah, I think that’s key, right? Just figure out where your comfort zone is. And then the opportunity, like I said, for us is really driving out that talk time, right? The call time, how can we reduce that and reduce the pain points that come along with longer talk times?

[Savannah Peterson]

How does your team feel? How has your team responded to that adjustment? Do you feel like morale is up?

[Ron Mills]

So I think people are excited, for sure. Like you said, this is the talk of the town, right? So it’s exciting to be operating in this space. We tend to think of ourselves as a leading organization in a digital space, so absolutely. So it brings that empowerment to the team that we’re not reading about, but we’re actually doing it as well.

[Savannah Peterson]

We’ve been talking about it on the show, 2024, the year of making AI real. Not just this hype stage that we’re obviously peaking in right now, big time.

[00:09:03]

Anand, on your side, what’s your advice to folks?

Risks to Avoid for Success

Or what are the risks you would like to see them avoid so they can achieve success and apply your solutions faster?

[Anand Nimkar]

Yeah, so with generative AI, now that we’re putting in, we’re creating applications now that are non-deterministic in their outputs, right? So the mechanisms you use to test for that and evaluate these applications have completely changed. In the past, where you would otherwise invest in manual testing efforts or automated testing with fixed determinism, now you’re looking at non-deterministic outputs and you’re using generative AI to test generative AI. The game is completely different. So I think investing in tooling, putting in the right foundation, breaking down data silos so you have relevant data that you can use for evaluation is important. And then beyond that, I think the control functions in any organizations, particularly in financial institutions, they can slow things down, right? So they are bottlenecks, and you can invest in them by empowering them with tools, with guidance, and making sure that they are ready to support use cases as they come through.

[00:10:06]

And we’re seeing clients actually start to do that, where they’re investing in governance while at the same time promoting use cases that could have a material impact on the business.

Partnership Characteristics

Yeah.

[Rebecca Knight]

So you have been working together for a few years now. I’m curious, Anand, what do you think about the kinds of partnerships that you’re looking for? I mean, are there certain characteristics, are there certain values that you need to share, a certain commitment to certain kinds of technologies? I mean, how do you describe what you look for? Because I mean, it’s a little, it’s a relationship that you need to cultivate.

[Anand Nimkar]

Yeah. So we’re focused on driving outsized outcomes for our clients, right? So our clients approach us with challenging business problems, and in many cases, and Deloitte does this quite a bit, where we’re not just paid by the hour, right? We actually engage in the implementation, and we sign up to the risks associated to that, right?

[00:11:05]

And so we share in the benefits and the outcomes in these value-based constructs, right? So we’re doing that a lot more. And I think what’s important to us is that it’s an important strategic problem for the industry, for the client themselves, potentially for society, because we also feel a sense of purpose in actually helping our clients achieve these visions or these lofty goals, right? So, yeah.

[Savannah Peterson]

Lagging Sectors in Gen AI Adoption

Would you say there’s any sectors that are lagging behind right now? I mean, I’ve said this with love, financial services is not always the front line to technology adoption, and obviously you are, and you consider yourselves leaders. Are you noticing any trends? And I mean, I’m even curious, from a Canada to North American perspective, where some folks are either afraid or falling behind, and some industries that are really out in front?

[Anand Nimkar]

Lots. Yeah. So I think financial services, surprisingly, at least out of Canada, has been leading the charge on some of this stuff. That’s awesome.

[Savannah Peterson]

Why do you think that is?

[00:12:00]

I’m curious, just to dig in.

[Anand Nimkar]

I think there’s tremendous benefits that can be obtained from the technology, and there are already business cases for many existing processes for automation, right? So I think there’s an opportunity. Many of them have focused, they’ve shied away from customer-facing use cases, and that’s understandable, because to prove other technology at scale, they probably want it internal-facing with employees. We’re seeing that risk posture, and over time, if I look across the world, like globally in Europe, there’s some companies that are putting things in front of customers already, so we’re seeing that shift. In terms of industries that are lagging, I think like public sector, government services, they’re a bit slow to procure, but they do understand the value, and they do understand the vision for this, and I think the scale of implementations can be a lot larger, but there’s a lot more risks there, because you’re dealing with citizens, and different types of regulations, right? So any regulated industry is slower. Consumer has been out the gate really fast to adopt, and other technology companies are infusing it throughout, so there’s really no rhyme or reason.

[00:13:03]

I would say every industry is focused on bringing generative AI to their markets, or infusing it in their processes. There’s just different regulatory hurdles along the way that some are navigating, but overall, I feel a sense of optimism across the sectors about this, yeah.

[Rebecca Knight]

Addressing Workforce Resistance to AI

Well, the positive energy is emanating, and as you said, Ron, morale is up, and in general, agents are really excited about the effect that this is having on their work. So much of what we hear is that there is some resistance to AI in the workforce, a nervousness, a skepticism, a worry about jobs dislocation. What are some of the things that you’ve learned in talking to your team and talking to your workforce that you maybe could share to get more employees on board, or for other industries to hear?

[Ron Mills]

Yeah, and I think it’s like we touched on, right? We’re taking out the low-value piece, right? For us, we did call summarization, right? So the wrap-up part of the conversation isn’t the most exciting part of the conversation either for the agent themselves, right?

[00:14:03]

The authentication piece. So again, I think we’ve taken out the pieces of the job that probably weren’t favorites, if you will, and again, they serve the benefit as well from an expense side, right? Allows us to serve more calls, where again, we’re doing this real interaction versus the precursor to the call. So I think that’s been positive for them. Again, we’re taking out some of the pain points in their experience. So again, it’s not only about the customer experience, but also the employee experience in this case.

[Savannah Peterson]

Customer Impact of DFINITY’s Project

Right, right. Have your customers noticed?

[Ron Mills]

I think they’ll notice, I think you shared early on, maybe the wait time to calls, right?

[Savannah Peterson]

Yeah, yeah.

[Ron Mills]

I think there’s a benefit from that side as well. On the wrap-up side, again, that part’s transparent to the customer, right? On the authentication side, again, you would notice that you’re interacting, obviously, with a virtual agent instead of with a human. But again, the questions are there, right? It should be a seamless interaction. It should feel like we’re talking like this, even though it is the bot, right? So yeah, it’s been positive on both sides. Again, both on the employee experience side, but as well as the customer side.

[00:15:01]

[Savannah Peterson]

Canadian AI Scene

Yeah, that’s awesome to hear. What are some of the trends that you’re seeing since I didn’t get a chance to ask you? In the Canadian AI scene, for example, we’re pretty deeply immersed here on the American side. We were just over in Paris and in Barcelona as well. But I can’t say we’ve done a gig in Canada recently. So what’s going on? What do you and your friends talk about in this space?

[Ron Mills]

Probably all the same things as our North American counterparts and European counterparts. Yeah, I think it depends what domain you’re in, right? Yeah. And I think in the Gen AI space, what we’re hearing in the peer group, and Anand touched on this, right, there’s a lot of internal POCs, right? How can we help back office functions? And I think there’s two sides there, right? How can we prove that out in a safe and reliable way? And I think there’s tons of opportunity to improve in that space as well. So that’s what we’re talking about, again, within our peer groups mainly. Anand? Yeah, I would say that…

[Anand Nimkar]

Sorry, what was the question again?

[Savannah Peterson]

Vibe in Canada

Well, I was curious about, because I think it’s actually… So I live in the Silicon Valley. Conversation in the Silicon Valley is very different than the conversation even in Las Vegas or in Paris or in Barcelona.

[00:16:01]

Yeah, so what’s the vibe in Canada?

[Anand Nimkar]

Yeah, I think there’s a lot of… So we’re basically in Toronto. And Toronto, Montreal, they’re tech hubs, they’re AI centers of the world. We have a lot of talent and there’s a lot of work happening in building applications that leverage this technology. I think where Canada is lagging behind is in infrastructure. So in investments in compute, right? So bringing GPU capacity to Canada. Recently, the Canadian government announced over $2 billion in spending to do that, to actually bring that capacity to Canada.

[Savannah Peterson]

On the hardware side specifically?

[Anand Nimkar]

On the hardware side, yeah. Wow, cool, that’s awesome. Yeah, this was like last week the Prime Minister announced it. So I think there is a realization of this and there’s a desire to catch up with other nations. From a regulatory perspective, I think Canada was first to have the regulations in place around AI, or at least proposed. I did not know that. That’s outstanding.

[00:17:00]

They’re still not fully ratified, but I think there has been thinking around the potential for AI to disrupt society and jobs and work in general, and safeguards being contemplated and discussed. So I think what the government is doing and what industry is doing is they’re putting in place the right guardrails so that they can foster an exponential growth in the technology and use. As I engage more with clients, I’m seeing a willingness to buy these technologies that has gone through the roof since ChatGBT.

[Savannah Peterson]

Money Following the Hype

So the money is following the hype a little bit. I mean, you’re Deloitte, so I guess that’s probably accurate.

[Anand Nimkar]

Yeah, I guess. I would say that. And again, making sure you have the right use cases and actually generate real value is critical. We spent a lot of time up front building business cases and selecting use cases and refining and measuring before we even decided what to do. That was about a year, I think, we had worked together on that. Oh, wow. Yeah. And then you can start picking off the low-hanging fruit from that, yeah.

[00:18:04]

[Ron Mills]

As you said earlier, how do you bring it to realization, right? Yeah. How do you make it real, right? How do we get off that hype curve?

[Savannah Peterson]

Future Expectations

Yeah, no, it’s super exciting. All right, last question for you, gentlemen. And you don’t have to give me numbers, Ron, I promise. When we have you back on the show for another fabulous customer use case story, what do you hope you can say a year from today or at the next Google Cloud Next, whenever it is, that you can’t quite say yet?

[Ron Mills]

Ron, I’ll start with you. Start with me. Yeah, I think, again, we’re looking to chase this wave just like everyone else, right? So I think there’s tremendous opportunity there, and we’re doing the exploration, as Anand said, across the organization, front to back. So we hope we have more stories to tell you in different spaces, and maybe share some numbers.

[Savannah Peterson]

Yeah, we’d love, hey, we’re here for that data. We love that, Anand. Anand, what about you?

[Anand Nimkar]

Yeah, so, you know, I’m a geek, and I…

[Savannah Peterson]

There’s no geeks here. I don’t know, you must feel really out of place.

[Anand Nimkar]

Yeah, this is like my home. So I would say the multimodal models that are coming to market are quite powerful.

[00:19:00]

With a million context-length windows, I think just very novel experiences that we can drive with customers is something that I’m really looking forward to. So beyond just simple functions or automation, it’s net new capabilities, experiences, products. I hope to be back here to share a story about something like that, yeah.

[Savannah Peterson]

The future is bright. Anand and Ron, thank you so much for being here with us on the show. This was a fantastic chat. Rebecca, always a pleasure. And thank all of you for tuning in from wherever you are on this beautiful rock to our fabulous three days of coverage at Google Cloud Next here in Las Vegas, Nevada. My name’s Savannah Peterson. You’re watching theCUBE, the leading source for enterprise tech news.