-
1417
04:01:09.230 –> 04:01:21.090
Julia Nimchinski: Thanks so much again. And we are thrilled to present Carol Dietrich, our favorite CMO advisor to Lovable, who took a plusie in public. Welcome to the show!1418
04:01:23.500 –> 04:01:24.610
Julia Nimchinski: Carlo?1419
04:01:25.710 –> 04:01:40.490
Carilu Dietrich: Sorry, just getting off of mute here and video. So excited to be here, Julia. Thank you for having us. And huge thanks and round of applause to Julia for amazing work to bring so many fantastic people together and to challenge us to think forward. So thank you, Julia, for everything you do.1420
04:01:40.600 –> 04:01:50.610
Carilu Dietrich: I’m so excited to be here today with a super killer panel of folks to talk about agents as the distribution channel, and the distribution channel for growth.1421
04:01:50.610 –> 04:02:14.280
Carilu Dietrich: So, traditionally, when we’ve talked about distribution, it’s been our historical channels of email, advertising, partners, websites, but now, agents are becoming the channel. The channel through which we’re selling to a buyer on the other end who’s researching, comparing different options, and in e-commerce, even potentially starting to put1422
04:02:14.280 –> 04:02:22.770
Carilu Dietrich: put things into carts and buy them. And so, we’re starting to see this emerging field where agents will become the buyer,1423
04:02:22.940 –> 04:02:45.049
Carilu Dietrich: specifically going out and researching on behalf of their agent operator, and agents as the operator within a company, creating the answers for the company to talk to buyers. And what’s gonna really get crazy here shortly is when agents are talking to agents, and humans aren’t even necessarily in the conversation.1424
04:02:45.200 –> 04:02:58.170
Carilu Dietrich: It changes everything about the way we think about creating our websites, the content we share, the way we nurture leads, the way we track who knows what, who knows about us already, so…1425
04:02:58.170 –> 04:03:05.590
Carilu Dietrich: marketing is going to be turned on its head here shortly, and I have this amazing group here to talk about some of the implications1426
04:03:05.590 –> 04:03:10.040
Carilu Dietrich: Of what we’re seeing already, and give you some of our predictions for what’s coming next.1427
04:03:10.040 –> 04:03:20.209
Carilu Dietrich: So, first, let’s just get a roundup of each of our speakers and some of their background in this AI and agent space. Marcel, do you want to start us off?1428
04:03:20.880 –> 04:03:33.399
Marcel Santilli: Sure. Hi, Marcel Santilli here, CEO and co-founder at GrowthX.ai. Prior to GrowthX, I was CMO at a few different companies, like Scale AI, DeepGram.1429
04:03:33.400 –> 04:03:57.599
Marcel Santilli: HashiCorp, Service Titan, leading growth there. And, a little bit on GrowthX. We build AI power with experts in the loop systems for companies to grow their content and get more visibility in AI. We are lucky to get to work with companies like Lovable and RAMP and Webflow, Sentinel-1, and a bunch of others, and so excited to be here.1430
04:03:58.320 –> 04:04:00.839
Carilu Dietrich: Great, thanks for joining us. Lisa, would you like to go next?1431
04:04:01.990 –> 04:04:21.470
Lisa Sharapata: Sure, so I’m Lisa Sharapata, and I’m currently the VP of AI and Go-to-market strategy at Metadata, but I’ve been in the B2B tech space for well over a decade, and in marketing, like, twice as long as that, to age myself. And, it’s been…1432
04:04:21.470 –> 04:04:32.879
Lisa Sharapata: Really cool to see how things have evolved. Metadata’s been around for about a decade now as well, and is a, ad… digital ad platform.1433
04:04:32.880 –> 04:04:41.779
Lisa Sharapata: But seeing how AI and the agents that they’re building is really shaped, like, just completely changing the shape of how1434
04:04:41.780 –> 04:04:58.869
Lisa Sharapata: you know, I’m going to market, and how marketers, you know, can do their digital ads and be thinking about orchestrating the entire go-to-market strategy has been really cool, so I’m excited to share some of what I’m seeing. Great, thank you. Omer, do you want to go next?1435
04:04:59.340 –> 04:05:06.450
Omer Gotlieb: Sure, and thank you everyone, excited to be here. Omer Gottlieb previously co-founded Tutango, the custom success platform.1436
04:05:06.500 –> 04:05:17.449
Omer Gotlieb: I’m the CEO, co-founder of Salespeak, and in a nutshell, we’re trying to improve the B2B buying experience by providing an intelligent conversation layer between a buyer and a company.1437
04:05:17.450 –> 04:05:33.129
Omer Gotlieb: So, if a buyer, by the way, a human being, really, or maybe their agent, if they interact today with a company, they need to, you know, stick with a static website, or with an inexperienced SDR, or with a stupid email, and we enable those kind of conversations to be much more intelligent.1438
04:05:33.580 –> 04:05:34.400
Omer Gotlieb: And thank you again.1439
04:05:34.990 –> 04:05:37.530
Carilu Dietrich: And Kevin, do you want to go next?1440
04:05:37.920 –> 04:05:47.039
Kevin Marasco: Sure, thanks, Claire Lou. Everyone, pleasure to be here. Kevin Murasco, four-time CMO, currently Chief Growth Officer at, Tebra.1441
04:05:47.170 –> 04:05:57.969
Kevin Marasco: helping independent, healthcare practices apply HR, which is a massive opportunity in and of itself, because I can’t think of an industry in the U.S. that’s more1442
04:05:57.970 –> 04:06:07.639
Kevin Marasco: ripe for modernization than, healthcare and helping supercharge, healthcare providers with so much burnout. And, if not more…1443
04:06:07.640 –> 04:06:23.639
Kevin Marasco: even more excited, is about applying AI to totally transform how we do all aspects of go-to-market. You know, in my few decades, I’ve never seen anything disrupting so fast or as furious as what we’re seeing right now, and really excited to be here.1444
04:06:24.450 –> 04:06:26.270
Carilu Dietrich: Thank you. And Tuba?1445
04:06:26.900 –> 04:06:51.239
Tooba Durraze: Thanks so much for having me. So, my name’s Chupa, I’m the CEO and founder of Amoeba AI. We’re a newer symbolic AI platform that’s building the new brain for your business, so we have agents that get deployed on top of your data to take a look at what’s happening in your business and to give you recommendations before they actually, offset your business. But by background, I’m a data scientist, a previous VPO product, I qualified, and1446
04:06:51.240 –> 04:06:52.690
Tooba Durraze: Very happy to be here today. -
1447
04:06:53.530 –> 04:07:15.369
Carilu Dietrich: Great. Like I said, such a killer panel. Some of the brightest minds I know that Julia helped me recruit, so thanks for joining me. Let’s just talk about what we mean by agents first, because I think there’s really this, agent washing going on. You know, if everything’s an agent, is nothing an agent, or if every LLM is an agent, does it denigrate what we actually mean by agents?1448
04:07:15.370 –> 04:07:18.679
Carilu Dietrich: Who wants to weigh in first here?1449
04:07:18.680 –> 04:07:20.239
Omer Gotlieb: I wanna, I wanna take it for a…1450
04:07:20.660 –> 04:07:38.209
Omer Gotlieb: Because I want to take it for a second, because I think I agree, I think, you know, there’s a lot of chaos and unclear about what is an agent, what is the agent in marketing. I attended Inbound, the conference last week, and every booth there was, we were doing agenting marketing, and nobody really understands what it is.1451
04:07:38.270 –> 04:07:53.019
Omer Gotlieb: I don’t think that’s that important, but for this discussion, I would frame agent or an agent marketing into some kind of an intelligent entity that can actually run workflows and take actions for you.1452
04:07:53.190 –> 04:08:04.690
Omer Gotlieb: So that’s a combination of some things, and of course, the implication, you could say that almost every product may or may not have an agentic component to that as well, but completely chaotic right now.1453
04:08:05.130 –> 04:08:30.130
Carilu Dietrich: Yeah, and so not just researching your product and LLM, but having more autonomous actions that it’s taking, and more orchestrations, and even deciding things on its own. So, you know, in e-commerce, we’re already starting to hear about people having agents which can shop on their behalf, add things to cart, and potentially even check out. In B2B, we’re in a much different space, although B2B is always1454
04:08:30.130 –> 04:08:35.130
Carilu Dietrich: following, a fast follow, to B2C. But,1455
04:08:35.130 –> 04:08:52.799
Carilu Dietrich: you know, many of us on the phone are already seeing a ton of agent traffic to our websites, and Marcel, that’s one of the areas that your company focuses on. What are you seeing in agent shopping? How are the agents performing? How are,1456
04:08:52.800 –> 04:08:56.849
Carilu Dietrich: How are these, leads that are coming to websites converting?1457
04:08:57.540 –> 04:09:05.100
Marcel Santilli: Yeah, like, so the way to think about it is, your first sales call for B2B, your first sales call is happening outside1458
04:09:05.100 –> 04:09:29.830
Marcel Santilli: of your website now, and your conversations, because in AI answers, people are spending on average of 15, 20 minutes, kind of researching, and it’s almost like these people are ingesting that information as the gospel, right? They’re thinking of it as, like, expert advice, so it’s almost the equivalent of word of mouth. So then by the time, if you do show up in those answers, and they come to your website, they’re converting, and we see with some of our1459
04:09:29.830 –> 04:09:54.630
Marcel Santilli: customers three to five times higher. So the value of that traffic that does end up coming to you is such higher intent that it’s so much more valuable. And it’s not like search is going away, and there’s no traffic there. And so I think it’s similar behavior to e-commerce, except in the e-commerce, you’re checking out on a card, and people are aggregating and curating items, and then you’re finishing the checkout, whereas in B2B, because the process is longer, they’re doing a lot1460
04:09:54.630 –> 04:09:56.749
Marcel Santilli: More of the research they would do post-sales.1461
04:09:56.750 –> 04:10:20.140
Marcel Santilli: earlier on, and then they’re giving a lot more context on who they are, their company, and everything about them, which means companies have to figure out how to build this really high-quality, credible content engine that ends up getting cited and show up in these answers to be part of it, right? And the quality bar is even higher, and the long tail is even longer, which now means you have to hit both the speed1462
04:10:20.140 –> 04:10:24.200
Marcel Santilli: Volume and quality in order to win. Yeah.1463
04:10:24.200 –> 04:10:42.089
Carilu Dietrich: But, some of the results are showing up really quickly. I mean, one of the things that’s so amazing about the new agents, I guess the new ways of indexing is that some of your new content can show up in a couple days, whereas in SEO, it used to be 6 months sometimes before you changed, right? The agents are moving quickly.1464
04:10:42.340 –> 04:11:02.339
Marcel Santilli: with Augment Code, one of our customers, I think that within an hour of publishing something, we saw one of their answers changing completely. The context, the way the wording was kind of done. And so, the way I like to think about it is we’re like an inception engine, essentially, except that inception engine actually has to build credibility with your customers as well, because…1465
04:11:02.340 –> 04:11:04.420
Marcel Santilli: You can’t say the wrong things either.1466
04:11:05.250 –> 04:11:19.850
Carilu Dietrich: And Kevin, you guys are doing all sorts of Q&A work and have a bunch of agents that interact with different customers that come to the website, including, like, a virtual human, a superhuman, right? Or are you still experimenting with that?1467
04:11:20.440 –> 04:11:24.429
Kevin Marasco: We are. I think for us, I mean.1468
04:11:24.670 –> 04:11:37.679
Kevin Marasco: from a B2B standpoint, like, I first thought about it as, maybe not, like, agent-informed buying, or thought of it as not agent buying, but actually agent-informed buying, where, kind of to Marcel’s point, like.1469
04:11:37.680 –> 04:12:00.489
Kevin Marasco: agents are, you know, the whole top of funnel is being disrupted, so it’s thinking about, like, how agents are transforming the consumption side, but then also, we have to be thinking about and changing how agents change the distribution side, right? And so for us, that’s automating through, an automated system of agents, how they engage buyers through all channels, including1470
04:12:00.490 –> 04:12:12.870
Kevin Marasco: You know, first of all, identifying targets, but then engaging through email, chat, and then, voice and actual interactions on the website. And so, we’re testing, you know, all of those channels, really.1471
04:12:14.110 –> 04:12:31.920
Carilu Dietrich: And that leads us right to our next question, which is, as agents, instead of agents as the buyer, agents as the distribution. Tuba, you are doing a lot of work with roadmaps that are including agent-to-agent information requests, and you’re kind of leading in this space. Talk to us a little bit about agents as the distribution.1472
04:12:32.070 –> 04:12:40.120
Tooba Durraze: Yeah, we’re an intelligence platform, and a lot of folks want to kind of see the intelligence being converted into some sort of an action.1473
04:12:40.120 –> 04:13:05.079
Tooba Durraze: And then they don’t want to be the ones who are orchestrating that action, right? As long as they’re trusting the insights, etc. So we get requests on agent-to-agent communication in terms of orchestrating something in other platforms, or in terms of sharing information as well. If I think of, kind of Lisa’s product, as well, like, potentially, like, creating campaigns and metadata, etc. So more and more, we’re going to see that you use agent-to-agent interaction1474
04:13:05.080 –> 04:13:08.230
Tooba Durraze: For the grant work, as long as you’re approving the recommendation.1475
04:13:09.560 –> 04:13:18.919
Carilu Dietrich: And Lisa, you guys have rolled out an MCP offering recently, and are kind of pretty deep in this agent world. Like, tell us more how you’re thinking about it as distribution.1476
04:13:18.920 –> 04:13:21.380
Lisa Sharapata: Yeah. So, less…1477
04:13:21.730 –> 04:13:40.949
Lisa Sharapata: on the consumer side right now, it’s more agent-to-agent, like you said. So, thinking about things like, how do I analyze current campaigns? So, there’s multiple agents that it actually takes to do that. So, looking at performance, looking at different experiments that have been run, different budget groups, different audiences.1478
04:13:41.100 –> 04:13:48.199
Lisa Sharapata: To identify, kind of, what, kind of, the best use case would be, and then you can…1479
04:13:48.360 –> 04:13:58.559
Lisa Sharapata: you know, inside of Claude today because of this MCP server connector, which I’ll be showing after this. It’s kind of complicated, right? Sounds complicated.1480
04:13:59.140 –> 04:14:13.669
Lisa Sharapata: these agents are all talking to each other, so I can create a new campaign with that information, I can build new audiences, I can dedicate budget, and I can deploy it right from Claude today.1481
04:14:14.120 –> 04:14:28.240
Lisa Sharapata: like, and another example would be we have a bid agent that sits inside of our platform, but it works with LinkedIn. So, if you turn it on, it’s figuring out the LinkedIn algorithm, it’s adjusting1482
04:14:28.470 –> 04:14:48.380
Lisa Sharapata: your ad spend within the limits you’ve defined, and it’s autonomously making decisions based on the criteria that you’ve set for it, on your behalf 24-7. But you… it’s like a toggle on, toggle off. You set the parameters, you can change the parameters, and then it’s making decisions for you.1483
04:14:49.500 –> 04:15:08.499
Omer Gotlieb: And, Carilo, I wanna… I wanna double down for a second on the genting distribution, and I want to warn the audience from a trap that a lot of companies are falling into. I don’t know about you, but when I open my email every day in my inbox, every day, there are 15 messages that look the same. Omer, quick question. Omer, can you join my podcast?1484
04:15:08.500 –> 04:15:19.730
Omer Gotlieb: When I look at my LinkedIn post, I see comments that it’s clear the AI actually wrote them. I think some people say, hey, it’s very easy, let’s take an AI agent, you know, buy it or develop it, that can1485
04:15:19.730 –> 04:15:22.379
Omer Gotlieb: Produce some content, and let’s just put it out there.1486
04:15:22.500 –> 04:15:34.089
Omer Gotlieb: And the problem is that 100,000 people are actually doing that, not in a very intelligent way, and we, if we wear our Byron hat for a second, are being stammed and flooded. And so I think…1487
04:15:34.150 –> 04:15:42.730
Omer Gotlieb: I think one of the most common traps that I see is people use AI, but not intelligently. They use AI to simply1488
04:15:42.930 –> 04:15:59.190
Omer Gotlieb: automate broken processes, and I think the best example that I have personally is, you know, think about those AI SDRs and things like that, you know. Did you ever want to speak with an SDR? Why would I want to speak with an AI SDR? So why are we taking an SDR and amplifying it?1489
04:15:59.190 –> 04:16:04.479
Omer Gotlieb: We want to do something different, and I think AI has the opportunity to do that, so when you think about1490
04:16:04.550 –> 04:16:19.320
Omer Gotlieb: using agentic distribution, it’s not about the automation. Automation is an important part of it, but I think it’s much more about the intelligence that you put inside, the experience that you put inside, and I think we can do great things with it.1491
04:16:19.320 –> 04:16:34.369
Tooba Durraze: Can I add a lens to that? I think I’ll push back on receiving massive amounts of, kind of, AI inbound, etc. The piece that you’re missing is the agent on your side, essentially, so you could say, hey, I’m only interested in, say, like, speaking on podcasts.1492
04:16:34.370 –> 04:16:41.869
Tooba Durraze: We never… we never closed the loop, right? Essentially, that way. If it was agent-to-agent, I bet it would be really useful, because you would only1493
04:16:41.870 –> 04:16:50.650
Tooba Durraze: relevant to you. But to your point, we rushed to automation, and we, like, forgot to kind of bridge that gap.1494
04:16:51.300 –> 04:16:52.079
Omer Gotlieb: I agree.1495
04:16:52.600 –> 04:16:52.950
Marcel Santilli: Think…1496
04:16:52.950 –> 04:17:07.749
Carilu Dietrich: It’s funny, not on the agent topic, but one of my old colleagues is the VP of Marketing at Deal, and they did their ad campaign with Veo, a totally AI-generated video that looks so amazing.1497
04:17:07.750 –> 04:17:22.270
Carilu Dietrich: And, she’s like, we did it in just a couple days instead of weeks. And I ended up talking to her about it, and they have a pretty extensive video and design team that has a lot of specialty. There was a producer, and they looked at costume design and1498
04:17:22.270 –> 04:17:47.249
Carilu Dietrich: characters and storyboards, like, they went through a bunch of thinking processes to then use VAO in two days to create something amazing. But I guess, kind of coming back to what you’re saying, Omar, what it really reinforced to me is that the AI can be so powerful if it’s built on top of people with knowledge doing something interesting, right? Right? Like, no one wants to replicate the annoyance of, like, forms and an uninformed reach-out that’s, like, gets you everything1499
04:17:47.250 –> 04:17:48.150
Carilu Dietrich: wrong.1500
04:17:48.150 –> 04:17:58.619
Carilu Dietrich: But if it was, like, you know, some of these, forward-deployed engineers that developer, companies are employing as their,1501
04:17:58.620 –> 04:18:11.180
Carilu Dietrich: as their SDRs, who are, like, instead of, like, trying to qualify you, there’s, like, hey, you know, do you want some sample apps? Like, here’s some common problems people have. If you have any problems, like, setting up, I’m here for you. Like, if we can really, like.1502
04:18:11.180 –> 04:18:25.709
Carilu Dietrich: create the ideation, to create the agent that’s actually really helpful, it could be delightful, and then humans can be there at the right time. You know, the dream is better than just, like, the perpetuity of horrible agent emails in our inboxes.1503
04:18:26.770 –> 04:18:39.709
Lisa Sharapata: Well, and just to circle back on what I was trying to get across, too, is that these agents can get you so far, and actually, you could even just say, build it and deploy it, right? But the human in the loop1504
04:18:39.740 –> 04:18:53.269
Lisa Sharapata: is, I think, very relevant still in the example I was giving as well, where you’re looking at what was analyzed, and you’re still making strategic decisions. And, you know, I can still push back and say.1505
04:18:53.270 –> 04:19:05.749
Lisa Sharapata: okay, well, I really need to generate this much pipeline in this short of time, and I only have $20,000, not $30,000, so can, you know, you help me reimagine it based on that, not just…1506
04:19:05.780 –> 04:19:07.590
Lisa Sharapata: like, running…1507
04:19:07.750 –> 04:19:26.999
Lisa Sharapata: you know, wild, with no guardrails. And same thing with the bidding. No one wants to sit there and bid on campaigns 24-7, trying, you know, moving it up a dollar and down a dollar, so I think that there’s really great use cases that can help free up capacity to be1508
04:19:27.000 –> 04:19:31.940
Lisa Sharapata: More creative, and more thoughtful, and try different things, and…1509
04:19:32.330 –> 04:19:39.720
Lisa Sharapata: and then, you know, automate things that, frankly, like, no human could really even do at that scale. So…1510
04:19:39.930 –> 04:19:43.700
Lisa Sharapata: you know, back to what you were saying, Omar, too, is it’s not just1511
04:19:43.900 –> 04:19:50.289
Lisa Sharapata: you know, throw an agent on that and spit out 5X more emails to people.1512
04:19:50.540 –> 04:19:55.550
Lisa Sharapata: That’s, I don’t think, a responsible use of distribution.1513
04:19:56.800 –> 04:20:10.730
Carilu Dietrich: So, there’s these two aspects we talked about when we were prepping about agents as the interface, like the buyer who’s coming to our website, and agents as the operator, and the operator being the one who’s, like, compiling the information. Kevin, you’ve done some of the more advanced1514
04:20:10.730 –> 04:20:29.200
Carilu Dietrich: operator agents that I’ve seen. I know you have one for competitive battle cards, you have one for customer references, you have some that are tied together for a number of different steps that inform each other. Like, talk to us a little bit about agents as the operator inside the company doing the selling.1515
04:20:31.080 –> 04:20:36.720
Kevin Marasco: Yeah, I think, you know what’s key is… is not just…1516
04:20:36.860 –> 04:20:45.000
Kevin Marasco: we have, like, base-level automation, and I think the trap here is just doing… just automating something, right? Making it a bad process. How do we take…1517
04:20:45.220 –> 04:20:57.300
Kevin Marasco: agents and apply it to up-level what is the art of the possible, and what you could do. And that, with the increased, like, context library and the speed to be able to analyze, execute, make decisions.1518
04:20:57.300 –> 04:21:06.969
Kevin Marasco: And give agency, to the agents. It, it, unlocks, on the operating side, some pretty, pretty exciting things, so…1519
04:21:06.970 –> 04:21:21.389
Kevin Marasco: I think for… for me, it first started where we always want more resources, right? And what could we do with more resources? And you could apply it to whatever area of your funnel or growth lever you have. And, you know, historically, I think, oh, well, we had1520
04:21:21.390 –> 04:21:31.200
Kevin Marasco: you know, another, you know, product marketing team was 3 times as big, we could create more battle cards and enablement content and help, you know, our sellers, sellers convert more.1521
04:21:31.200 –> 04:21:44.460
Kevin Marasco: well, now with agents, we could take that work and we could scale. But what the important part is, we gotta scale it, like, in an intelligent way, do the right things. And, like, like, Omer’s, like, SDR’s example, yeah, you could just take an agent and1522
04:21:44.460 –> 04:21:53.919
Kevin Marasco: send more emails faster, but I think that’s… that’s the trap we have to avoid. Like, how can we make that experience better for the buyer, where1523
04:21:53.920 –> 04:22:08.450
Kevin Marasco: what maybe was the job of the historic SDRs we’ve known over the past couple days, but supercharge them with information to be hyper-consultative and guide the buyer through, their buying journey and add value to the experience. I think1524
04:22:08.450 –> 04:22:16.779
Kevin Marasco: Like, that’s been, for me, the trap is, like, it usually starts with, hey, it unlocks this incredible amount of scale and leverage, but…1525
04:22:16.780 –> 04:22:32.690
Kevin Marasco: then also have to, like, jump to, hey, how do we do it in a smarter, better way to make a better, you know, buying experience and a better, you know, selling experience, too. But we’re, I’ve really tried to take a lot of the jobs to be done and try to figure out, yeah, how do we scale it, but also how do we do it better?1526
04:22:33.260 –> 04:22:42.810
Carilu Dietrich: It’s funny because, you know the Gartner hype cycle curve, where you get so excited, and then you enter the trough of disillusionment, and then you come back up on the… I don’t know.1527
04:22:42.810 –> 04:23:07.759
Carilu Dietrich: hill of value, whatever it’s called. Like, one of the things I’ve heard is people got so excited about their agents, they went out and built all these agents, and they have all these agent team members, and then, the GM of AI for Microsoft and I were speaking at another CMO event last week, and she was saying, after they’d created so many agents, they ended up in this, like, agent overload spot, where, like, there were too many agents, and it was too confusing, and the agents were…1528
04:23:07.930 –> 04:23:23.840
Carilu Dietrich: you know, kind of overwhelming, and then they ended up kind of coming out of that trough of disillusionment back to value to kind of rationalize. So, it does feel like we’re in the, like, agent propagation phase right now, where we’ve created agents for everything, and then maybe it’s going to come back and rationalize.1529
04:23:23.840 –> 04:23:36.229
Carilu Dietrich: And one funny example, I know, Marcel, you guys have an agent that’s a fact-checking agent, which literally goes to fact-check all your agents who might be doing things wrong. You want to talk to us a little bit about developing that?1530
04:23:36.470 –> 04:23:42.839
Marcel Santilli: Yeah, like, I think one thing that is so important that a lot of people miss is starting with outcomes.1531
04:23:42.840 –> 04:24:06.770
Marcel Santilli: and working your way backwards. It doesn’t matter if it’s agent, deterministic AI workflows, or automation or not at all, it’s like, you need to figure out how to get to great. Like, going fast in the wrong direction is actually worse than going slightly slower in the right direction. So it’s like, agents doing the wrong things are off. And if you don’t have a way to evaluate what the agents are doing, the agents are not going to do well, because they don’t know how to even, like, self-criticize and self-correct1532
04:24:06.770 –> 04:24:30.979
Marcel Santilli: and follow, like, a bigger planning if you don’t have the right context. So in this example of the fact checker, we have this workflow that breaks down a piece of content into chunks, and then analyzes what parts of the chunk have different passages, and comes up with questions to go answer, and then does deep research in parallel with all those questions, and then comes up with a confidence score, or whether or not those statements are true, or if there’s any misplacement or inaccuracy1533
04:24:30.980 –> 04:24:54.569
Marcel Santilli: or better ways to do it, and then it fetches the writing guideline, and then auto-corrects anything that has a strong confidence that it’s not factual or that it’s misleading in some ways, right? But that’s only one step of the job to be done, and it’s all based on the definition of quality. So we have a customer in the healthcare space, there’s a lot of medical aspects to it, you know? A company like Sentinel-1, or Abnormal Security, or Augment Code, they’re more technical.1534
04:24:54.570 –> 04:25:06.170
Marcel Santilli: There’s other aspects to it, and so it’s not about having one agent that then abstracts the whole thing away, it’s figuring out what are all the steps, that… to get to great outcomes and outputs.1535
04:25:06.170 –> 04:25:23.469
Marcel Santilli: And then figuring out where you have enough confidence by having experts in the loop that then you can delegate to an agent, because then you know how to evaluate. And so I think that kind of just shifts where humans are going from not just the output bar raisers and process architects, but also getting the right inputs.1536
04:25:24.700 –> 04:25:38.799
Carilu Dietrich: And Omer, we were talking, before, kind of, like, leading on from that, that there’s also this transition period. You know, agents aren’t the only ones coming to our websites right now. Humans are still coming to our websites, too. In fact,1537
04:25:38.860 –> 04:25:48.699
Carilu Dietrich: from a website traffic… well, sorry, I guess that stat doesn’t apply as well. But, how are you thinking about this parallelizing,1538
04:25:48.870 –> 04:26:01.809
Carilu Dietrich: experiences for humans and experiences for agents. Are we gonna end up with, like, hidden things on our websites, or parallel websites, or… or how do we navigate when the distribution channels are, multiple right now?1539
04:26:01.810 –> 04:26:10.009
Omer Gotlieb: Yeah, I think it’s a great question, and definitely we are in a transition phase. I’m sure that in the future it will be full agent-to-agent, because1540
04:26:10.010 –> 04:26:32.839
Omer Gotlieb: why not? It’s gonna be very, very smart and easy to do, but I don’t think the technology is there right now. I do see even now, you know, we offer our customers a way to actually have a shadow website, so one website is fully designed, optimized for human being accessing you, and the other one is, you know, when ALM is accessing you, and not always it’s the same thing. ALM is asking a couple…1541
04:26:32.890 –> 04:26:45.410
Omer Gotlieb: In a human being, you know what they’re asking, you understand what a human being, LLM, you don’t know a lot of things, but you need to present other things. The way they actually consume the data is different. Now, again, in the future, it’s going to be an agent, and…1542
04:26:45.970 –> 04:27:00.389
Omer Gotlieb: whether there will be a website or not, nobody knows, right? If, you know, if I have an agent and you have an agent as a company, then why do we need a website? Again, a website will be used for another use as well. So, I do think that…1543
04:27:00.600 –> 04:27:12.589
Omer Gotlieb: It needs to be a differentiation between how do we provide information, communication, conversation, whatever we want to call it, to a human being, versus how do we want to provide that1544
04:27:12.720 –> 04:27:27.780
Omer Gotlieb: communication and conversation to a technology, an agent. I think both of them needs to be different than what we have today. Again, you know what? I spoke with many marketers recently, and my best advice, which is so nice, but it’s actually working, is1545
04:27:28.240 –> 04:27:36.659
Omer Gotlieb: really designed for the buyer. Designed for the customer. If we understand that the experience needs to be in favor of the customer.1546
04:27:36.800 –> 04:27:45.550
Omer Gotlieb: then we’re gonna win, and we’ve done, you know, even me in my previous company, you know, designing websites with forms, that’s not good for the buyer, it’s good for me, right?1547
04:27:45.650 –> 04:27:59.739
Omer Gotlieb: putting a threshold that you have to speak with a salesperson, a junior salesperson, in order to get to the right salesperson, and then only he will call the SE if you are qualified. That’s not good for the buyer, and the reason we’ve done it is because that was the only way. And I think…1548
04:28:00.150 –> 04:28:05.130
Omer Gotlieb: The amazing opportunity in AI is really bringing all that kind of1549
04:28:05.530 –> 04:28:10.350
Omer Gotlieb: Amazing service, amazing intelligent, amazing experience, up front.1550
04:28:11.270 –> 04:28:21.420
Omer Gotlieb: And if you think about it, that’s the way I think you need to design your website, your content, your email, anytime you… anytime you interact with a buyer, you can actually enhance those things.1551
04:28:21.830 –> 04:28:26.509
Omer Gotlieb: And it’s interesting you just say that, because I do think it’s changing the…1552
04:28:26.530 –> 04:28:34.780
Carilu Dietrich: way we think about our org design. So, for instance, you know, there’s these automated, SDR… SDR1553
04:28:34.780 –> 04:28:59.320
Carilu Dietrich: buyers, or, you know, superhuman SDRs that can talk to you at any time. But they’re really focused on qualifying someone, or the SDR experience. They’re, like, replacing a role we had, which was an SDR. And there’s this one company called OneMind, which is… Kevin is trying them out, and I’ve been really intrigued by, because it started out as an AI SE, a sales engineer, which was able to help assist in selling, which1554
04:28:59.320 –> 04:29:23.540
Carilu Dietrich: has always been a really, like, tight, role, because it’s such a specialized role, and they’re so in demand, and they’re kind of expensive, but this SE could talk to you at any time of day and have all the information. But what, OneMind found out was that this SE did a great job of talking to customers, because it had all the information, and it actually does a great job of qualifying, whereas some of the qualifying tools qualify, but if they run into a customer.1555
04:29:23.540 –> 04:29:27.460
Carilu Dietrich: The customer has to bounce out and go back into, like, a customer support chat1556
04:29:27.580 –> 04:29:45.250
Carilu Dietrich: funnel. And, you know, when you can have this agent that has infinite knowledge, you know, kind of like the download to Keanu Reeves in The Matrix, you can have one agent that talks to anyone and, like, routes them to the right place and gets them the right information, which kind of totally changes the…1557
04:29:45.250 –> 04:29:55.169
Carilu Dietrich: The mindset of, the way our teams were organized into, like, new processes is just, like, serve the customer and give them all the information they need without the gates.1558
04:29:55.170 –> 04:30:18.639
Carilu Dietrich: But I think what’s terrifying about that from a marketing perspective is, like, how do we track that? Like, how do we know what our revenue is gonna be, upstream? Because it’s like, people are gonna come in, like, 95% qualified, and you’re gonna be able to see a script, maybe, of the superhuman, but then, like, the final closing is gonna be so small, that you don’t know what’s working until you don’t have the revenue.1559
04:30:18.640 –> 04:30:21.250
Carilu Dietrich: Kevin, you came off mute. Do you have a commentary on this?1560
04:30:21.250 –> 04:30:21.779
Carilu Dietrich: My ramp?1561
04:30:21.780 –> 04:30:31.399
Kevin Marasco: Yeah, I got the, you know, it’s a group of marketers, so there’s an answer, and of course, it’s an acronym. It’s AQL, an Agent Qualified Lead. You know, it’s just…1562
04:30:31.400 –> 04:30:31.930
Omer Gotlieb: Oh, buddy.1563
04:30:31.930 –> 04:30:41.749
Kevin Marasco: Or a BQL, a bot-qualified lead, yeah. But what does that mean, and how does a AQL compare to a traditional, you know, MQL.1564
04:30:41.750 –> 04:30:42.310
Omer Gotlieb: Yeah.1565
04:30:42.310 –> 04:30:42.930
Kevin Marasco: And SQL.1566
04:30:42.930 –> 04:30:59.240
Omer Gotlieb: I would even argue, do we need to qualify? The reason we had to qualify is because only qualified customers, the buyers, get the best service. What if we can provide everybody the best service? Again, the challenge would be completely agreeing with forecasting, because1567
04:30:59.240 –> 04:31:04.409
Omer Gotlieb: Qualifying… Qualification is also good for forecasting, but if you put forecasting aside.1568
04:31:04.410 –> 04:31:10.230
Omer Gotlieb: Maybe? Again, haven’t thought about it before this conversation, maybe the notion of the qualified lead doesn’t really matter.1569
04:31:10.570 –> 04:31:17.609
Omer Gotlieb: I mean, what does matter is, okay, do we have a good conversation with the customer? Can we provide value for them?1570
04:31:17.890 –> 04:31:20.009
Omer Gotlieb: And can we actually move them further?1571
04:31:20.580 –> 04:31:29.879
Omer Gotlieb: Again, I do agree that things will change how we measure things, how we focus things, and I have no way, no idea to focus how they’re going to look like, but they will be different.1572
04:31:30.110 –> 04:31:33.360
Carilu Dietrich: Tuba, did you come off mute? It looked like you had something to say.1573
04:31:33.360 –> 04:31:56.680
Tooba Durraze: Yeah, I… I think… I agree with Umar. I feel like it’s a computation problem, like, we can’t really compute across everything, we don’t have enough capacity for that, so we, like, create these funnels. But you’re right, I think our qualification criteria would either not exist or be super, super open if we get into a world where it’s just agent-to-agent selling. Like, there shouldn’t be this idea of, like, what is the difference between a bulk qualified lead and a human-qualified lead?1574
04:31:56.680 –> 04:32:02.180
Tooba Durraze: We would do that, obviously, because incentive structures, when you get paid out on leads, have to be aligned in that way.1575
04:32:02.180 –> 04:32:09.320
Tooba Durraze: But I think, I think in the future, yeah, some of this qualification criteria will, like, fall off. I totally agree with that.1576
04:32:11.260 –> 04:32:36.200
Carilu Dietrich: It’s so crazy to imagine everything we know being totally different. It’s like, how the body regenerates all of its cells in so much time. It feels like the marketing tech stack is changing, the marketing processes are changing, the way buyers buy is changing, the way we evaluate things are changing, you know, potentially the evaluation, topics that we use. Like, in this world of agent-to-agent, it seems like trust and safety and government1577
04:32:36.200 –> 04:32:38.480
Carilu Dietrich: governance are gonna be really important. Like.1578
04:32:38.480 –> 04:32:50.159
Carilu Dietrich: you know, in B2C, you might let an agent buy something because it’s a small amount, and maybe just on a credit card where you could cancel it or something. Are any of you guys kind of thinking forward to this, like.1579
04:32:50.160 –> 04:32:53.640
Carilu Dietrich: Trust, governance, space.1580
04:32:54.510 –> 04:32:54.900
Marcel Santilli: reality.1581
04:32:54.900 –> 04:33:05.610
Lisa Sharapata: Carol Lou, I have a question to flip back on you, and it kind of pertains to what you’ve been thinking about, too, at Metadata, but… so you’re, fractional for lovable.1582
04:33:05.610 –> 04:33:16.020
Lisa Sharapata: Lovable has basically done what Omar and Kevin were talking about, like, bringing everything to the surface, right? The product is there, it’s very product-led, you can1583
04:33:16.020 –> 04:33:29.899
Lisa Sharapata: play around with it, there’s no gates, but it’s like, you know, you have to unlock, I guess, certain levels to get deeper into it, be able to use it to deploy a site or push something live, like, you have to have enough credits.1584
04:33:30.020 –> 04:33:32.759
Lisa Sharapata: And you have to have trust1585
04:33:32.759 –> 04:33:55.719
Lisa Sharapata: to do that, right? And, like, that’s one of the things I’ve been playing with, like, free trials, for example, but someone’s gonna have to share their LinkedIn information, or share their account for their Gmail, or whatever it is, in order to, like, let the agent go. So, I’m curious, like, your thoughts on that, given that you’re really leading in that area.1586
04:33:56.830 –> 04:34:16.249
Carilu Dietrich: Yeah, I mean, I think trust becomes paramount and potentially a differentiation between different companies, and we’ve certainly seen that with Anthropic’s market positioning coming out of Cloud… I mean, sorry, coming out of OpenAI to create this kind of ethical, alternative and different features that reinforce trust.1587
04:34:16.250 –> 04:34:24.949
Carilu Dietrich: So… And Levable’s done different things, like we had rolled out an agent feature, earlier this year.1588
04:34:24.950 –> 04:34:49.939
Carilu Dietrich: that helps, reduce errors by 90% by kind of checking over the code and checking over your requests to make the agent work better. So again, kind of a check bot. And then also a security agent that, like, reviews everything and makes recommendations about how to make your apps more secure. And for people that don’t know, I’m sorry, Levable is a vibe coding platform, one of the leaders, where you can take an idea to an application, just by chatting with AI.1589
04:34:50.180 –> 04:35:10.869
Carilu Dietrich: And it creates these really gorgeous visual sites that then can be full-stack apps and be deployed, and people are starting businesses, or prototyping, or creating entire products for companies. So yeah, I mean, I think trust and reliability is kind of a centerpiece of AI agent offerings, and we’ll continue to differentiate1590
04:35:10.869 –> 04:35:13.709
Carilu Dietrich: And always the challenge with that is that1591
04:35:13.710 –> 04:35:25.790
Carilu Dietrich: you know, it takes a long time to build up trust and not a lot of time to lose it if you do something wrong. And so I think that’s why we see so many different security companies and AI security companies1592
04:35:25.790 –> 04:35:36.140
Carilu Dietrich: really having astronomical momentum, because AI creates so many new vectors for attack and surface areas, that really need to be protected.1593
04:35:37.950 –> 04:35:42.330
Omer Gotlieb: I think trust is a very serious temporary problem.1594
04:35:42.570 –> 04:35:50.080
Omer Gotlieb: And the reason I’m saying temporary is we all remember, you know, can I trust, to put my data in the cloud, right? Financial data in the cloud!1595
04:35:50.340 –> 04:35:59.830
Omer Gotlieb: it’s a non-issue anymore, and this will be a non-issue. It might take longer or sooner, I don’t know. But right now, I think there’s two types of trust issues. One.1596
04:35:59.980 –> 04:36:18.260
Omer Gotlieb: as business executives, do we trust the agents that we actually, you know, build or buy in order to do a good job for us, or put in front of the customers? And even Marcel had a good example. They did not trust their internal agents, they built another agent to actually make sure that they can trust it, which makes complete sense.1597
04:36:18.290 –> 04:36:35.419
Omer Gotlieb: But I also think there’s some trust issue from your customers. I mean, can I trust this AI that I’m actually speaking with? I think that’s also a done deal. I mean, I don’t know about you, but personally, if I had the choice between getting my information from1598
04:36:35.450 –> 04:36:42.130
Omer Gotlieb: a salesperson, and usually these are junior salespeople at the beginning of the process, versus an AI,1599
04:36:42.419 –> 04:37:00.399
Omer Gotlieb: my first bet was gonna be on the AI. Now, I know I’m an early adopter, but I think more and more people are going to be educated by big companies that, yeah, AI can actually provide, you know, a better solution, a good solution. So I think the trust right now is mainly business owners, can I trust1600
04:37:00.470 –> 04:37:06.060
Omer Gotlieb: the AI to do a good job for me, but it will… it is a temporary problem.1601
04:37:06.060 –> 04:37:24.759
Tooba Durraze: I feel like it’s inherently a human psyche problem. Humans have a hard time giving up control, so the guides that under trust, quote-unquote. I do think it’s going to be a little longer than it used to be, because you’re not talking about systems that are non-deterministic, right? And every… all of these systems have drift. How many times do we wake up, like.1602
04:37:24.900 –> 04:37:33.150
Tooba Durraze: you know, one day, and we’re like, okay, well, the output suddenly changed. So you’re gonna have to design these systems around trust, and I’m…1603
04:37:33.150 –> 04:37:48.840
Tooba Durraze: I’ll be curious to see where the onus lies. Does it lie on entirely the customer side? Does it lie entirely the builder’s side, on how you reveal, like, certain things within your product and how things are functioning, how agents are functioning, so people can trust that something good is happening behind the scenes?1604
04:37:48.840 –> 04:37:59.330
Tooba Durraze: But I feel like this is going to be a little bit longer than my financial data in the cloud, just because people don’t like the notion of, like, not knowing how exactly something would map out.1605
04:37:59.490 –> 04:38:03.180
Omer Gotlieb: Well, financial data in the cloud took a few years, so I think, yeah.1606
04:38:03.189 –> 04:38:08.449
Tooba Durraze: I think this is, like, 5 to 10 is my, in my head, but yeah.1607
04:38:08.680 –> 04:38:32.270
Carilu Dietrich: I think one of the things on the trust side is there’s the two sides. They’re like, is the brand trustworthy, right? Like, can our apps be… can Lovable’s apps be secure, and thoughtful, and scalable, all of those things. And then there’s the trust on the consumer side, and one of the things that I’ve been surprised by is how authoritative LLMs are in telling you an answer, especially in product comparisons.1608
04:38:32.290 –> 04:38:46.599
Carilu Dietrich: Like, they’ll tell you who’s the leader, and then you, like, click on the little link and look at it, and you’re like, oh, this is a secondary site that the vendor put up that compares themselves, which creates, like, slightly less,1609
04:38:46.599 –> 04:38:56.929
Carilu Dietrich: research support than we might have had when we were looking through Google link responses and SEO, and we kind of did our own self-filtering to look at the validity of different websites.1610
04:38:56.930 –> 04:39:00.959
Carilu Dietrich: Marcel, this is kind of your world, because…1611
04:39:00.960 –> 04:39:19.919
Carilu Dietrich: the way all the content you’re generating that shows up in LLMs, from our marketing perspective, we want it to, like, win the LLM and be authoritative. And then also, from the consumer side, we want to be thoughtful about how we’re evaluating brands. Like, how are you building trust into the content?1612
04:39:19.919 –> 04:39:26.569
Carilu Dietrich: In a way that, even when people kind of click through to really evaluate, they’re still trusting what you’re doing.1613
04:39:27.009 –> 04:39:39.539
Marcel Santilli: I think this is, like, at the core of what we do, but also at the core of what everyone has, as marketers, have to figure out. And so, like, I’ll give a few examples. One of our customers, they’re in the women’s supplement space.1614
04:39:39.539 –> 04:39:55.399
Marcel Santilli: started by, a well-known founder, and, they have a chief medical officer who has a background in endocrinology and a holistic doctor, right? So we had to set the right context, we had the fact-checkers, you had the… all these steps, but then, we…1615
04:39:55.399 –> 04:40:19.509
Marcel Santilli: gave her a piece of content for calibration, this chief medical officer, and she left 30 comments in the document, right? And they were all nuanced medical things. So then we had to reverse engineer those comments to understand, like, what was about this? It was like an oversimplification of the, you know, how this ingredient plays into your hormones, or something like that, right? And so a lot of the trust and quality is not achieved from zero to one.1616
04:40:19.509 –> 04:40:37.219
Marcel Santilli: you know, when I was at Scale.ai, we’re doing a lot of work for the Waymos of the world. You don’t go from, like, level one autonomy to self-driving Waymo in one system, in one shot, right? And it’s all about calibrating and setting the right context, and then you have to ground that information on something. Like, when we were developing all these integration pages.1617
04:40:37.219 –> 04:41:02.079
Marcel Santilli: for Webflow, and you go to the Stripe integration page there. Like, that has to be grounded on their docs. It has to be grounded on something in order to know if it’s factual or not, and that’s how you build trust. But if you don’t have confidence in your grounding and what your source of truth is, then you can’t actually go after it. And then the other piece that I would say as a practical piece of advice for everyone is, like, use multiple systems. So, for instance, like, when we’re doing a deep research.1618
04:41:02.079 –> 04:41:26.949
Marcel Santilli: using EXA AI or Tavly to do the deep research. We might use perplexity’s deep research as a fact checker, or vice versa. And that way, you’re using multiple layers, but also don’t try to abstract experts in the loop too early before you gain that confidence, you know? And so the way we look at it and measure it is how many human interventions are needed in order to get something out, like a piece of content, or a page, or something that’s published.1619
04:41:26.999 –> 04:41:36.549
Marcel Santilli: And if it goes from 30 comments to 1 to 0, then you can start to build confidence in those systems. And you need to do that internally first, as well, yeah. -
1620
04:41:38.080 –> 04:41:52.269
Carilu Dietrich: agents talking to agents, checking agents, agents as the distribution channel. What have you guys seen, as being some of the most impactful, like, practical examples? I think, like, we risk being really abstract.1621
04:41:52.270 –> 04:42:00.600
Carilu Dietrich: In our conversation, but practical impacts that you’ve seen so far of agents in your companies or in your marketing?1622
04:42:01.010 –> 04:42:19.090
Tooba Durraze: Can I give a funny example, because I’m not a marketer by background? When I first started this company, I was trying to do my best, as much as I could do, with some, like, LinkedIn marketing, and then I was like, I don’t feel like I’m doing great, but I feel like I’m doing okay. Took all that data, tossed it at Amoeba, at Nurismolic, and1623
04:42:19.240 –> 04:42:38.650
Tooba Durraze: it gave me a lot of really good feedback on how, like, I was basically creating a lot of boredom for my, like, end users, and the way I was talking about things repetitively, it’s not the right kind of fit for the target buyer that I was trying to sell it to. All things that are very obvious to marketers, but maybe not as obvious to folks who are outside of that.1624
04:42:38.650 –> 04:42:56.369
Tooba Durraze: And then we kind of evolved that into, like, can you run an audit on my LinkedIn, as an example, like, ever so often? And we’ve seen a big difference in sort of, like, how that’s materialized in, like, pipeline for our company. So I think that’s an example of, for us, like, a lot of times folks will say, like, I don’t have1625
04:42:56.370 –> 04:43:10.110
Tooba Durraze: maybe sometimes enough data to get started with agents, etc. That’s an example of, like, even with a little bit of data, if you get started, the agents will, like, kind of… can help you guide your system in a way that you build better proficiency or competency.1626
04:43:10.300 –> 04:43:12.079
Carilu Dietrich: I love that.1627
04:43:12.690 –> 04:43:13.810
Carilu Dietrich: Other examples?1628
04:43:13.810 –> 04:43:36.110
Marcel Santilli: other one is when we started hiring and accelerating hiring for GrowthX, like, we started getting almost 1,000 applicants a day on some roles, and so there’s just no way to tackle it. And so one of the ways we did it was to kind of decompose the process and recompose it back up, and so we just built a workflow that kind of goes through and gets people to apply and write their answers and some of the questions.1629
04:43:36.110 –> 04:43:37.610
Marcel Santilli: And then if they pass that.1630
04:43:37.610 –> 04:44:01.860
Marcel Santilli: a process, there’s a recruiter in the loop that looks through the best 20% of candidates, passes them through to a video interview, and within that video interview, then we transcribe and do the same process, then they go through an assessment. And even though that process might sound like a bad experience for the candidates, we actually got a lot of feedbacks, because it’s like, we’re asking them for 30 minutes of their time, but in exchange for that, even though they don’t talk to a human right away.1631
04:44:01.860 –> 04:44:10.650
Marcel Santilli: By the time they do get to talk to us, they’re already in the final steps, and so we can go from application to offer in, like, days instead.1632
04:44:11.190 –> 04:44:19.539
Marcel Santilli: And so, like, that was just, like, a way to be able… that would have just been impossible to do without actually AI and workflows and agents as well.1633
04:44:20.630 –> 04:44:32.019
Kevin Marasco: One of my favorites right now is, using agents to two-fold on the sales side for coaching, and then on the marketing side, the market intelligence that comes out of that, and I used to1634
04:44:32.080 –> 04:44:51.060
Kevin Marasco: you know, 5 years ago, binge, gong calls on 2X to just… to understand what buyers cared about and all that, and now what we’ve done is trained, agents on our sales competencies, what matters for, you know, what our best performing reps look like, what, our, the SPICE methodology that we use.1635
04:44:51.060 –> 04:45:02.390
Kevin Marasco: And, then taking every single call, you know, 100% of them, and they’re running through the agents, and they’re analyzing and breaking them down and scoring them on spiced efficacy, or Scoville level.1636
04:45:02.390 –> 04:45:10.080
Kevin Marasco: And then taking the data, automatically filling the CRM for the sales rep, so it saves them time, providing coaching feedback to the rep and the manager, and then1637
04:45:10.080 –> 04:45:35.049
Kevin Marasco: what I love is getting, like, these market insight briefs that summarize data from all those calls to understand trends in the market and what’s happening and what’s not. Hey, we’re seeing more of these buyer specialty in our world, you know, and here’s some of the emerging pain points, competitive and product insights, and things like that. I didn’t… there’s no way I could have scaled and done that in the past, but having agents do that without fail for 100% of calls is pretty… is pretty1638
04:45:35.050 –> 04:45:35.870
Kevin Marasco: pretty valuable.1639
04:45:36.640 –> 04:45:38.110
Carilu Dietrich: Yeah, that’s a huge impact.1640
04:45:38.410 –> 04:45:40.169
Omer Gotlieb: I’m actually, you know.1641
04:45:40.340 –> 04:45:50.709
Omer Gotlieb: completely different than my previous company, I’m always thinking how not to hire the next person. Literally, how not to hire the next person. I think in go-to-market, there are many…1642
04:45:50.840 –> 04:46:05.530
Omer Gotlieb: tools and technologies that you can actually use in order to, you know, do a lot of things that are doing great. And, you know, we’ve developed an internal signal-based system. We identify signals from all places, whether LinkedIn or website or, you know, you know the drill.1643
04:46:05.530 –> 04:46:12.009
Omer Gotlieb: and eventually come up to a central intelligence system that tells us what to do. Some of the actions are being taken1644
04:46:12.010 –> 04:46:30.700
Omer Gotlieb: automatically. I’m very careful with that, because eventually, it’s my brand, it’s the company brand, but at least, hey, homie, you need to pay attention to this. Hey, this person just posted, there’s a great article that you actually need to take a look at. Here’s the data that we found out from everything. So, I would say it’s a combination of a set of mini-agents. Some of them1645
04:46:30.700 –> 04:46:35.110
Omer Gotlieb: Our inside of products, some of them things that we’ve designed internally.1646
04:46:35.110 –> 04:46:36.780
Omer Gotlieb: But literally help us1647
04:46:36.880 –> 04:46:42.009
Omer Gotlieb: do a lot of things and go to market that, initially, I would probably need to hire a lot of people to do that.1648
04:46:43.870 –> 04:46:59.689
Lisa Sharapata: Yeah, I just wanted to add on to what Kevin was saying. I think… I don’t know if it’s called agency, we had something like that called agency. So it’s sitting over the top of the calls, and it’s analyzing all the information, giving the insights to the sellers.1649
04:46:59.730 –> 04:47:15.419
Lisa Sharapata: like you described, Kevin, but then I’m actually taking that on the marketing side. I’m pulling that into Manus, which I’ve found just to be better at analyzing that kind of information, and then I’ve given it,1650
04:47:15.510 –> 04:47:21.960
Lisa Sharapata: a brand kit and criteria, tone of voice, everything to help turn that into LinkedIn posts.1651
04:47:22.010 –> 04:47:35.709
Lisa Sharapata: So, what are the sentiments we’re hearing? What are some themes that are coming up? And then I can actually have, basically, set up the agents from Manus to schedule posts for me.1652
04:47:35.870 –> 04:47:55.150
Lisa Sharapata: So, it’s… it’s really powerful, and to your point, like, I used to listen to those calls, and oh my gosh, I go down into this pit of despair, I’m like, I can’t listen to any… you know, but now it’s just like, I get these insights, it’s very helpful, and I can get that spun up really quickly into actionable, usable information.1653
04:47:55.930 –> 04:48:00.089
Kevin Marasco: Yeah, I love that, Lisa. We’re using a tool called Momentum, it’s great, but I love, like.1654
04:48:00.340 –> 04:48:04.969
Kevin Marasco: you know, being able to get those insights, but then how do we take that full circle? So now we’re able to compress1655
04:48:04.970 –> 04:48:25.420
Kevin Marasco: our innovation cycles, right, and how we’re able to take that into action on the go-to-market side, and I love your… how you’re immediately topping that up into, content that obviously buyers care about. So I think that’s, that’s… that’s… that’s really neat. There’s so much we could do with that, you know, it closes the loop in a way we weren’t able to do before, or it’d take a lot of… lot of time.1656
04:48:26.570 –> 04:48:44.359
Carilu Dietrich: And I’m gonna share a slide here. I have a blog at carilou.com called Hypergrowth Leadership, and this was a state of AI and B2B marketing scorecard, which was showing some of the processes that I saw CMOs attacking most, and so we’ve talked about a lot of those today. Content creation.1657
04:48:44.360 –> 04:48:55.030
Carilu Dietrich: SEO and answer engine optimization, like, certainly this, SDR and BDR, like, these are some of the places where we’ve seen, like, it, it easiest to address some of the challenges.1658
04:48:55.030 –> 04:49:18.040
Carilu Dietrich: And then… and then some of the others coming farther down the list, the email marketing, the analytics, the ad campaigns, which Lisa was talking about, really, in the experimentation phase, moving into the operational phase. And so, I think, you know, last year was really an experimental year for marketers. This year’s really an operational year for marketers, and even as we’re changing from kind of, like.1659
04:49:18.150 –> 04:49:42.069
Carilu Dietrich: more simple AI processes to full agents, it seems like, you know, there’s still this prioritization of where it makes the biggest impact, where we can see the biggest ROI immediately, and this has been a helpful chart for some folks. I’m actually in the middle of doing some research to get this more statistically significant, so I’m gonna put in the…1660
04:49:42.070 –> 04:49:54.559
Carilu Dietrich: a link in the chat here, oops, but I don’t have the link right this second, I will grab it. A link in the chat for the survey that I’m doing to try to determine,1661
04:49:54.690 –> 04:50:00.079
Carilu Dietrich: like, you know, where are we now, and how are agents affecting this? So, I will put that in in one second.1662
04:50:00.350 –> 04:50:14.059
Carilu Dietrich: How about, kind of, closing comments? Like, predictions for the future? Are you, bullish that B2B buyers will be buying, in agents shortly, or do you think,1663
04:50:14.640 –> 04:50:16.280
Carilu Dietrich: That’s still a couple years out.1664
04:50:17.570 –> 04:50:34.969
Omer Gotlieb: I’ll start… I don’t think that people are going to allow an agent to buy for them, or make the decision for them right now, but they’re definitely starting to see, you know, people are using some kind of, you know, buying agents to take them 90% to the journey. So eventually, you know.1665
04:50:35.910 –> 04:50:46.200
Omer Gotlieb: imagine you’re an executive and you need to decide on a technology. Basically, what you do is you go to your director, and you say, run a project, analyze everything, come back with your recommendation, and…1666
04:50:46.400 –> 04:50:49.370
Omer Gotlieb: Let me know who are the top companies that I need to be speaking with.1667
04:50:49.500 –> 04:51:08.499
Omer Gotlieb: That’s a clear job for an AI agent to actually do those things for you. So I definitely see the future, which, again, the future could be right now, it doesn’t have to be the long-term future, but people are going to rely on their journey and their decision based on AI agents, and I think we as marketers, we have to design1668
04:51:08.510 –> 04:51:13.400
Omer Gotlieb: for those guys. But I don’t think people will… Let AI buy for them.1669
04:51:16.760 –> 04:51:35.290
Carilu Dietrich: other predictions for the future, Kevin, you know, your, buying audience is kind of, like, SMB, and so they’re, like, getting pretty deeply engaged in their off time, trying to solve their problems very quickly. It seems like some of your agent responsiveness is, like, creating more velocity in your sales cycle.1670
04:51:35.290 –> 04:51:37.180
Carilu Dietrich: Like, what’s the next level?1671
04:51:38.480 –> 04:51:40.209
Kevin Marasco: I think, like.1672
04:51:40.360 –> 04:51:58.900
Kevin Marasco: I guess my bold prediction… first of all, this is, like, changing everything, right? Like, as us leading go-to- every aspect of marketing and sales, you know, content marketing’s gone. Now it’s, like, model priming. And so, like, all those things change. I think, stepping back more broadly, I guess my bold, prediction is that1673
04:51:59.030 –> 04:52:11.989
Kevin Marasco: you know, we shift from this, like, world, you know, era of automation and programmatic marketing and predictive AI to generative go-to-market. And how do we think about1674
04:52:12.030 –> 04:52:30.630
Kevin Marasco: generative agents and systems that are automating and improving all aspects of the go-to-market, starting to break down silos and close loops, and it might even make some of these legacy conversations, things like attribution and stuff, maybe some of those things go out the window and blow up.1675
04:52:30.710 –> 04:52:36.309
Kevin Marasco: So I think, like, I guess that’d be my bold prediction, is this, like, new world of generative, go-to-market.1676
04:52:36.500 –> 04:52:41.000
Carilu Dietrich: What’s the difference between generative go-to-market and automated, AI automated?1677
04:52:41.310 –> 04:53:01.030
Kevin Marasco: I think of, like, automated is, is, is like the, like, like a calculator, right? And you have to be very, like, okay, 2 plus 2 equals 4, 2 plus 2 equals 4, like, that was, like, the marketing automation system, send this email, then this email, then fill out this form, and not, like, deterministic, and so now we’ve gone from the calculator to we have an analyst.1678
04:53:01.030 –> 04:53:08.429
Kevin Marasco: that can make decisions and do things, and you can say, hey, I want this outcome. I don’t want… just… don’t go get me, you know.1679
04:53:08.430 –> 04:53:26.950
Kevin Marasco: get this form fill, go find me one of the best buyers, go find me 10 more of those, build the sequences, the personalized landing pages, and, you know, take it full circle. And so it’s like building a more comprehensive system that all works together, versus just one, like, discrete set of tasks.1680
04:53:27.190 –> 04:53:30.309
Carilu Dietrich: Like, more predictive and responsive, yeah.1681
04:53:30.950 –> 04:53:32.510
Carilu Dietrich: Anyone else? Lisa?1682
04:53:34.280 –> 04:53:36.190
Tooba Durraze: I would say, can I… can I jump in really quickly?1683
04:53:36.190 –> 04:53:36.680
Carilu Dietrich: Go ahead, too.1684
04:53:36.680 –> 04:53:49.439
Tooba Durraze: and predictive. I think we’re going to move from predictive into more prescriptive, so not so much reliance on a ton of historical data. Instead, the systems that tell you something is going to go wrong before it goes wrong.1685
04:53:49.440 –> 04:53:56.710
Tooba Durraze: And I think that, in turn, is going to build enough trust that people just, like, let agents loose. I know we feel like we’re further away from that, but I think1686
04:53:56.730 –> 04:54:06.120
Tooba Durraze: if I was, like, a marketer, a CEO of a company, I would pay close attention to the fact that you can’t… you won’t be able to afford to be left behind in this sort of stuff.1687
04:54:06.140 –> 04:54:19.230
Tooba Durraze: Right? So the more you kind of shy away from it, or the more guardrails you kind of throw around it within reason, I would say, you will hinder your own development in that sense. I think companies1688
04:54:19.270 –> 04:54:30.489
Tooba Durraze: will go from, like, everyone needs to be, like, AI-native or AI-powered, all of that, into really understanding what are the systems that are getting me the outcomes that I want, and, like, then applying those systems at scale.1689
04:54:32.500 –> 04:54:40.309
Carilu Dietrich: It’s pretty exciting. It’s a… it’s an exciting time to be alive. One more answer, and then let’s tell people how to find us, or follow up with us.1690
04:54:40.680 –> 04:54:41.600
Carilu Dietrich: Lisa, were you?1691
04:54:41.600 –> 04:55:00.800
Lisa Sharapata: I think that there’ll be a learning curve and a scale. So, for example, like, would I be okay letting an agent rent a car for me if I give it parameters on how much to spend on, you know, here’s the dates I need, this is the size car I want, I don’t want to go over this price. Yeah. But would I want to buy B2B tech?1692
04:55:01.270 –> 04:55:20.800
Lisa Sharapata: use, you know, with an agent today? No. So, I think that there’s gonna have to be kind of this curve and cycle that’s gonna take time for… and marketing, even in B2B, to figure out how do you serve up an experience that would make it, like, safe to go agent to agent. So, yeah.1693
04:55:22.230 –> 04:55:46.059
Carilu Dietrich: Well, it’s been such a pleasure talking to you guys. I was nervous about this topic because I didn’t know even what agents were as the distribution channel before I started researching it, and then realized I’m deep in agents, both on the interface and operator side, but now I know that they’re the channel as well. So, thank you for making it so practical and approachable, and let’s just go through, or maybe we can share in our1694
04:55:46.060 –> 04:56:01.460
Carilu Dietrich: Oh, I see now there were some audience questions that we didn’t answer. Sorry for that. But maybe each of us can share in the chat how to get in touch with our companies and learn more about what we do, because I’m sure the audience1695
04:56:01.460 –> 04:56:08.599
Carilu Dietrich: would be interested in that for their favorite panelists. Let’s see, let me just look really quickly at this last question.1696
04:56:12.480 –> 04:56:31.059
Carilu Dietrich: I think the last question in the last 3 minutes, is around, how should marketers start using tools to track AI mentions and citations for queries, and how should they think about creating content, for AI? Marcel, this is, like, right in your crosshairs. Do you want to talk about that one a little bit?1697
04:56:31.260 –> 04:56:35.259
Marcel Santilli: what we do for customers quite a bit, and I would say, first of all.1698
04:56:35.540 –> 04:56:59.919
Marcel Santilli: gain a deeper understanding of your customers, and so what that means is, like, understanding, like, their jobs to be done, what questions they have, and then from there, you can map out all the things they care about, both informationally and commercial-related, and then you can start to figure out, are you showing up for those? Do you have the best answer to those questions? And then figure out a way to systematically become the best answer to those questions, and track along the way if that’s having an impact.1699
04:56:59.920 –> 04:57:21.820
Marcel Santilli: or not on those answers. And so, a lot of the things that matter to humans in becoming the best answer still apply to ranking well and showing up well in those answers. It’s just you have to do more, because the long tail is longer, and a lot of the questions that people might have during your sales process are now becoming, you know, upfront in their research as well.1700
04:57:23.410 –> 04:57:39.120
Carilu Dietrich: Well, agents being created by some of us on the phone, agents operationalizing our work, and agents talking to agents very quickly here in our future. I just want to thank all of you, and I don’t know if Julia’s here. Let’s see. Hi, Julia. Hi.1701
04:57:39.570 –> 04:57:46.250
Julia Nimchinski: Incredible session. Thank you so much, Carolyn. And, we have a question from the audience for you.1702
04:57:46.250 –> 04:57:47.030
Carilu Dietrich: Questions?1703
04:57:47.030 –> 04:57:57.050
Julia Nimchinski: Yep, people are asking about the CML tenure, and your thoughts on it shrinking, and what’s the implication with agents.1704
04:57:58.350 –> 04:58:10.260
Carilu Dietrich: It’s a really strange time in AI-native companies. You know, if you look at OpenAI, Cursor, and Anthropic, companies that have grown in AI astronomically quickly with1705
04:58:10.260 –> 04:58:27.810
Carilu Dietrich: It’s very small marketing teams, and without CMOs for part of that time, certainly in their early days, it seems like the role of CMOs is becoming even more hands-on and technical, and Kevin is one of the CMOs that I admire most, who’s, like, been really deep in building all these orchestrations.1706
04:58:27.810 –> 04:58:48.999
Carilu Dietrich: So, I think it’s a challenging time for CMOs as heads of growth and people within the org can do more and make a bigger impact, much faster, and it could lead to shorter tenures in some roles, but hopefully strategic CMOs that stay in front of it and, like, hire the right team, and set a vision, will continue to extend their tenures as well.1707
04:58:49.000 –> 04:58:51.829
Carilu Dietrich: Kevin, do you want to say anything else about that? Oh, yeah, go ahead, Martin.1708
04:58:51.830 –> 04:58:55.270
Marcel Santilli: One quick thing, just because we talk to so many CEOs.1709
04:58:55.270 –> 04:59:15.049
Marcel Santilli: And I would say the number one thing is, I talked to a CMO at Zapier and several others, they’re like, I can’t find a CMO that’s hands-on and can be a top-notch practitioner and be in the weeds as well. And so, if you’re a CMO and you’ve been disconnected from the work for years, go change that, because otherwise, I think you’re going to be out of a job. Sorry, to Kevin.1710
04:59:15.050 –> 04:59:30.199
Kevin Marasco: No, I agree, Marcel. I radically agree. I’ll tell myself the same thing I share with my team. I always tell them, hey, you don’t have to worry about AI taking your job, but you do have to worry about someone who knows AI taking your job. And I think that’s true for CMOs, and I talk to myself, and1711
04:59:30.200 –> 04:59:39.750
Kevin Marasco: what does that… I mean, I literally block off time for myself to go dark and just play and tinker, and that’s the only way. You gotta, like, roll up the sleeves and do stuff, and so I think…1712
04:59:39.750 –> 05:00:01.510
Kevin Marasco: I agree, like, we have to get more hands-on and get our hands dirty, and push our whole, not just our teams, but our entire organization, because it’s changing everything, you know, risk tolerance, and speed of execution and, you know, all that, because we’re talking about go-to-market and the shifts there, but it’s also changing all aspects of SaaS, and so I think we gotta be at the tip of the spear on that.1713
05:00:02.070 –> 05:00:16.429
Omer Gotlieb: I just want to share something final, you know, in my previous company, I went on stages and explained to everybody why I think the chief customer officer job is the most difficult one in the company. And I can tell you, after spending two years in marketing, especially where the market is right now.1714
05:00:16.540 –> 05:00:28.170
Omer Gotlieb: CMO job, man, that stuff, it is difficult, and you guys are right, you have to do all those things. The future is unclear, but I think that’s the opportunity. The future is exciting, and I think everybody that will1715
05:00:28.240 –> 05:00:39.150
Omer Gotlieb: align themselves into, let’s be innovative, let’s be hands-on, let’s evaluate, let’s experiment. That’s what gets me excited, and I think this is what will help CMOs in their future careers.1716
05:00:40.330 –> 05:00:46.919
Julia Nimchinski: Incredible session. Thank you so much, Caroline and everyone, and we are transitioning to our demos. Lisa?