Daniel248x248_3
Daniel Palay, Elastic
Daniel248x248_3
 | a conversation with... MaryAnn Rains Customer Advocacy Marketing Manager NAVEX |
|---|---|
| Could you describe your program? | NAVEX began a customer advocacy program in 2019 when the business scaled to the point where the team needed a proactive, rather than a reactive approach. Customer Advocacy and Events is on the Corporate Marketing team and is comprised of three members. We have key administrative stakeholders in Sales Operations, Business Systems, and our International Marketing team. One of the motivators to start a formal customer reference program was to support the bandwidth of our Sales Operations colleague who was pulling custom reports for sellers upon request. This wasn’t efficient or effective for any party involved. Sales Ops had to change their focus on a dime to prioritize requests, the seller didn’t know if the customer could say yes or would be available, and the customer wasn’t sure what they were saying “yes” to. We transitioned to ReferenceEdge in 2022 to help us run a more data-informed program that’s Salesforce-native to help with adoption. We had a phased approach for our implementation, first training our recruitment stakeholders (Customer Success, Product, Marketing), then onboarding our Sales team. |
| Who are your internal stakeholders? | We have a robust ecosystem of stakeholders to drive recruitment and adoption throughout the organization. We invested significant time building out relationships around the organization to ensure the program is aligned and mutually beneficial. Sales - Managers & Leaders: reinforcing process and seller accountability - Leadership & Development: training support - Account Executives: reference requesters and nominations from Farmers - Retention Account Managers: connectors to renewing customers - Sales Operations: supports the matching process for managed reference requests - Solution Engineers & Product Specialists: reinforcing the program in conversations with sellers and customer nominations Customer Success - Customer Support Managers: nominate and manage requests for their customers - Professional Services & Implementation: connectors to happy, knowledgeable customers Marketing - Product Marketing: alignment on product strategy - Marketing Analytics: support with dashboards Business Systems: support in configuring ReferenceEdge within Salesforce Product - Product Managers: nominating customers who are a part of Early Adopter Programs or advisory boards |
| What were your top 3 challenges before ReferenceEdge? | 1. User Adoption: We had a challenging time getting our requesters to utilize the processes and systems, opting to connect with one another directly to find references instead 2. Seeing Gaps: We didn’t have a good pulse on where we needed to run targeted campaigns to address gaps in our current customer references, making the program reactive to last-minute requests 3. Influenced Revenue: We couldn’t speak to the ROI on our program and efforts |
| Since launch, what has changed in terms of your company’s reference practices? | ReferenceEdge is very accessible for our stakeholders, given the seamless UX with Salesforce. We benefit from having our CSMs more involved in reviewing and approving reference requests, given their strong relationships with customers. We’re also able to see program activity through reports and dashboards to drive our team’s strategies and build momentum and competition among our users. We’re empowering team managers with curated dashboards so they can see who is using the system with a leaderboard and who isn’t. Thanks to the dashboards, we can also speak to our KPIs and influenced revenue more accurately, which is getting more visibility than we could have imagined prior to implementing. |
| Since launch, how has your job changed? | Since implementing ReferenceEdge, I’ve had the opportunity to focus my role more on strategy and training to support our Customer Reference Program and other sales supporting activities. Where I used to spend my time reactively responding to requests or pulling data from various sources, I can more easily provide that same level of support for requests while also freeing up time to think and work proactively to strengthen our program. In addition, peers and leaders across Sales and Customer Success see the program as more user-friendly and engrained into our existing processes. As a result, we are now seeing improved success in training and adoption compared to our previous solution, especially when nominating customers for the program. |
| What feedback have you gotten from stakeholders? Leadership? | A few of the testimonials we’ve received from stakeholders: Retention Manager: “ReferenceEdge allows RAMs to identify happy customers upon renewal, providing Sales with a trusted list of well-vetted references, while delivering world-class customer service. The Customer Reference Program shows how cross-department collaboration drives NAVEX’s success.” CSM: “ReferenceEdge makes it simple to nominate customers with just a few clicks of a button. CSMs can quickly review and approve a reference request from Sales, and I love that we can track how often they’ve been contacted or when they were last utilized. This is a great value add for our collaborative efforts!” Executive Sponsor, Sales: "As executive sponsor for the Customer Reference Program, I see the ReferenceEdge tool as a strategic advantage for selling at NAVEX. There's an immeasurable value behind prospects hearing from their peers that NAVEX is the real deal, in addition to hearing it from us. Using this system in a timely way and sharing nominations to continually fill the reference pipeline that supports all of our deals enables us to remain customer-centric." We recently gave our first presentation on ReferenceEdge to our executive team and they were impressed with the customer-centric approach and dashboards. |
| What aspects of ReferenceEdge do you value the most? | To date, we have dedicated a lot of our time and training to educating our sellers on how they can help fuel our Customer Reference Program through nominations. By utilizing the nomination feature and automated notifications that encourage sellers to consider nominating customers after an opportunity has closed, we’ve seen a drastic increase in the number of nominations received and the quality of nominations. We have not yet run campaigns for nominations, but intend to in the future. By using the Peer-to-Peer capability to enable CSMs to review reference requests, we have not only freed up bandwidth of our Reference Managers but have also strengthened the bridge between our CSMs and AEs. By bringing CSMs into the reference request review, we’re able to more accurately judge and review reference requests by using their deep insight into the customer’s experience. This improvement has been very well received across our leadership as well. |
| How do you measure program success? | Our formal KPIs are based on influenced revenue and the number of approved nominations. Informally, we’re looking at overall program activity; including the number of nominations submitted, the number of requests submitted, and the average time for reference request completion. We’re in the process of developing our baseline, which will help us be more sophisticated in our success measurement over time. |
| How does Point of Reference service compare with other vendors with whom you work? | We can’t say enough about the implementation process and ongoing support. When looking for a customer reference solution, we were looking for a tool as well as best practices advising. We’re grateful for the responsiveness to inquiries, the support as we learn and our program grows, and best practices guidance to ensure we’re on target. Our account director is incredible! She is so responsive to our questions and shares helpful feedback to keep us progressing. We meet on a weekly basis to ensure we’re utilizing the right features and reports. While implementing, our Business Systems colleague mentioned this was the smoothest implementation she’d experienced, thanks to the very knowledgeable team. We are so thankful for the dedicated support. |
 | a conversation with... Jill Fox & Evan Sharp Customer Marketing Manager and Sr. Manager of Customer Success Lever |
|---|---|
| Would you describe your program? | Jill: We have customers all over the world, so the program is international in scope. Sales and customer success are our primary internal clients, but marketing could use it in the future for panel speakers, events, case studies, and speaker opportunities. We have about 25 reps from our sales organization and about the same from our customer success currently using the program. We mainly use it [ReferenceEdge] for reference calls, but we also have different referenceability types within the system to determine if someone is an appropriate contact for product research or cases studies; if they are currently in our customer advisory board, which we host twice a year; or if they are a candidate to be a part of the advisory board in the future. Evan and I both run the program. We tackle different aspects of it, and then there are two reference managers in Customer Success, focusing on other segments. |
| Where did the initiative to start a program originate, and why? | Evan: There has always been a need for customer references at Lever that usually manifests as new business account executives requesting referenceable customers to assist in closing new business sales opportunities. However, when I joined almost five years ago, we didn’t have a formal program in place – those requests just took place over Slack or email, or someone would just walk over and ask one of the CSMs. Shortly after I joined, we set up a slightly more formal process between new business and CS that ran uninterrupted, but with many areas for opportunity over the next several years. In various fits and starts, we wanted to see if software could help alleviate some of the friction that was in the process. And then finally, we got really lucky, and we hired Jill, and Jill picked up the effort to implement software in support of our program. And ReferenceEdge came out on top [in our vendor search] and has been running the program really, really amazingly ever since. So, to answer your question, we’ve always had a reference program, but it didn’t work that well. There have always been issues with it, not the least of which was there was no notion of a true peer-to-peer process, and now we have that, and that alleviates one failure point at the top, which we had previously. And now we have a much more robust and scalable solution in place. |
| What were your top 3 challenges before launching ReferenceEdge? | Evan: I was sort of the de facto manager of the reference program and so let’s take a moment to consider that I go on PTO, for instance, and I become one point of failure. I wouldn’t be actively managing the program when I wasn’t in the office. Or let’s say my bandwidth was really constrained because I’m working on end of the quarter activities. I didn’t really have enough time to dedicate to what was almost a full-time job. So, I think the single point of failure was one thing. Another big thing we had identified as being problematic was reference fatigue. We tended to hammer on the same happy customers quarter after quarter, year after year. And we didn’t have a good way of tracking the volume of requests we were disproportionately throwing at them, our most valuable customers. So, we were looking to solve the reference fatigue issue. And then – last but not least – I wouldn’t have had a term for this during our evaluation, but the thing that stood out to me was how much more seamless the peer-to-peer process is compared to a managed process. And we have a hybrid model now, but the majority of requests are peer-to-peer, meaning that an Account Executive can make a request directly to a CSM without relying on anyone else to put the customer in front of the prospect. It’s just been fantastic. So, those are the three things that come to mind. Jill: One more thing to add is seeing which contacts are referenceable because, from a marketing perspective, we were trying to source customers to speak on our customer conference panels. We didn’t have a single source of truth of which people we could reach out to. So, having that now in ReferenceEdge is super helpful. When selecting a product to run your program, what attributes were you looking for? Jill: So, when I joined Lever, the team had already evaluated a few different vendors. I came on and got a demo with ReferenceEdge. The two aspects that were very important and impressive to me were the native Salesforce ® aspect, to have everything in one spot because that’s where our CS and sales reps live. And then also the analytics and dashboards. I thought the out-of-the-box solution was already great from my point of view, and the ability then to build out different dashboards and views if our leaders or teams needed to see something different. Evan: Overusing customers was a big-time concern for us. So disproportionately, our largest up-market customers were being requested to provide references. This was natural because they are household names. The larger the customer, the more compelling the reference in many cases, so it was difficult to ask the same people repeatedly. And we didn’t necessarily know if they were being asked repeatedly unless we asked the CSM, when was the last time they did this with their customer? So ReferenceEdge is really solving a real need. |
| How did you kick off your new program? | Jill: With leadership, we had multiple prep meetings to let them know where we were in implementation and the next steps. We use Confluence internally, which is a way for us to post pages and information. So, we had a Confluence page showing the timeline and all the different steps and meetings that were occurring. And then to our CS and Sales team, we hosted a training on the day we launched. We also had multiple email communication going out in advance of the training to let them know it was coming. And then, we also communicated the nomination campaign spiff the day of the training to let them know it was happening, the deadline, and associated monetary rewards they would get for participating. For example, in terms of continual communication and training, we just ran the [ReferenceEdge] Profile Update Minder feature last week, so there were two email communications to the team about that. In addition, we announced the Q1 spiff yesterday, so that was an email and a Slack communication and Confluence pages associated. |
| Since launch, what has changed in terms of your company’s reference practices? | Evan: Certainly, my perspective is that I have a little bit more time back in my calendar. When I think about how the program has changed from a high-level business standpoint, I think our hope is that we can put reference-influenced dollars in front of stakeholders across the business just to prove that this is a really high-impact initiative. So, one of the big areas where we weren’t doing a great of before was reporting. Now we are able to take a look at the efficacy of the program across the board and by segment – slice and dice that data and go to our cross-functional leaders and prove out the value of the program. Jill: I would just add that there’s been enablement between sales and CS in the peer-to-peer process so they can talk to each other about which references would be appropriate and move forward that way, so, improving that aspect of it. |
| Since launch, how has your job changed? In other words, how is ReferenceEdge enabling you to do your job better or achieve program goals? | Evan: Basically, all roads led to me, which was a single point of failure, which meant that AEs and AE leaders were following up with me – and honestly, I didn’t have the time to prioritize all of that as a full-time job. Now my responsibilities as a reference manager are more streamlined. I can focus on approving nominations or managed requests for our strategic customers, so I think there has been a significant impact on bandwidth, which is much appreciated. One of our key deliverables for our cross-functional team members is whether we can decrease the time it takes to fulfill a request. And I sense that we’ve been doing that because we’ve eliminated some blockers there. My calendar and my time being one. I think that’s been a big shift and a positive one. That’s where I believe we are today. Time will tell if that continues to be the case, or we can continue to improve there. |
| What feedback have you gotten from stakeholders? Leadership? | Evan: I got some positive feedback from a Sales leader who said his perception was that the reps on his team were in the process a little more. And we’ve gotten some functionality questions and observations from the team with feedback on ways we can improve the program. For example, I just got a question asking me to make sure people couldn’t request a reference from deactivated clients. Overall, we’re pretty new, and the team is figuring it out. I would expect us to have higher-quality feedback in the next 30 to 60 days Jill: I will say that I’ve gotten questions about using ReferenceEdge and functionality. That at least lets me know that team members are using it. The fact that they have questions and are trying to figure out how to do certain things shows that they’re engaged. |
| What aspects or features of ReferenceEdge that you are using do you value the most? | Jill: I would say that the out-of-the-box reporting has been very impressive so far. So, we have just met with [our Point of Reference account director] yesterday and reviewed our dashboards. We ran a nomination campaign, right when we launched, for two weeks. So, now I just announced a new Spiff to our CS and Sales teams to encourage them to submit nominations and reference requests and do the profile update minder aspects so that we can keep our data clean and up-to-date. We have not yet announced any external rewards to customers who do reference activities. Historically, we’ve given them gift cards, but we are in the midst of looking at platforms to do gifting, so we aren’t doing anything just yet until we have something formal in place. We have the Slack integration, so, yes, we have that enabled to alert anyone internally in the program of nominations or requests. [Our Point of Reference account director]and I looked at the Program Health Monitor feature very briefly yesterday, but I wouldn’t say we’re using it quite yet. |
| How do you measure program success? | Jill: We have success metrics and goals set around the number of nominations and the number of requests that come through quarterly. And I don’t think we have a formal pipeline revenue goal yet. |
| What is your experience with Point of Reference as a vendor? | Jill: We’ve had a great experience with our account director so far. She was with us from the very beginning and helped out a lot during the implementation. Since we’ve launched, she’s super responsive and very knowledgeable. Evan: It’s kind of interesting because I lead a team of customer success managers whose roles are in part very similar to what our [Point of Reference account director]) does. My observation of her working with us is that I feel like she is delivering a rather bespoke and proactive up-market experience for us even though we are a smaller customer. I asked her what segment we were in, and she said we were on the smaller side, which I expected, but we never felt it, which is exactly the type of customer experience that we want to create for our customers. So, we’ve definitely felt well supported by her. I think the thing is that she’s just always available, and she’s very proactive and she drives the agenda, and she has recommendations. So, it’s almost like Customer Success on offense with her, which is definitely our goal. So, it’s been great. |
 | a conversation with... Alyse Chiariello Sr. Director, Customer and Events Marketing NICE InContact |
|---|---|
| Could you describe your program? | Our program is a global reference program that supports both the sales and marketing organizations in all geographies. I’m the Sr. Director, Customer Events and Marketing and I have two reference managers that roll-up to me. NICE InContact has had a reference program, at least in name, for five or six years. |
| Where did the initiative to start a program originate, and why? | Initially, before my time, the program was housed in the Operations department. It was called the Reference Desk. Operations didn’t have the bandwidth to manage the Reference Desk anymore. It was Operations part time focus. Marketing was given the opportunity to own References. Since I had built a Customer Reference Program in the past and had a passion for references, I was asked by the CMO if I would be interested in taking on the program. I jumped at the opportunity to build it from scratch. |
| What were your top 3 challenges before ReferenceEdge? | A huge issue was that no one believed in the old Reference program at all. As a result, the program was a shell. The program needed a department to fully focus on making it a success. We had maybe, a couple of dozen customers in the program. The data was a mess: old and unreliable. Everyone did their own thing when it came to finding a reference. Some of our salespeople had never logged into the old reference system. They were using their own networks of contacts. We didn’t have customer content. The program had no real relationship with customers, there weren’t customer advocates. |
| Since launch, what has changed in terms of your company’s reference practices? | Everything. Both our salespeople and marketing believe in the program and know it is there to support them. Everyone knows they are supposed to go through the Customer Reference Program for customer references. We’ve added hundreds of customers to the reference program. We didn’t have much content and now we have global customer content that we can use for advocacy and marketing. We’ve gone from no one using the program to significant user adoption. For our sales references, like reference calls, most of our salespeople now use the peer-to-peer functionality. Our marketing users’ requests often require a more in-depth conversation with the customer, so those needs are handled in a concierge service by our reference managers. |
| Since launch, how has your job changed? | When I inherited the program and brought it into marketing, I basically ripped out the old program and replaced it. This transition happened at about the same time that we moved from ReferenceStor to ReferenceEdge. In the beginning, my role was building relationships both internally and with customers. I set up QBRs [quarterly business reviews] and created training manuals. I still continue to actively promote the program and do our own PR. To have a successful reference program you have to do internal and external advocacy for the program. Now we have two Reference Managers that handle the day-to-day fulfilling of marketing reference requests, building advocacy, growing the pool of reference-able customers, etc. |
| What feedback have you gotten from stakeholders? Leadership? | Positive feedback. Sales is happy with the program and Sales leadership supports using the Customer Reference Program for references They see the value and promote it to the sales reps. The CMO is a big supporter. He keeps the program in front of the C-level executives. If someone complains to him that they need a specific type of customer for a reference use, he’ll ask them, “have to gone to the References team? Did you reach out to this group for help?” |
| What aspects of ReferenceEdge do you value the most? | The P2P [peer-to-peer] reference requests are great. Tracking customer use is very helpful. The new help wizard is a huge plus. It helps people remember how to use ReferenceEdge if they haven’t been in it for a while. The integration with Salesforce helps us keep up to date on our customers. |
| How do you measure program success? | We use several measurements. We report on the program's growth by both contacts and accounts. Our sales team is broken-out by different segments, so slicing the data by segments helps us to gain support from the segment leaders to get more nominations. We produce various types of customer content to use in sales and marketing initiatives. We track the number of pieces of content created per quarter. We also evaluate where we have gaps in content types or subjects. Just like the pool of reference-able customers, you can never have enough customer content. Then we track bookings with reference use to show the number of references used per request to identify if we are using too many references for an opportunity. Many times, Sales uses additional references than needed. Measuring this element enables us to determine if too many references were used for small deals, where one reference would have been sufficient. Finally, we measure Peer-2-Peer vs. Managed requests. Our goal is to grow the percentage of P2P reference requests. Therefore, we track reference requests by P2P vs. Managed per quarter and evaluate progress toward achieving our goal by comparing year-over-year. |
| What is your experience with Point of Reference as a vendor? | The support is beyond beautiful. Our account director is wonderful. We’ve had a weekly call with our account director from the start of the program. She helps us in so many ways whether it is how to do something we want to do or how the product works. She has a real gift in translating the technical aspects of ReferenceEdge into something anyone can understand. We couldn’t have this program the way it is if we didn’t have the support. |
 | a conversation with... Lisa Kaspari Global Customer Reference Program Manager Genesys |
|---|---|
| Could you describe your program? | The global customer advocacy program supports Genesys’ global Sales organization, including LATAM, APAC, and EMEA. The program itself is located in North America and dare I say Canada because that's where I'm based—but really everything is run out of North America. Today, we operate under Marketing. That is a very recent change; up until about a month ago, we were under Sales Operations. Even though now we reside in Marketing, our sole focus is Sales. Our program lives in Salesforce because everything lives in Salesforce. Our sales team lives in Salesforce, and that's where ReferenceEdge lives, which is awesome from my point of view. Our program offers three different paths that our sales team can take to find and request a reference. The easiest path is through the peer-to-peer request feature in ReferenceEdge, where the account executive who owns the reference relationship solely manages the request. Nine times out of 10 times, I do not get involved in those. It's the second path that I get involved in; those trickier, hard-to-find, one-off references for which you really don't have a big pool; you might not have any. So those are the ones that I get pulled into. We then have the third path for when executive advocates are needed. Our Customer Engagement Team manages this type of reference request. Their responsibility is to foster the relationships that we have with our C-level contacts. So, our program goes from the simplest—peer-to-peer—all the way up to managing those C-level relationships. And they all factor into what we put into ReferenceEdge. |
| Who are your internal stakeholders? | As far as our focus, it’s Sales. We also have stakeholders within Marketing—PR, analyst relations; and the RFP team. For example, the RFP team itself does not use ReferenceEdge, as we made it the responsibility of the account executive to find references for RFPs. If they can’t find what they need through a Reference Search, the RFP team can come to the reference team, and we will work together. |
| What were your top challenges before ReferenceEdge? | Well, one major challenge was identifying which accounts we could reach out to at any given time, and prior to ReferenceEdge, things were housed in Excel files. We all know how quickly Excel files go out of date. You keep references in your back pocket and one day, 'Oh, this company's no longer a customer!?' I was still seeing that back in 2016 when I first joined in this role, and I said, 'Wait a second—why do you have an Excel file when we have this really awesome tool that's in Salesforce based on information that account executives and the Sales teams put into Salesforce?' People were like, 'Oh, well, we don't know how accurate it is.' I said, 'Well, it's as accurate as the information you put in. And more accurate than that spreadsheet—just sayin.' The information in ReferenceEdge is continually updated. The information that's there is relevant, and it's current. |
| Since launch, what has changed in terms of your company’s reference practices? | First, we no longer use spreadsheets that become out of date quickly. The filters within Reference Search allow us to customize each search and provide the current references at the time of the request. We now have a single source of truth for reference information company-wide. And, of course, better reporting capabilities with standard reports through ReferenceEdge, which allows us to report on various factors such as revenue influenced by reference activity. |
| Since the launch, how has your job changed? | When I first joined, my responsibility was really to maintain the tool—so managing the information that was in ReferenceEdge and focusing on the data that the account executives see. Now, my role is more strategic. The majority of reference requests are peer-to-peer, which allows me to focus on getting new accounts into the reference program to help take the burden off of those customers that are the “go to” accounts for everyone. It also allows me to help with the unique reference requests as well. |
| What feedback have you gotten from stakeholders? Leadership? | We have the buy-in all the way up to my VP level. Their thinking is, 'Yeah, this is it—ReferenceEdge houses our reference information.' So, when anyone, anywhere in the company, looks for reference material, this is where they find it, and this is the team they come to; they come to the reference team. I know the sales leadership—they get it as well. The tool works for them. I jump on weekly sales calls just as a friendly reminder, 'Hey, remember, the reference team is here for you. You know, we have this tool. We get you're busy; we're here to help you.' When a request comes in, and an account executive says "Hey, I'm looking for this third-party integration", I can say, "You know what? I have this, this, and this for you. And guess what? Two of them are in the tool. So, I'm now going to walk you through how to find this yourself.” They’re hesitant at first: “Oh, but I've never done it before." I tell them, “It's okay. It's easy. Let me walk you through it." And then realize, "Oh, it actually is easy." I use these opportunities to foster relationships with the account executives. |
| What aspects of ReferenceEdge do you value the most? | Beyond the peer-to-peer request feature, another unique point is the Influitive integration with ReferenceEdge we’ve had since 2015. I'm very happy to say that the custom-built API that we've had starting in 2015 is now a standard integration within Influitive which allows transparency to our advocates as well as to our sales team. That's a pretty exciting integration for us because we use a points system for advocates. If you do a reference activity for us, you earn points, and we're always being asked: 'How many points do I have?' Having Influitive integrated completely to ReferenceEdge, there's no having to do anything twice. When it happens on one side, it happens on the other side. For our users, having no additional logins or credentials is key to adoption—everybody's in Salesforce; nobody wants to have to remember another login; nobody wants to have to click another window when they already have something open. The out-of-the-box reporting is awesome. For me, Salesforce reporting is complicated; I still have a big learning curve. But having those out-of-the-box reports is terrific. I can see the last active date on a specific reference profile and tie it back to revenue or see how many peer-to-peer versus managed requests we have and all that stuff. Another benefit is that ReferenceEdge is entirely scalable. We went through a pretty big acquisition in late 2016. ReferenceEdge was able to scale with our bigger sales team as well as increased reference accounts. I was very excited to see that we could scale, and it really wasn't painful; it just happened. I have tell you, the mapped attributes—100% valuable. It could not be easier to go in and see, 'Hey, there's a new picklist field I could use in the Search function. Oh, my goodness. Mapped—done.' |
| How do you measure program success? | Success is definitely assessed by the company in terms of revenue influenced. We measure how many wins have reference activity tied to them. Personally, I look at how many peer-to-peer requests come in that I didn't have to support. It keeps growing each year. Another thing that we're tracking this year is the number of [reference request] emails that go out—when we see someone send a mass email to All Sales, 'Hey, I'm looking for a reference,' and I think, 'Did you really just send a mass email asking for a reference? Are you new? Get to training!' Everybody's set in their ways sometimes. I know learning new software, whether it be Salesforce or changes to Word or Excel, some people don't take to the change. So, when we see the reduction in those types of emails, that's also a success. |
| How does Point of Reference service compare with other vendors with whom you work? | My account director is awesome. Every day, she goes above and beyond. When I send her those wacky questions where I think, 'I feel I should know this, but I'm going to ask it anyway.' She'll never come back and say, 'Oh, well, on page 20 of the user guide…' No, she gives me the answer, she gives me a screenshot—it's awesome. I have worked with the executive team for different things, most recently related to our integration with Influitive. The team, as a whole, is phenomenal. I've said this many times, and I'll keep saying it, that they're not just a vendor; they're really a partner. And you know, my success is their success is my success again when I suggest a product enhancement and they're like 'Yeah, that's pretty cool,' and then it makes it into a release. They listen—it's awesome. Honestly, sometimes, even when a situation isn't a ReferenceEdge issue, they still step up and provide suggestions. They might say, “Did you think of looking at this or looking at that?" And you know what? I hadn't, because Salesforce is huge. They help me, when a technical situation comes up, they put it into terms that I understand so then when I need to go to a Salesforce admin, I can ask intelligent questions. And not very many vendors will do that—if any. My experience with other vendors has been, "Oh, well, sorry—we don't handle that." The fact that Point of Reference is there to support us is phenomenal. |
| What are your future plans? | We're always looking for 'How do we make it easy? How can we make it easier for our sales team?' Providing the best tools for Sales to have easy access to success stories, to the database, to be able to sell and sell quickly. That’s our program in a nutshell. We're turning on ReferenceEdge content functionality within the latter half of this year, and really, truly giving our account executives that one-stop-shop. We are creating Reference content packages for use in Sales presentations. They will include talk tracks and links to any case studies or videos we may have with that particular customer. Our company-wide content is housed in Seismic today, and there is a lot of information to sort through. Sometimes all that is needed is the story of why an account chose Genesys. This content will give that information to the AEs through a platform they are in every day. By using the reference content feature of ReferenceEdge, we will be able to set review dates for each piece of content. This will allow us to keep the content current. We are also able to control if we need to pull a piece of content based on the customer’s reference status. In 2020, we are looking at doing more with ReferenceEdge through the Salesforce mobile app. It hasn't been our focus, but I think once we get past the content initiative, I think the adoption of the mobile app is just going to skyrocket. Then they’ll have the tool at their fingertips anywhere. |
 | a conversation with... Allyson Crowell Evidence & Editorial Group Lead, Brand Strategy Blackbaud |
|---|---|
| Could you describe your program? | Our reference program originated around 2013 and has gone through a few changes over the years. I've been managing the Customer Evidence & Advocacy team for a little over a year. We are part of the Brand Strategy team within Corporate Marketing at Blackbaud. Customer Evidence & Advocacy covers three distinct components: references, champions (advocate hub), and customer stories. We have customers who participate in all three areas, and some who participate in only one. Our reference customers tend to be more senior in their careers. Our champions tend to be more mid-career, looking to connect with other users—but there is a lot of overlap. |
| Who are your internal stakeholders? | Our larger teams serve the entire organization, so we'll get requests from sales team members, product marketers, and customer success managers—it really runs the gamut of our colleagues who are requesting different types of customer evidence and advocacy, but references specifically are a sales-driven need. We have several hundred active ReferenceEdge licenses for our sales teams. |
| What’s a big focus in your references program right now? | In recent years, one of Blackbaud's big initiatives is to ensure our advocates' happiness and express our gratitude every time they participate in an activity. That's something that our team feels passionately about. Part of that standard of excellence means that we track our references and don't overuse them; we always abide by the cadence they've set and express how much we appreciate them every time. |
| Why did you decide to move to a new platform? | We had some dissatisfaction with our previous reference platform because it made it more difficult to achieve those goals. Our director was steering that ship to look at new vendors and partner with IT and others within corporate marketing to look at what it would take to move to a new platform. |
| What were your top challenges before ReferenceEdge? | Reference data health was number one. It was critical for us to have a reference platform where customer updates were seamlessly integrated into the system and didn't require a big manual effort. This capability was crucial to save our team significant time and effort and ensure that the platform had our stakeholders' confidence. Number two was the platform's reliability—the old platform was kind of glitchy; there were little intermittent outages of different capabilities or functionalities, and we wouldn't have clear answers as to why. The third pain point for us was program reporting. The senior references manager would spend hours manually sifting through our old platform for any comprehensive reporting. |
| Tell me a little about the transition to ReferenceEdge. | We decided to go with ReferenceEdge toward the end of 2019. We started the transition in February of 2020—and as you know, everything changed in March when our entire company went remote. Quite honestly, it was the perfect storm to do a platform migration under these circumstances. We'd already set a pretty aggressive timeline that involved departments across Blackbaud to pull it off, including different teams within corporate marketing to IT to procurement, and, of course, the buy-in of sales and sales enablement. But Blackbaud really values our customers who serve as references, and ensuring we had the right platform to serve them was a cross-organizational priority – so, with a big team contributing, we got the job done! We officially launched ReferenceEdge on May 8, 2020, right in the middle of the chaos, but it was seamless. I credit our Account Director for her advocacy and ensuring we got to the finish line in the best way possible. |
| How did you launch ReferenceEdge internally? | We were really thoughtful about how we approached the launch, in terms of socializing the program to the company. We convened this group of high performing sellers who hadn’t previously been significant users of our reference program and invited them as our beta testers. While we were finalizing the migration, we invited them to test ReferenceEdge and provide feedback. We incorporated that feedback into the rollout, which I think was very effective in spreading the good word. These stakeholders were able to credibly share with their own teams, "Hey, the customer evidence team is collaborating with us and meeting our needs. We have a common goal here." Our Point of Reference Account Director was fantastic, because she attended these sessions and answered any questions that my team wouldn't have had the background to answer. We had the opportunity for a lot of facetime with sales and to solicit some suggestions from them. They also had to take a mandatory seven-minute training with us on how to use ReferenceEdge, then got a license. We joined a lot of all-hands meetings and sales enablement meetings. The awareness skyrocketed, and it was just a great opportunity for us to share what our program could help them achieve. The people who used it were seeing great results, and so we had the opportunity to socialize with a message of "Look what your hyper-successful colleagues are doing—let us help you as well." |
| Since launch, what has changed in terms of your company’s reference practices? | Our sales team is consistently using the platform rather than touching off email chains where they're just asking their colleagues directly for help. Making sure all reference requests flow through the platform is crucial to ensuring that we demonstrate care for our customers and ensure we don't call the same ones all the time and make things smoother and easier for sales. By working with our team and within ReferenceEdge, we can track usage very closely and honor our customers' requests in terms of how frequently they're contacted and ensure that we're thanking them. We're using the nominations capability, and we love that. That is definitely a huge win for us. It makes nominating customers to be in the reference program a lot easier. We can guide our colleagues in sales by saying, "You can make a nomination directly from the contact, and it'll come straight to us." It makes it easy to receive and track them because the process is a lot more seamless and takes out a lot of manual work. |
| What feedback have you gotten from stakeholders? Leadership? | It's been really good. Overall, we've just had great feedback, and, honestly, had no complaints about it. Our team has received a lot more outreach from salespeople wanting to partner to find a specific reference. We provided a little synopsis of the program around the launch date, and the response was very enthusiastic, that this was a great move. So, I would say that it was very well-received. It also earned a lot of visibility for our team. We're a pretty lean team, but we play an important role in the company, and so having that visibility as a result of this change was great for us. |
| What aspects of ReferenceEdge do you value the most? | Having everything in one spot and connected to our CRM is really nice. We're still getting familiar with ReferenceEdge, because we are less than a quarter in. Nonetheless, I think our experience is much better [compared to the previous solution], whether it is the time spent reporting or providing specific data quickly. I think there's a lot less left to the imagination because it’s real-time and native to Salesforce, which is the platform we use to manage our sales process. And that’s what you need." |
| How do you measure program success? | The metrics that we track focus the number of references provided on a month-to-month basis. We measure the growth quarterly, and we report that out to our sales teams and our leadership —then we track annually and set goals around that. Included within those reports are the pipeline influenced and also the influence on closed deals. We also track the number of references in our program. We're always trying to recruit, especially in what we would call 'gap areas.' If we have a new solution that launches, it would be a priority for us to recruit new references in that area. Alternatively, if we are noticing that we're getting a lot more reference requests for a particular product, we would definitely want to increase the numbers there to prevent asking the same people too often. So, those are all metrics that we track and report within corporate marketing on a monthly basis. Then we report to sales the number of references provided, pipeline influence, and influence on closed deals on a quarterly basis. |
| How does Point of Reference service compare with other vendors with whom you work? | You know, I think everybody uses the term 'partner,' but it's so true in this case. We have this weekly call with our Account Director. Doing this migration during Covid-19 and the height of the chaos, it was so nice to have this weekly contact with her. What I appreciated about her is her honesty and dedication to us. If she didn't know the answer, she never pretended she did. She is really great about saying, "I'm not sure but let me talk to the person who's the subject matter expert and get back with you." She always gotten back very quickly. And I think that is a real testament to a true partnership—when you can say, "That's not my area of expertise, but I will find out for you." She is always really receptive to our concerns and makes great suggestions on what might be next for us in terms of "Hey, you know, let's talk about Lead Finder" because that was high on our list before we jumped in, and then you get caught in the weeds. And she's great about surfacing things that are going to be important to us moving forward. |
| What are the next steps for your program? | Our Account Director has been working with us on our dashboards, and it's been great, so we're looking forward to getting more familiar and comfortable with doing that on our own. We are planning to integrate Gainsight because we know that the data from ReferenceEdge will be invaluable to our colleagues in customer success—and they just let me know this week that they've been pulling in the data. We use Influitive's AdvocateHub for our Champions program and are working on that integration as well. It'll be great to have those two systems integrated so we can see the overlap and unlock all of those capabilities. We are also getting ready to start using the Reference Lead Finder capabilities. |
 | a conversation with... Liv Schichtel Customer Marketing Manager AvidXchange, Inc. |
|---|---|
| Could you describe your program? | The customer Reference Program is part of our marketing department. My title is Customer Marketing Manager, and I handle our ReferenceEdge program, our customer community, and our customer story writing. AvidXchange works with real estate, construction, HOAs, and other vertical markets to help automate their payments and accounts payable. We sell different solutions to make it easier and more seamless when they're making payments and processing invoices. So, our references have to address those specific verticals and products. |
| Who are your internal stakeholders? | The groups who use ReferenceEdge and or customer references include Sales, Product Marketing, our PR and social media team, and other various departments. Our Customer Success or relationship management people are also deeply involved. |
| What were your top 3 challenges before ReferenceEdge? | Our sales team was pocketing their best customers in their “little black books,” which they went to whenever their prospective customers needed a reference, not really wanting to share them for fear that their contacts would get overused. We didn't really know how often customers were being used or if they were being used at all. We couldn't see if salespeople were actually even contacting these references that they pulled. It was a hot mess. |
| Since launch, what has changed in terms of your company’s reference practices? | Over the last year or so, references have been a very hot topic at AvidXchange. There's just been such a need for them across the board. I was hired specifically to get ReferenceEdge and customer marketing off the ground. I've only been here for a year, but our company has had ReferenceEdge for 4-5 years. Unfortunately, nobody truly owned it; it was just sitting there. I think there were waves when people would put references in the system, but then it would just kind of sit there. Neither the references nor ReferenceEdge was being used effectively. That history is to explain that this last year has been about starting from the ground up to build the customer data and educate the reference users. We had to meet with the sales team and educate them on how to use ReferenceEdge. Then we met with our customer success team, who are the ones approving and maintaining relationships with those references. We put rules in place to incentivize customer success to put references in and remove old contacts from ReferenceEdge continually. They are now keeping that pool fresh and current so that whenever a salesperson dips into ReferenceEdge, they're not just coming to the same exact references that they saw last time; there're always new ones available. ReferenceEdge wasn’t being used a year ago. Now Sales, Customer Success, PR, and other teams are using it—and it isn’t just me working in the system. |
| Since launch, how has your job changed? | My job's changed a lot. I don't have to be in ReferenceEdge or involved with finding references as much. I'm also doing less data entry because our customer success staff is now coming in to make sure that our reference contacts are updated. Going forward, ideally, we're not going to see as many cases where I need to be involved. Part of this change results from training sales on how that they can find references for themselves, and they don't have to click the button to ask for help from me. Educating them on how to use the system for themselves has made my job a little bit easier. |
| What feedback have you gotten from stakeholders? Leadership? | The leadership is constantly telling me how important this program is. Since I've gotten here, it's been easy to get executive and higher-level backing, so that's been a blessing. When I first started, I met with a lot of the sales leaders and they essentially said, "You got passed a hot potato because ReferenceEdge is complicated to work with." They were nervous that it would distract their team. Then, they realized what ReferenceEdge would actually do that for them, and so it's been cool to see how supportive people have become of it. |
| What aspects of ReferenceEdge do you value the most? | I definitely love the reporting and the dashboards; they're extremely helpful. We have gamified the customer success team's incentive to nominate references. We’re able to pull a report or a dashboard easily—like their leaderboard—to see who's in the lead for the number of accounts they've put in per quarter. I also like the peer-to-peer request management a lot because it's pretty intuitive, reference requests go straight to the customer success manager for approval and I typically don’t have to intervene. |
| How do you measure program success? | When I came on board, our biggest goal was to get as many contacts and accounts into ReferenceEdge as possible. So, last year I was getting measured on upping the number of references in the program in general. I think we probably had maybe 150 contacts in ReferenceEdge when I joined, and we more than doubled that number this last year. We’re now measuring on revenue, or to put this in easier terms, closed/won opportunities—how many of those deals had a reference attached. Where we want to take the program this year is more about how many people are using it. We'll be tracking Sales, and other customer facing teams that actively use the references that we're collecting. Something else that's important to point out is that customer marketing is not a one-way street. We don't want just to be using references to close deals. Yes, that's a piece of it, but it's also to make sure that we're taking care of our customers. These are our happiest customers and biggest advocates, and so we want to make sure that we're thanking and rewarding them accordingly as well. Our reference contacts are real people, and they enjoy the service that we're providing, and so we want to acknowledge that and their participation. The functionality within ReferenceEdge has been awesome to help us do that. There's a place where we can track how often somebody's being used as a reference and then be able to reward them accordingly, whether it be with a swag gift or a gift card or just a fun surprise gift. It's just nice being able to celebrate them and surprise them. |
| How does Point of Reference service compare with other vendors with whom you work? | It's been amazing. I would do anything for our Account Director--she's the easiest person to work with. I've had a lot of other customer success managers on other platforms that I've used who haven’t been responsive—one just completely ditched me and sent me to their support page on their website and a generic email. With Point of Reference I meet with my account director twice a month and it's just very easy. She responds to emails so quickly. She'll jump on a phone call whenever I need her. I don't think I could have done a lot of what we've been able to do with ReferenceEdge if I didn't have the support from them. Probably my favorite part about having ReferenceEdge in general is their customer service. |
 | a conversation with... Sandi Montour Senior Customer Program Manager Mitel |
|---|---|
| Would you describe your program? | The Mitel global customer reference program currently resides within the sales enablement team in marketing. For the past nearly four years, I've been administrating our customer reference program. Our global program supports all products and geographies, including the Americas, EMEA and APAC. ReferenceEdge is the software tool that tracks and manages the overarching, strategic program, called the Mitel Ambassador Program. It’s in four languages—English, French, German, and Spanish—and provides public-facing information on the benefits and process. |
| Where did the initiative to start a program originate, and why? | The initiative started as a massive data integrity project with the reference system that ShoreTel had at the time. With the Mitel acquisition, the team took a fresh look at all of our systems, including our customer reference database. We considered the options and chose to replace the former system with ReferenceEdge, primarily because it’s a Salesforce native application. Since I was a Point of Reference customer for four years at a previous organization, moving to ReferenceEdge felt very comfortable – both with the technology and the business relationship. For the ReferenceEdge launch with the legacy part of our business, we cleaned up the data, decided what would be moved to ReferenceEdge and what fields to map to. Those stakeholders were relatively familiar with the concept of a customer reference database system and just needed to learn how to use the tool, which had a renewed sense of trust and excitement because of that data clean-up project. For the other part of the business, the legacy Mitel part, having a customer reference database system was brand new and very exciting. Internal surveys and feedback had shown that finding a reference was a top pain point for sales. Having a tool to solve that pain point was a big leap forward. |
| Who are your internal stakeholders? | Our stakeholders include sales, customer success, executives, training, product marketing, field marketing, brand and corporate marketing, user groups, PR, AR, and IR, product trials, and the RFP and activations teams. |
| What were your top 3 challenges before ReferenceEdge? | The problems across legacy ShoreTel and Mitel were ultimately the same: no metrics, no central hub for all information and activities, and no scalability. |
| Since launch, what has changed in terms of your company’s reference practices? | There's a greatly improved understanding of who our reference customers are and what they're doing with us and for us. We’ve seen a decrease in that scramble for references, especially for new salespeople who may not yet have a complete understanding of our customers. There's improved coordination amongst departments, like with the RFP team, product trials and the activations team. It has also increased our value to partners as an additional way for us to collaborate and help each other. |
| Since launch, how has your job changed? | Based on our self-service model with sales and customer success managers owning the reference process, my role is to manage the customer reference system and the program framework, training and tools to support it. For example, I’ve created customized how-to documents, videos and a learning management system course. This also includes my favorite practice of kaizen, which is the concept of continuous improvement. By connecting with and listening to my internal customers – primarily sales, customer success and marketing – and through the great insights of our Point of Reference Account Director and the constant innovation of Point of Reference, we’re always looking for – and implementing – ways to make the system serve our stakeholders even better. Our model also allows me to strategically develop and manage other programs such as the win reports and lead other special customer and partner-related projects. |
| What feedback have you gotten from stakeholders? Leadership? | There have been a lot of positive responses. A colleague in content marketing said, "I love how you are bringing structure to this very important part of our business." Also, a territory account manager, wrote, "Thank you for providing me an overview of ReferenceEdge last week. It was super-informative and helped me understand how powerful ReferenceEdge truly is. As many of our prospects usually ask for industry, size, location, and product-specific references, this tool is very efficient, easy to use, and will be a competitive advantage. In my career, I have not seen a reference tool like ReferenceEdge." And, after I met with a sales team and sent a follow-up email with resources, a sales vice president said, "I just happened to be on the phone with a salesperson when you sent this. She has one that should close this quarter and will be a nice success story. One cool thing about it is that she was able to move them forward based on references from our reference program." Based on the reports I send to leadership every month, they love seeing the increase in program adoption and the objective, hard data. In essence, the program adoption equates to more opportunities to showcase our customer’s success and our ability to quickly match our customers to the reference activities that are of interest to them. It’s the quintessential win-win. Leadership also appreciates the decrease in those urgent emails trying to find a reference, and the more efficient and focused process via ReferenceEdge. |
| What aspects of ReferenceEdge do you value the most? | First, that it's a native application to Salesforce, so there isn't an additional or different login. We meet sales, our key internal customers, where they already are. Another one is the Gainsight integration. We’ve set up automated processes around the Net Promoter score, contract renewal date, and the overall health score. Based on the numbers reported in Gainsight, we automatically set a customer in ReferenceEdge to 'caution' or 'inactive.' With the contract renewal date, we automatically set a customer back to 'active' when they renew. The customer success managers have especially loved this because it doesn’t distract them with reference requests for customers who may not be currently appropriate. The Gainsight integration further streamlines our processes – and based on our own data and criteria, which increases the trust and confidence in the system. For the overall health score, on a monthly basis the customer success managers and I receive and review a report of the scores. The customer wellness score is based on a variety of internal indicators and provides us with evidence-based, valuable leads for our reference program. Another function that I value is Reference Lead Finder because it streamlines and automates the process of identifying customers who may be appropriate for our reference program. It saves time and harnesses the beauty and power of software. No one needs to keep a list or remember which customers closed 'X' number of months ago. It automatically prompts us to check on a customer’s readiness and provide the option to send the notification to somebody else who may be more appropriate to answer the question. With the reference content functionality, along with case studies, we've also added our win reports. These are internal only reports that provide additional sources of insight that may help win business, and they're searchable based on the same criteria as reference contacts. We’ve also enabled advanced request routing. With the Advanced Request Routing capabilities, supervisors can respond to reference requests for team members/account owners who are out-of-the-office, which keeps the process moving forward at a critical time in the sales cycle. And, of course, the customizable reports and dashboards show all of the objective, hard data needed for the reports to leadership -- in a single place. |
| How do you measure program success? | The primary ways we measure program success are revenue influenced by the month, the year, percent increase, and by the number of new references. As of July 2020, our revenue influenced is more than 122% higher than all of 2019. |
| What is your experience with Point of Reference's service? | Our account director is a true business partner. She’s always thinking of how to improve the tool for our unique environment and needs. She's responsive, creative, patient, knowledgeable about the tool and the industry, highly professional, and an absolute joy to work with. She's made the overall experience with Point of Reference a very positive one by taking a keen interest in our business and how ReferenceEdge can help. She relates well to all stakeholders—so beyond me as a reference manager to include our representatives from IT and Salesforce support and anyone she interacts with. Our ReferenceEdge implementation and our program would not be what they are without her. |
 | a conversation with... Maria Sturgeon Director, Peer Advantage, Customer Advocacy, Global Marketing, Teradata |
|---|---|
| Would you describe your program? | Peer Advantage is Teradata's global reference program launched back in 2001. We've always reported into global marketing. We support marketing activities and sales references for all global regions. It's a pleasure to work with our salesforce and marketing constituents because they really value the program and appreciate the work we are doing to drive revenue and support our corporate strategy. |
| Where did the initiative to start a program originate, and why? | The Peer Advantage program started a couple of years before I joined Teradata. It's the longest-running program within our marketing organization. Our execs and stakeholders have always seen the value in the program because we know that peer-to-peer conversations are consistently the number one or two criteria for selecting a vendor. Analyst research from firms such as Gartner and Forrester has consistently shown that year-over-year. In addition, peers instill trust in the buyer that they are making the right decision. |
| Who are your internal stakeholders? | The program supports our sales organization with one-to-one calls and meetings at Teradata events and arranging site visits. We also help marketing stakeholders, like our PR team and analyst team, fulfill key media interviews, analyst reviews, and critical analyst evaluations such as the Forrester Waves and the Gartner Magic Quadrants. Within the last two years, we've also expanded into supporting references for our alliance team because they help manage our partners, who also help drive our revenue. I also work closely with our user experience team to help them find customers willing to provide feedback and complete surveys based on our products. |
| What was the catalyst for moving to ReferenceEdge? | When Teradata decided to switch the CRM system to Salesforce® a few years ago, our homegrown reference management system, which was part of our former CRM system, no longer worked to the capacity needed, mainly due to integration issues. As a result, we were spending lots of time with our help desk trying to understand and resolve the problems, and it became clear we needed a more compatible tool with Salesforce. We also had a member enrollment website where the platform was not being supported anymore, so we needed to switch platforms for that as well. It really made sense to go into a vendor selection process to find a reference management system that met our needs and integrated with our member website and Salesforce. |
| What were your top 3 challenges before ReferenceEdge? | Even though our old system was great for many years, we could never successfully track revenue influenced and the opportunities we supported unless we did it manually. Additionally, nominations were completed with a Word document, and we captured all of the profile and attribute data from those nominations into an Excel spreadsheet. Those were the main challenges that we were never able to meet with our prior system—and now we are with ReferenceEdge. Ultimately, it was a very long process in terms of the solutions we looked at and why—and we were able to get a cross-functional team internally with our marketing ops folks, IT, and our Peer team to look at our needs. We put together an extensive user requirements document, and in the end, we just felt that Point of Reference and the ReferenceEdge tool could best deliver what we needed as a program to move forward. |
| Since launch, what has changed in terms of your company’s reference practices? | As a result of launching ReferenceEdge, the main change is that our stakeholders are now able to conduct a little more self-service and research on the best customer for their client or activity since reference search functionality is available. This takes some of the responsibility off us to do the leg work. In addition, the nomination process is automated within ReferenceEdge, and profile data is captured in Salesforce for all of our stakeholders to see. We also worked with our learning team to design learning modules around requesting a reference, nominating a reference, and updating attributes. As a result, we've elevated the overall training experience for our new hires. I'm able to assign a license to the appropriate person and send them some of the training modules simultaneously. Since we have modules available for all aspects of ReferenceEdge, it's easier to get new hires on board with the tool and up to speed with Peer Advantage. Also, since everything now is done in Salesforce and that's the primary system they work with daily, I believe that's very helpful. |
| Since launch, how has your job changed? | I spend a lot more time on reporting since I can now leverage more automated reports. With so many reports at my fingertips, I am now doing them weekly to make sure we're on track to meet our KPIs. We also just started building out the dashboards, so we hope to increase the visibility at the executive level. My team has spent more time with the account executives, engaging them on how to update attributes of their respective advocate companies. It's been great since there are a lot of new account executives, and we can educate them about Peer Advantage and the supporting processes. We hope to automate the profiles more in the future for them to update but working with the account executives during the last year has been really good for relationship building, especially with COVID and not being able to see them face to face. Since our program is unique in how we reward customers with business rewards, we have a new liability process with corporate finance, so I also spend a lot of time around liability reports. The reporting in ReferenceEdge really, really helps me do that every month. |
| What feedback have you gotten from stakeholders? Leadership? | We consistently track feedback about Peer Advantage by reaching out to the account executives to make sure that the references fulfilled their part and that the requesting prospect or customer was satisfied. For example, I just received feedback from an account executive who said that Peer Advantage is one of the key tools that he leverages to change perceptions of Teradata. Of course, we get plenty of feedback from customers, too—especially those who attend our webinars. Like last year we did one with our Utah Jazz customer hosting it, and we had one of the attendees say, "the insights were great in helping us with our evaluation process." Obviously, with switching to a new sales tool, you're likely to have pushback from those folks who were used to our previous methods, so it was an education process. ReferenceEdge is really easy to use in terms of submitting a request or nominating a new member company. Often, we do have quick meetings with the account executives or the marketing person completing the request to walk them through it, and after they see it, they're like, "Oh, you're right—it's super easy." I think they do appreciate it being within Salesforce. |
| What aspects of ReferenceEdge do you value the most? | For me, it is definitely the automated reports and the ability to flesh out a complete reference profile: what they’re referenceable for, activities they’re amenable to, etc. As I mentioned, I'm in ReferenceEdge daily and weekly doing reports just because it's become so critical to proving the value of our program. We're constantly refining our reports and attributes as needed to align with our program and corporate goals. When we introduce a new product or solution, we can quickly modify the nomination form to ensure that we know the best references who can speak about that product or solution and that reference search results are accurate when searching on the new solution. Our ability to also track within the profiles if a company is on caution for some reason is also critical in delivering the right reference. For example, last year with COVID, we saw many members not wanting to complete references. With ReferenceEdge, we're able to update that and keep that information accurate as well. |
| Tell me a little about your use of ReferenceEdge Group Events. | One of the Peer Advantage program's core strengths is organizing webinars and events to leverage a customer. I collaborate with our analyst team to create 1: Many events with a customer, an analyst, and one of our key subject matter experts or executives moderating the session. When COVID changed things, we saw the volume of our one-to-one references going down. However, we knew that our customers had a lot of stories to share, and they were willing to share them, so we organized several webinars throughout the last year. We used the group events functionality in ReferenceEdge to help us record who attended those webinars and then associate opportunities with those webinars to track the revenue influenced. One of the great reasons this program has sustained is that we have members of our program that have been here since 2001. So, even though you constantly have new customers coming in and contacts changing, we do have long-term members who know our team. We have a history with them and can—especially at face-to-face events—organize a lot of unique personal touches with those people to recognize them and know that they're valued and appreciated for all their work. We truly enjoy working with them. We make all the contact with our customers, and that's one of the things that Point of Reference helped us customize. When we send out the contact invite, it goes directly to the customer with a copy to the respective account manager just to keep them in the loop. But again, because this program has been so longstanding and has a very good reputation within Teradata, our account executives really trust us to go directly to that customer to make the ask. |
| How do you measure program success? | Since program launch, we've measured two KPIs: the volume of references, both sales and marketing, and then new member companies because you continually need new advocates as part of your program. But with the capabilities of ReferenceEdge, we can successfully add revenue influence as one of our KPIs. We're just thrilled to be able to add that in terms of the opportunities we track. It allows us to track several areas; one is total overall Annual Recurring Revenue growth and total contract value, and then we're also able to look at a full funnel for the next 12 months to see what the potential ARR growth will be as well as the potential contract value. It is extremely helpful to see how that changes week to week because I provide a weekly report to management in terms of what is influenced. |
| How does Point of Reference’s service compare with other vendors with which you’ve worked? | I met Point of Reference’s President, David Sroka, at a conference many, many years ago. He has been very gracious in introducing me to many of my peers in the advocacy world. He knew Teradata was not ready to move into a new customer reference system until we switched our CRM platform, so as soon as I knew that we had to do that, one of my first phone calls was to him to say we definitely wanted to consider Point of Reference as a potential solution. I know that our program has presented some unique requirements for Point of Reference, and I really appreciate the staff's ability to customize where needed. I also appreciate the thought leadership as related to best practices. Our original account director was phenomenal—I mean, just phenomenal—and I greatly appreciated her being assigned to our account. We recently transferred to a new account director, and she jumped right in, quickly adding value without skipping a beat. The staff has just been wonderful. We work with the Point of Reference co-founder and CTO a lot, too. He worked with our web agency when we've had integration issues, mostly API challenges with our website. He is always great at looking at the problem, going back and thinking about the issues involved, and then resolving them. So, the overall experience working with Point of Reference has been great. Another thing I've enjoyed is the virtual user group. I think those are phenomenal in connecting their clients. You always learn a lot from other companies, and other companies may learn from you. I provided some feedback on the last one via the chat feature. I've already had several people reach out to me, mostly to educate them about our rewards program and the business rewards we offer, and how we manage that. It's always great to get a new perspective from a peer in the advocacy industry. So, I appreciate Point of Reference in taking the lead in organizing those, and I look forward to participating in more. |
Sr. Manager of Customer Success & Customer Marketing Manager
Lever.co
We mainly use it [ReferenceEdge] for reference calls, but we also have different referenceability types within the system to determine if someone is an appropriate contact for product research or cases studies; if they are currently in our customer advisory board, which we host twice a year; or if they are a candidate to be a part of the advisory board in the future.
Evan and I both run the program. We tackle different aspects of it, and then there are two reference managers in Customer Success, focusing on other segments.
Shortly after I joined, we set up a slightly more formal process between new business and CS that ran uninterrupted, but with many areas for opportunity over the next several years. In various fits and starts, we wanted to see if software could help alleviate some of the friction that was in the process. And then finally, we got really lucky, and we hired Jill, and Jill picked up the effort to implement software in support of our program. And ReferenceEdge came out on top [in our vendor search] and has been running the program really, really amazingly ever since.
So, to answer your question, we’ve always had a reference program, but it didn’t work that well. There have always been issues with it, not the least of which was there was no notion of a true peer-to-peer process, and now we have that, and that alleviates one failure point at the top, which we had previously. And now we have a much more robust and scalable solution in place.
Across the top of all these stakeholder groups is the leadership team. With the executives, I make sure they are kept up-to-date and aware of my work.
So, I think the single point of failure was one thing. Another big thing we had identified as being problematic was reference fatigue. We tended to hammer on the same happy customers quarter after quarter, year after year. And we didn’t have a good way of tracking the volume of requests we were disproportionately throwing at them, our most valuable customers.
So, we were looking to solve the reference fatigue issue. And then – last but not least – I wouldn’t have had a term for this during our evaluation, but the thing that stood out to me was how much more seamless the peer-to-peer process is compared to a managed process. And we have a hybrid model now, but the majority of requests are peer-to-peer, meaning that an Account Executive can make a request directly to a CSM without relying on anyone else to put the customer in front of the prospect. It’s just been fantastic. So, those are the three things that come to mind.
Jill:
One more thing to add is seeing which contacts are referenceable because, from a marketing perspective, we were trying to source customers to speak on our customer conference panels. We didn’t have a single source of truth of which people we could reach out to. So, having that now in ReferenceEdge is super helpful.
When selecting a product to run your program, what attributes were you looking for?
Jill:
So, when I joined Lever, the team had already evaluated a few different vendors. I came on and got a demo with ReferenceEdge. The two aspects that were very important and impressive to me were the native Salesforce ® aspect, to have everything in one spot because that’s where our CS and sales reps live. And then also the analytics and dashboards. I thought the out-of-the-box solution was already great from my point of view, and the ability then to build out different dashboards and views if our leaders or teams needed to see something different.
Evan:
Overusing customers was a big-time concern for us. So disproportionately, our largest up-market customers were being requested to provide references. This was natural because they are household names. The larger the customer, the more compelling the reference in many cases, so it was difficult to ask the same people repeatedly. And we didn’t necessarily know if they were being asked repeatedly unless we asked the CSM, when was the last time they did this with their customer? So ReferenceEdge is really solving a real need.
For example, in terms of continual communication and training, we just ran the [ReferenceEdge] Profile Update Minder feature last week, so there were two email communications to the team about that. In addition, we announced the Q1 spiff yesterday, so that was an email and a Slack communication and Confluence pages associated.
Jill:
I would just add that there’s been enablement between sales and CS in the peer-to-peer process so they can talk to each other about which references would be appropriate and move forward that way, so, improving that aspect of it.
One of our key deliverables for our cross-functional team members is whether we can decrease the time it takes to fulfill a request. And I sense that we’ve been doing that because we’ve eliminated some blockers there. My calendar and my time being one. I think that’s been a big shift and a positive one. That’s where I believe we are today. Time will tell if that continues to be the case, or we can continue to improve there.
Overall, we’re pretty new, and the team is figuring it out. I would expect us to have higher-quality feedback in the next 30 to 60 days
Jill:
I will say that I’ve gotten questions about using ReferenceEdge and functionality. That at least lets me know that team members are using it. The fact that they have questions and are trying to figure out how to do certain things shows that they’re engaged.
We ran a nomination campaign, right when we launched, for two weeks. So, now I just announced a new Spiff to our CS and Sales teams to encourage them to submit nominations and reference requests and do the profile update minder aspects so that we can keep our data clean and up-to-date.
We have not yet announced any external rewards to customers who do reference activities. Historically, we’ve given them gift cards, but we are in the midst of looking at platforms to do gifting, so we aren’t doing anything just yet until we have something formal in place.
We have the Slack integration, so, yes, we have that enabled to alert anyone internally in the program of nominations or requests. [Our Point of Reference account director]and I looked at the Program Health Monitor feature very briefly yesterday, but I wouldn’t say we’re using it quite yet.
Evan:
It’s kind of interesting because I lead a team of customer success managers whose roles are in part very similar to what our [Point of Reference account director]) does. My observation of her working with us is that I feel like she is delivering a rather bespoke and proactive up-market experience for us even though we are a smaller customer. I asked her what segment we were in, and she said we were on the smaller side, which I expected, but we never felt it, which is exactly the type of customer experience that we want to create for our customers. So, we’ve definitely felt well supported by her. I think the thing is that she’s just always available, and she’s very proactive and she drives the agenda, and she has recommendations. So, it’s almost like Customer Success on offense with her, which is definitely our goal. So, it’s been great.
 | a conversation with... Jessica Thomas Technical Solutions, Analyst, Benevity |
|---|---|
| Could you describe your program? | I manage the client reference program at Benevity. My title is Technical Solutions, Analyst, and I sit within the Pre-Sales team. We launched ReferenceEdge around October 2018. We have close to 100 team members with access to ReferenceEdge, including all of our sales reps and client success managers, across all the different time zones throughout Canada and the United States. |
| Where did the initiative to start a program originate, and why? | Benevity had a reference program before that we called 'BURT'—the Benevity Unified Reference Team, and we managed it through a different software product. We made the business case that we needed a reference-specific software application to manage reference activity at scale moving forward. We took on the responsibility of doing the research, finding ReferenceEdge, and learning how it would help Benevity streamline our program. |
| Who are your internal stakeholders? | Our primary stakeholders are the sales team, including our Regional Vice Presidents and our Senior Vice President of Sales, and then our Client Success Management team, which includes our VP of Client Success. We have a cross-functional working group that meets on a monthly basis to ensure our program is functioning well and address any challenges that may creep up. |
| What were your top 3 challenges before ReferenceEdge? | We really wanted to decrease the number of steps in the workflow because, at times, it would take two or three weeks to hear back from the client success team about whether or not a reference request was approved, and that was just too long. So, streamlining and speeding up the process were big goals for us. Another challenge that we were hoping ReferenceEdge would help us solve was salespeople going around the process by simply reaching out directly to their client contacts with whom they had established relationships, instead of going through the BURT process. We wanted to have software that would make the sales reps feel confident that using the application would yield the reference results they needed. We also didn't have a central place where we searched for attribute data to help ensure that we were connecting a prospect with a client that had similar characteristics, so that was another checkmark for ReferenceEdge. And lastly, reference overuse. We definitely overused a few of our clients, especially some of the larger, well-known name brands, and because we weren't tracking usage very well, we didn't know how often we ended up using some of those contacts. |
| Since launch, what has changed in terms of your company’s reference practices? | By using ReferenceEdge, everything is more streamlined because reference requests are going directly from a salesperson to the appropriate client success manager. We've taken out the client success managers' managers; which was a bottleneck for us in the past. Another major change we put in place with ReferenceEdge is having an automated process to include and exclude clients in the program. There's much more reporting that we have access to, and because of that, we can clearly identify things that we need to work on, such as decreasing the time it takes for requests to be approved or declined. Lastly, everything related to references is handled in one central location and, if anyone has questions or needs help, they know exactly who to speak with, which makes things very simple. Those are the things that have really changed and helped us grow the program. |
| Since launch, how has your job changed? | A number of different responsibilities fall within my role, and references make up about 15% of it. I really appreciate that I don't need to spend more of my time working on things that are reference related because I simply wouldn't have the capacity to get everything else done. ReferenceEdge has helped to save us time. I don't have to be involved in the majority of reference requests because they're going from the salesperson to the CSM using the peer-to-peer functionality, and they don't need any intervention from me. |
| What feedback have you gotten from stakeholders? Leadership? | About six months after launching, I reached out to our folks in Client Success leadership about how they felt the program was running, and they were so happy to be less involved in things. It was a time savings for them, and the general consensus was that the new processes with ReferenceEdge were running smoothly. That was such great feedback and really put me at ease. |
| What aspects of ReferenceEdge do you value the most? | Many! To start with, I really like the Reference Lead Finder feature. We enabled this pretty recently, and it allows us to find new clients for the reference program who have recently implemented the Benevity software product(s). It's a simple and effective way of getting new clients into the reference program. At Benevity, we are very heavy Slack users, so when ReferenceEdge released the Slack integration, that was another feature that we turned on right away. We've been really happy with how those notifications go to our client success managers and our salespeople. We've also been able to look at how many and which clients are getting used most frequently. If clients have been used two or more times within the last year, we send them a Charity Gift Card (funds they can donate to a cause of their choosing) as a thank you for helping us win more business. So that was another report that was really helpful to us. As an added benefit, I would say that I've learned a ton about Salesforce as a result of using ReferenceEdge. I know how to build custom reports, and I understand how data is populated into various fields on various record types. I'm really happy that I've had the opportunity to work more within Salesforce and up-level my skills there. |
| How do you measure program success? | Right now, we're focused on ensuring that as many reference requests as possible are responded to before their deadline date. On an ongoing basis, we look at peer-to-peer request outcomes and the peer-to-peer average time to complete. We are consistently working towards improving both of those metrics. |
| How does Point of Reference’s service compare with other vendors with which you’ve worked? | Our account director is awesome. She's been wonderful to work with and truly cares about the success of our program. She discusses new features and functionality with us, helps troubleshoot various issues, helps us create new reports and dashboards, and enable new functionality on an ongoing basis. We’ve been surprised and delighted at how frequently we are able to meet with her. We definitely appreciate the dedicated support that we receive through Point of Reference. |
Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry’s standard dummy text ever since the 1500s, when an unknown printer took a galley of type and scrambled it to make a type specimen book. It has survived not only five centuries, but also the leap into electronic typesetting, remaining essentially unchanged. It was popularised in the 1960s with the release of Letraset sheets containing Lorem Ipsum passages, and more recently with desktop publishing software like Aldus PageMaker including versions of Lorem Ipsum.
It is a long established fact that a reader will be distracted by the readable content of a page when looking at its layout. The point of using Lorem Ipsum is that it has a more-or-less normal distribution of letters, as opposed to using ‘Content here, content here’, making it look like readable English. Many desktop publishing packages and web page editors now use Lorem Ipsum as their default model text, and a search for ‘lorem ipsum’ will uncover many web sites still in their infancy. Various versions have evolved over the years, sometimes by accident, sometimes on purpose (injected humour and the like).
Contrary to popular belief, Lorem Ipsum is not simply random text. It has roots in a piece of classical Latin literature from 45 BC, making it over 2000 years old. Richard McClintock, a Latin professor at Hampden-Sydney College in Virginia, looked up one of the more obscure Latin words, consectetur, from a Lorem Ipsum passage, and going through the cites of the word in classical literature, discovered the undoubtable source. Lorem Ipsum comes from sections 1.10.32 and 1.10.33 of “de Finibus Bonorum et Malorum” (The Extremes of Good and Evil) by Cicero, written in 45 BC. This book is a treatise on the theory of ethics, very popular during the Renaissance. The first line of Lorem Ipsum, “Lorem ipsum dolor sit amet..”, comes from a line in section 1.10.32.
The standard chunk of Lorem Ipsum used since the 1500s is reproduced below for those interested. Sections 1.10.32 and 1.10.33 from “de Finibus Bonorum et Malorum” by Cicero are also reproduced in their exact original form, accompanied by English versions from the 1914 translation by H. Rackham.
There are many variations of passages of Lorem Ipsum available, but the majority have suffered alteration in some form, by injected humour, or randomised words which don’t look even slightly believable. If you are going to use a passage of Lorem Ipsum, you need to be sure there isn’t anything embarrassing hidden in the middle of text. All the Lorem Ipsum generators on the Internet tend to repeat predefined chunks as necessary, making this the first true generator on the Internet. It uses a dictionary of over 200 Latin words, combined with a handful of model sentence structures, to generate Lorem Ipsum which looks reasonable. The generated Lorem Ipsum is therefore always free from repetition, injected humour, or non-characteristic words etc.
Senior Customer Marketing Manager
Amplitude
First and foremost, the program focuses on providing the customer with valuable activities and perks beyond what they are paying for with our product. We consistently ask ourselves ‘What can we give them to keep them as advocates? What motivates them? How can we tailor the program based on customer interest and value?’
We officially launched our program in January 2021 and currently have over 150 advocates enrolled. Our customer champions span many different roles within their organizations: product managers, product leadership, data scientists, analysts, engineers, and marketers. And, we want to also engage the C-suite level with this program. That means we have to have a variety of advocate activities appropriate to the different roles and titles.
Within the first 30 days, I completed a comprehensive assessment of “all things customer marketing” at Amplitude. I saw that the head of Customer Success wanted a way to alleviate work from his team. Customer Success was doing so much for sales and marketing while also trying to do their regular jobs. With everyone coming to them, it was very hard for them to manage it all. He wanted them to have a scalable way to use their customers and have more advocates without sucking up every ounce of their time.
In 2021, I joined the Comms team where I now take the successes from the advocacy program and partner with our external partners to get the storylines out to media.
Across the top of all these stakeholder groups is the leadership team. With the executives, I make sure they are kept up-to-date and aware of my work.
Another problem was that there wasn’t a formal reference program— We were putting significant work onto the CS team to manage marketing and sales requests. It wasn’t scalable, and all the regions were doing different things.
Finally, there were no advocacy processes. There had never been a core team for customer advocacy at Amplitude so processes for marketing, product, and sales asks fell to the wayside. For example, if you had a customer that wanted to do PR, we didn’t have the connections or process to include them in media. There wasn’t a good way to coordinate a case study between the regions. There wasn’t a strong process for speaking opportunities. Really, nothing was in place or being communicated, so the regions were operating separately.
That was a big undertaking. I did an internal roadshow to talk to all the stakeholders about why they should care about customer advocacy, what it is, what good versions of customer marketing look like, what we have the potential to do, and what we’re missing out on because of our lack of processes. I was taken seriously as the expert in the area, which was needed to get these relationships with the leaders of sales, CS, and marketing.
Then, I searched for the perfect partner to be the advocacy program’s backbone. That’s when I found ReferenceEdge. My sales process was pretty seamless, and I had trust that they could help fill the gaps in our existing program. I worked with my team to create an implementation plan and training materials to get the sales, customer success and marketing teams excited and using the platform.
After my training sessions, people started to listen to what was being said, which is fantastic. The North American team started following all of the processes. It seems small, but I was most proud that they’d submit references the correct way — which is a huge step towards a functioning global program. I also saw big engagement in my nominations campaign (which I ran through ReferenceEdge). In the first quarter, I received 217 nominations globally and we are now working on regional nomination challenges to help fuel marketing efforts in APAC and EMEA.
Now, people are happy to follow the processes because they see the value in how strong references can affect their deals. At this point, everyone in the different departments and teams regionally is using the reference program. The number of advocates on our roster has just grown substantially.
I’m able to tell my organization the goals I’m tracking and where we stand with advocates at any given moment. All that we have accomplished is pretty amazing. We now have AMP Champs, two awards programs, and we just announced our customer brand campaign called ‘Digital Disruptors.’
I use the platform to do executive stakeholder management. I’ve found the dashboards to be a constructive way to disseminate the information. And then, I’m also using the workspace where I can see who’s putting in nominations for the reference program.
And then finally, making sure that we close the loop when it comes to how a reference we supplied works out. Sales can get alerts when their reference is complete. All that stuff enables us to expedite the process and hopefully close deals faster.
Another measure is the number of advocates created. We’re trying to scale the program globally to feed more of our awesome activities to our customers. I believe our goal is 254 by the end of the year, and we’re tracking wonderfully on that. So, that’s how we’re judging success with the CS team.
Additionally, we judge the program based on the number of sales reference requests submitted and completed. Before my time at Amplitude, we had no formal sales reference program, so there was no data around the revenue influenced from reference activities. Now, we are able to report revenue influenced related to completed references to sales leadership.
It could not be more night and day with Point of Reference. I see Point of Reference as a true partner as I grow and scale my program. My Account Director is just so great. She is so helpful and has made herself completely available when it comes to questions that I have, issues that we find, or if we need help with training anywhere. I meet with her weekly to discuss how the program is going or create something specific for executives. It’s made the platform more accessible for me, which is also just fantastic.
The results speak for themselves. Things have improved dramatically since I rolled out the platform. References being used more often and consistently. CSMs are spending less time on reference requests and more time on the account activities that are most important to them.
 | a conversation with... Delaney Tucker Client Marketing Specialist BlackLine |
|---|---|
| Please describe your program. | Our customer reference program sits within the client marketing team, a branch of our marketing department. We went live with ReferenceEdge in mid-January of '21 and have about 250 users globally. We use ReferenceEdge to standardize and simplify the advocacy reference request process while also providing a means of tracking other advocacy use cases, speaker requests, and documented customer marketing assets. |
| Where did the initiative to start a program originate, and why? | I joined the team in November of 2018 and took over sales reference request as well as a client rewards program through Influitive. As a fast-growing organization the legacy process, created long before I joined, we had to record any requests just barely met our needs. I was asked to fulfill the global reference needs with this legacy process. At the end of the day and at the rate of organizational growth, it was difficult to meet the needs. References are a vital piece of the sales cycle, as anyone who’s in advocacy knows, and it’s important to be able to scale with the sales growth. To that end, I started researching solutions, building a business case, and slowly started getting leadership on board. It took a long time, but we finally got approval to move forward. |
| Who are your internal stakeholders? | Our stakeholders include the sales team, both on the account management and new business, and our customer experience team. Our new business sales team are the primary users of the platform. They require reference calls and RFI/RFP contact listings for various opportunities. But our account management side use ReferenceEdge to request Best Practices Calls, or client to client use case discussions. They also use the platform to nominate clients for the reference program, client advisory boards, and our annual modern accounting customer awards. And of course, our marketing department. We have marketing team requests for clients for webinar speaking opportunities, virtual events, PR, and blog posts. |
| Tell me a little about your launch. What made it so successful? | Our launch was a success. We engaged Marketing and Sales managers in each region outside of North America to enforce the nomination campaign. We ran a regional SPIFF offering the top 3-5 individuals a premium gift item of their choice for the most champion nominations received in each region. We also used multiple communication channels to remind people to participate including email, calendar invites, ReferenceEdge office hours, team meetings, newsletters, and internal 'Coffee Breaks' with senior members of BlackLine. |
| What were your top 3 challenges before ReferenceEdge? | We had a few challenges. The biggest bottleneck that I personally experienced was not having any way to track client use cases. We didn't have a searchable database that supported the unique type of advocacy needs, and there are many, coming from our sales team. It took too much time to search the various internal systems just to narrow down clients who met the very specific or complex reference request. Another challenge was the time it took to complete a reference request. It was very difficult to complete a reference request within the timeframe allowed or needed by our sales team. It often took me a day to research, and four to five days to confirm an account. I wasn't too sure which accounts would necessarily do reference calls unless they had done a reference for us in the past. Additionally, advocacy duties were segmented. We lacked visibility into what others were doing and were recording client marketing uses in multiple places. For example, I would manage the reference request, someone else on my team would handle speaking opportunities, and someone else took care of case studies. There wasn't really any way for us to see what the other person was doing and no visibility into everything that was happening across the board with clients, what they were doing for us or who was in contact with them for an advocacy request. We wasted plenty of time looking for accounts that were already in the process of doing other marketing activities for us. Finally, we didn't have a standardized way of tracking to report and showcase everything we were doing. We couldn’t show the number of requests that were coming in over a given period of time, the type of requests, and the value that an advocate brought to BlackLine based on the deals the references were influencing. We also weren't able to showcase in one place the marketing assets—a blog post or case study—that we had in-process. |
| Since launch, what has changed in terms of your company’s reference practices? | I would say the benefits for us were quite immediate because it was vastly different from what we had the capacity to do in the past. The time to fulfill a reference request has dramatically improved. Our SLA pre-ReferenceEdge was about two weeks, but we've now significantly reduced that time. Two of my happiest success stories from ReferenceEdge include when we filled a three-contact RFP within 24 hours and a two-contact reference request in less than a business day. This was huge! Before ReferenceEdge, that would rarely happen, if ever – it usually took around two weeks. I've noticed a shift in how we're thinking about advocacy, you know? We're trying to think more proactively about building the advocacy pool. We have clients and leads to go to when we get last-minute or complex requests versus in the past when we would just be reacting to requests. Another positive change is not overusing our advocates—not necessarily only references, but speakers as well. With the ReferenceEdge nomination request form available within Salesforce, all of our account managers and account owners have advocacy a little bit more top of mind. That's been awesome. |
| Since launch, how has your job changed? | Today, my role has shifted from just reactively managing sales references to managing all advocacy within a specific revenue range for our clients. So now, all case studies and speaking opportunities for that space go through me as well. You could say that our role hasn't changed much because we're still doing a lot of advocacy, but ReferenceEdge has been our single point of contact for all of that stuff, which is fantastic. I'm trying to think of some other areas where the business is impacted, and I think that that's something that we're going to be able to showcase quite well down the road. Right now, we're just trying to track and use the reporting that is available to see the impact we’ve had to date. I think that sometimes working in customer advocacy is kind of relentless, you know? It's a lot of effort that people in this role put in and it's not always noticed. The statistics we're able to pull in the reports from ReferenceEdge–tracking all this data and information–speak volumes for what we're doing in the background. |
| What feedback have you gotten from stakeholders? Leadership? | Our sales reps like the platform because it has added transparency. They like the fact that they have some visibility into the requests. Previously, they would send us a request, and we would kind of run off into our client base and try to pull it out of the woodwork for them. Whereas now, they can see who is in our reference pool. Based on the information we have on the reference search page; they can see why we choose a specific customer for their unique opportunity. Our account managers also like that there's visibility into their reference accounts. In the case where a client is an active reference and there's a change in account ownership, the CSM has an easy little snapshot view. Our leadership team is loving the data points. By combing through the data we're pulling from ReferenceEdge, we can configure reports in Tableau for a nice snapshot for our leadership team. Statistics that we have never had access to before. And, our Customer Success Leadership Team may be interested in building out specific use cases for the CSMs. So, there's some excitement from stakeholders that weren't previously included in the initial evaluation. |
| What aspects of ReferenceEdge do you value the most? | The tagging capability would be at the top of the list. BlackLine has very complex solutions and we have new use cases come up all the time. Creating a new tag and tagging a client based on unique use case criteria is incredibly helpful. Another capability is being able to create that database we wanted and needed for so long in the first place. When we have new marketing assets, it's very easy to create a new referenceability type and attach it to an account. This allows us to know what accounts have been doing and have that historical data. I think that's a big feature that we're really taking advantage of right now and thinking hard about how we can build it out strategically for the future. For next steps, we are working on the Influitive integration right now. We're very excited about getting that up and running. It will enable us to pull self-nominated advocates from our rewards platform as well as push out reward points for anyone who completes a reference or any other marketing asset. Plus, we can push any challenges directly to our Influitive hub—so that's in the process. I know that that's going to be a really big win for us when it comes to our use of ReferenceEdge and building out our reference pool quite smoothly. The fact that ReferenceEdge was native to Salesforce was really important for our organization. Our legacy process was built in Salesforce, and we didn’t want any big changes for the sales team. Everything else that they use is there as well, so we wanted to make sure that we built it out correctly for our sales team. |
| How do you measure program success? | The things we're focusing on in terms of measuring program success start with building our advocate pool. At launch, we ran a nomination campaign for our global sales team and received just over 180 nominations. That was a big number for us to get from the get-go. We are also looking at the annual contract value that our advocates are influencing. We want to be able to show how advocacy impacts bottom line. In addition, the ability to track customer marketing assets that is critical. We track request type and how many requests we're fulfilling over a given period. We're using the platform to track all that data to show upper management and other stakeholders what we have coming up. It comes back to the effort we're putting in and how we're showcasing that internally. I think ReferenceEdge will be extremely advantageous for our organization and is in lockstep with our advocacy strategy. Our goal is to be an indispensable program for the business units we serve. ReferenceEdge helps us do that. |
| What is your experience with Point of Reference as a vendor? | I was really happy with all of the demos we went through, all the communication we had; they all seemed to have everything together, which was nice. But also, post-purchase and during implementation, they've been very attentive and responsive to our needs. I'll mention something in a meeting with my account director and forget that I said it, but then I'll get a follow-up on it next week. They're very responsive and attentive. |
| a conversation with... Sandi Montour Senior Customer Program Manager Mitel |
|---|---|
| Would you describe your program? | The Mitel global customer reference program currently resides within the sales enablement team in marketing. For the past nearly four years, I've been administrating our customer reference program. Our global program supports all products and geographies, including the Americas, EMEA and APAC. ReferenceEdge is the software tool that tracks and manages the overarching, strategic program, called the Mitel Ambassador Program. It’s in four languages—English, French, German, and Spanish—and provides public-facing information on the benefits and process. |
| Where did the initiative to start a program originate, and why? | The initiative started as a massive data integrity project with the reference system that ShoreTel had at the time. With the Mitel acquisition, the team took a fresh look at all of our systems, including our customer reference database. We considered the options and chose to replace the former system with ReferenceEdge, primarily because it’s a Salesforce native application. Since I was a Point of Reference customer for four years at a previous organization, moving to ReferenceEdge felt very comfortable – both with the technology and the business relationship. For the ReferenceEdge launch with the legacy part of our business, we cleaned up the data, decided what would be moved to ReferenceEdge and what fields to map to. Those stakeholders were relatively familiar with the concept of a customer reference database system and just needed to learn how to use the tool, which had a renewed sense of trust and excitement because of that data clean-up project. For the other part of the business, the legacy Mitel part, having a customer reference database system was brand new and very exciting. Internal surveys and feedback had shown that finding a reference was a top pain point for sales. Having a tool to solve that pain point was a big leap forward. |
| Who are your internal stakeholders? | Our stakeholders include sales, customer success, executives, training, product marketing, field marketing, brand and corporate marketing, user groups, PR, AR, and IR, product trials, and the RFP and activations teams. |
| What were your top 3 challenges before ReferenceEdge? | The problems across legacy ShoreTel and Mitel were ultimately the same: no metrics, no central hub for all information and activities, and no scalability. |
| Since launch, what has changed in terms of your company’s reference practices? | There's a greatly improved understanding of who our reference customers are and what they're doing with us and for us. We’ve seen a decrease in that scramble for references, especially for new salespeople who may not yet have a complete understanding of our customers. There's improved coordination amongst departments, like with the RFP team, product trials and the activations team. It has also increased our value to partners as an additional way for us to collaborate and help each other. |
| Since launch, how has your job changed? | Based on our self-service model with sales and customer success managers owning the reference process, my role is to manage the customer reference system and the program framework, training and tools to support it. For example, I’ve created customized how-to documents, videos and a learning management system course. This also includes my favorite practice of kaizen, which is the concept of continuous improvement. By connecting with and listening to my internal customers – primarily sales, customer success and marketing – and through the great insights of our Point of Reference Account Director and the constant innovation of Point of Reference, we’re always looking for – and implementing – ways to make the system serve our stakeholders even better. Our model also allows me to strategically develop and manage other programs such as the win reports and lead other special customer and partner-related projects. |
| What feedback have you gotten from stakeholders? Leadership? | There have been a lot of positive responses. A colleague in content marketing said, "I love how you are bringing structure to this very important part of our business." Also, a territory account manager, wrote, "Thank you for providing me an overview of ReferenceEdge last week. It was super-informative and helped me understand how powerful ReferenceEdge truly is. As many of our prospects usually ask for industry, size, location, and product-specific references, this tool is very efficient, easy to use, and will be a competitive advantage. In my career, I have not seen a reference tool like ReferenceEdge." And, after I met with a sales team and sent a follow-up email with resources, a sales vice president said, "I just happened to be on the phone with a salesperson when you sent this. She has one that should close this quarter and will be a nice success story. One cool thing about it is that she was able to move them forward based on references from our reference program." Based on the reports I send to leadership every month, they love seeing the increase in program adoption and the objective, hard data. In essence, the program adoption equates to more opportunities to showcase our customer’s success and our ability to quickly match our customers to the reference activities that are of interest to them. It’s the quintessential win-win. Leadership also appreciates the decrease in those urgent emails trying to find a reference, and the more efficient and focused process via ReferenceEdge. |
| What aspects of ReferenceEdge do you value the most? | First, that it's a native application to Salesforce, so there isn't an additional or different login. We meet sales, our key internal customers, where they already are. Another one is the Gainsight integration. We’ve set up automated processes around the Net Promoter score, contract renewal date, and the overall health score. Based on the numbers reported in Gainsight, we automatically set a customer in ReferenceEdge to 'caution' or 'inactive.' With the contract renewal date, we automatically set a customer back to 'active' when they renew. The customer success managers have especially loved this because it doesn’t distract them with reference requests for customers who may not be currently appropriate. The Gainsight integration further streamlines our processes – and based on our own data and criteria, which increases the trust and confidence in the system. For the overall health score, on a monthly basis the customer success managers and I receive and review a report of the scores. The customer wellness score is based on a variety of internal indicators and provides us with evidence-based, valuable leads for our reference program. Another function that I value is Reference Lead Finder because it streamlines and automates the process of identifying customers who may be appropriate for our reference program. It saves time and harnesses the beauty and power of software. No one needs to keep a list or remember which customers closed 'X' number of months ago. It automatically prompts us to check on a customer’s readiness and provide the option to send the notification to somebody else who may be more appropriate to answer the question. With the reference content functionality, along with case studies, we've also added our win reports. These are internal only reports that provide additional sources of insight that may help win business, and they're searchable based on the same criteria as reference contacts. We’ve also enabled advanced request routing. With the Advanced Request Routing capabilities, supervisors can respond to reference requests for team members/account owners who are out-of-the-office, which keeps the process moving forward at a critical time in the sales cycle. And, of course, the customizable reports and dashboards show all of the objective, hard data needed for the reports to leadership -- in a single place. |
| How do you measure program success? | The primary ways we measure program success are revenue influenced by the month, the year, percent increase, and by the number of new references. As of July 2020, our revenue influenced is more than 122% higher than all of 2019. |
| What is your experience with Point of Reference's service? | Our account director is a true business partner. She’s always thinking of how to improve the tool for our unique environment and needs. She's responsive, creative, patient, knowledgeable about the tool and the industry, highly professional, and an absolute joy to work with. She's made the overall experience with Point of Reference a very positive one by taking a keen interest in our business and how ReferenceEdge can help. She relates well to all stakeholders—so beyond me as a reference manager to include our representatives from IT and Salesforce support and anyone she interacts with. Our ReferenceEdge implementation and our program would not be what they are without her. |
 | a conversation with... Kate Restaino Customer Marketing Program Manager Samsara |
|---|---|
| Would you describe your program? | Our customer reference program is primarily a sales enablement function led by the marketing team. It is focused on helping our mid-market and enterprise sales teams find the right customer references easily and making sure that we're tracking our conversations and interactions with those customers. We have a twofold mission: one is to make the lives of the account executives (AEs) easier, and the second is to be able to track our interactions and the impact of those interactions on the deal cycle on the back end. |
| Where did the initiative to start a program originate, and why? | The initial idea came from my supervisor, who is the marketing manager, and her colleagues on the sales side. It grew out of Samsara's desire to grow the sales organization. They saw how quickly our sales team was growing and that we needed a better way of scaling our reference process to match. The question we faced was, "How can we enable our global sales team, and can we give them tools that are going to increase their efficiency and drive deals to close quicker?" |
| Who are your internal stakeholders? | We have multiple stakeholders beginning with our marketing leadership. The stakeholders we really try and align with all the time are sales leadership. We want to make sure everybody on the sales team is aligned and understands our KPIs for the quarter, the program outcomes, and how they are going to benefit their organization. Mid-market and enterprise sales leadership are our significant stakeholders there, and additionally, we're looking to create an ongoing dialogue with managers, directors, and VPs. |
| What were your top 3 challenges before ReferenceEdge? | One challenge was efficiently responding to reference requests, which we had previously handled through internal messaging channels. The customer reference program automated and streamlined the process. Samsara has a large sales team, which required a more streamlined process with an actual database. An internal messaging channel didn’t provide the efficient framework that ReferenceEdge has in place. Our second challenge was tracking our interactions with our advocates because, a) we don't want to overuse them, and b) we also want to make sure we are using good advocates who might not have been used before. And then our third challenge was tracking our impact on sales. Enterprise sales is a company-wide focus. Reference calls happen on almost every enterprise deal, and we had no existing workflow to systematically track the outcomes of those. As the company was growing its enterprise sales business, we realized that enterprise sales are significantly affected by reference calls. Leadership wanted to understand the impact of the deals on end-of-quarter numbers, end-of-year numbers, etc. |
| How did you launch your program so successfully? | We had a pretty big launch with global events. We made it an event because it's obviously a major work shift. Our approach to our sales teams was, "This is going be your new best friend, and this is actually going be a gamechanger for you." We also provided incentives to our AEs. The first quarter was all about making it fun for the sales representatives (“reps”), and now they've adopted it. We've also created a program so that each time a customer takes a reference call, they get a reward—which is another big incentive for our reps to use the application. |
| Since launch, what has changed in terms of your company’s reference practices? | We've gone from a message thread culture to a ReferenceEdge culture for customer references. Now the default is to go to ReferenceEdge first and then work backward if you can't find anything. I think the biggest changes have mostly been about streamlining our process. We're saving AEs quite a bit of time on finding a reference. References are always needed, and we're enabling AE’s to find references by themselves—and to find good ones. AEs can search for a reference based on specific attributes like integrations, previous camera provider, previous telematics providers, etc. |
| What feedback have you gotten from stakeholders? Leadership? | Our mid-market team has been loving it; they like that they can go in right away and select somebody instead of waiting on somebody to respond in a large message thread. We're a pretty fast-paced culture overall, especially with sales; they want to get their deals done, and they want to get them done quickly. I think they love that it takes less time to find a reference, and more importantly, they love being able to filter references on use case. We’re still transitioning other teams that are operating in a more remote basis, and those reps are getting more excited about the program over time. |
| What aspects of ReferenceEdge do you value the most? | Being able to create search filters around use case, geography, and segment has been the most helpful; that was our number one request from the sales team. Since we have so many products, having a centralized database where you can filter on products and all the other attributes is just so important. We want to set our prospects up with customers that have a similar use case or are in their same geography or same size. Before ReferenceEdge, there was no real way to do it; now we can. Our AEs go into ReferenceEdge, and they're pretty much guaranteed to get one or two references coming back with a 'yes,' so they can just set their prospect up with them right away. Another thing is figuring out and being able to better track and understand who our top advocates are, and then being able to leverage them for other activities too. A big part of customer marketing is figuring out which customers we want to leverage for a specific advocate opportunity. Having all this information now in one place allows me to see when they've been used, how they've been used, what they've influenced more systematically. We position ReferenceEdge as a sales tool, but it's also been great for events and for marketing communications because those teams are able to request happy customers for their activities too. Now everything is streamlined, so ReferenceEdge has been a benefit for these other groups as well. |
| How do you measure program success? | Our initial goal during rollout was to get a certain number of advocates into the database and requests processed through ReferenceEdge; we met our initial goal this quarter. On average, we're going for a 20% increase in the total number of nominations and requests per quarter. We also now have an enterprise focus, so we have specific KPIs for that. We try to measure everything, and we have pretty extensive dashboards. To measure program success, I have an executive dashboard that gives a high-level overview of the program. We have an enterprise-specific dashboard that shows how we are engaging with enterprise reps, enterprise leadership, and marketing leadership. We also have a more general sales dashboard that tracks different aspects like the total number of nominations, the total number of requests, who's nominating the most, and who’s requesting most. It tracks our more detailed KPIs as opposed to the executive dashboard, which is just tracking high-level KPIs. |
| What is your experience with Point of Reference’s service? | Our account director has been great. We had a couple of issues with some attributes and reporting prelaunch, and we were able to get the right people on the phone immediately to figure those out; that would have delayed our entire launch had we not figured it out. Point of Reference is very responsive in that way. |
| What are your future plans for your program? | We have big plans for what we can do with the advocates, and we want to get them as involved as possible. We’re on the pathway, but we’re only five months into the program, so it’s still laying the groundwork and ensuring the foundation is strong first. In addition to the sales team, our marketing communications team is starting to become more involved because ReferenceEdge has a referenceability type for press activities. Our marketing communications team was not an initial stakeholder, but they're finding that it's been really helpful to request time with the AEs to figure out which customers would want to participate in press activities. We can also see how using ReferenceEdge may be a tool to help our product management team figure out which customers Samsara might want to be used for beta testing. Moreover, our product marketing team uses ReferenceEdge all the time to identify customers for case studies, webinars, etc. Our marketing team has also partnered with our legal team to start using ReferenceEdge to track which customer logos we can use for marketing purposes and which ones we can't. These examples are not our primary use cases right now but definitely have an impact. |
 | A conversation with... Wendi Wolfgram Senior Customer Advocacy Manager A10 Networks |
|---|---|
| Could you describe your program? | Our global customer advocacy program has been ramping up over the last few years. A10 Networks has a lot of great customers, and we wanted to share their expertise and knowledge of our solution. To do that, we wanted to build a program to share our customer stories and build stronger relationships with our customers. Part of that was implementing the ReferenceEdge solution. The program includes content: written customer case studies and video testimonials. A lot of work goes into creating internal documents such as customer success slides, which we use to highlight a customer story. Additionally, we kicked off a customer advisory board and relaunched a customer community on a new platform. We have around 7,000 customers across the globe, and we are on tap to have roughly 10% in the advocate program in some way by the end of our second year. |
| Where did the initiative to start a program originate, and why? | A10 did not have a structured program. It was bits and pieces here and there with various marketing owners. A10's marketing leadership recognized that A10 needed to manage a formal program to leverage customer testimonials and provide a better user experience for our customers. You know, they say happy customers equate to lifelong customers and continued business, and I think it's a good way for A10 to be seen, as a partner, with lifelong customers and not just another vendor. A10 had already done quite a bit of solution research before I arrived. I believe they realized right away that ReferenceEdge was a really good fit as that foundational tool on which to build a program. I was brought on initially as a consultant to get the solution implemented and up and running, and then roll out a formal program. Once I did that, I was offered a full-time position to manage it going forward. |
| Who are your internal stakeholders? | Primarily sales, but also the events team and PR. Occasionally our CMO and CEO ask me to support an activity of theirs. We also respond to quite a few RFPs, so that team depends on our program heavily.” |
| What were your top 3 challenges before ReferenceEdge? | A lot of the challenge before ReferenceEdge was tracking customers on multiple spreadsheets, which was ineffective and inaccurate. When I first came on board, that's what I was given; multiple very, very large spreadsheets of customer account names and contact names and notes here and there about their reference status or if we had content featuring them. That's just unmanageable. They also saw a lot of missed opportunities to leverage customer content because it wasn't centralized. And, of course, probably too many email blasts hitting global sales when customer reference information was needed; that was not manageable, either. We just didn't have a good handle on how to find customers that were using our solutions by specific use cases, and now that we have ReferenceEdge in place, it's much easier to manage all of this. |
| Since launch, what has changed in terms of your company’s reference practices? | ReferenceEdge gives A10 that centralized tool to be able to track reference customers. It's that one place for sales to go for reference content and answers. We have automated processes to collect the sales win information easily and then disseminate that across the company. Prior to ReferenceEdge, sales wins were collected as Microsoft Word documents. We collected them and stored them in a Salesforce library, but they weren't easily searchable, and there was no way to tie those wins to accounts or report on them. Now with ReferenceEdge, we can easily report on the data that's collected. We can even identify who responded and who didn't, and then we can share that information with other parts of the organization. Our process includes escalations to the managers to collect that data from slow-to-respond account owners. We recently implemented an automated process to update reference account and contact profiles using ReferenceEdge with the Profile Update Minder feature. This feature helps to keep our reference data fresh and up to date—and it's all automated. It doesn't require me to manually dig through the database and figure out what's current and what's not. We can automate that process, and account owners can make the necessary updates. |
| Since launch, how has your job changed? | The first year was all about administrative activities, program creation, and implementation of ReferenceEdge along with promoting content. Going into the second year, it's more about increasing customer participation along with new content development. I now have more time to spend on specific projects and relationship development with internal stakeholders and customers. |
| What feedback have you gotten from stakeholders? Leadership? | It's all been really very positive from the start. I've had strong backing from the sales and marketing leadership who see the value of having an organized and centralized program. I send out weekly news flashes to most of the company, announcing new wins and new customer content. I receive positive feedback from other parts of the organization beyond sales, too—just like "Hey, this is great to know, I always enjoy learning about our customers." This information wasn't being shared in an organized manner before. So, now that we have a formal program, everybody knows this comes through the advocacy program. |
| What aspects of ReferenceEdge do you value the most? | I think what I value the most from ReferenceEdge is the ability to centralize and track the accounts, the contacts, and the content and then have all that tied together. ReferenceEdge being a native app within Salesforce is a must. Without it being part of Salesforce, the management isn't the same. I think that's huge. Being able to search for references and content by meaningful attributes is so helpful across the organization. Data Collector has been a real win for the advocacy program. It's even used by our operations team to leverage sales input about key wins to share for quarterly earnings or company meetings. Before this, the task was very siloed, and sometimes multiple departments would ask Sales for that same type of information. Now, the question is asked once, and that information is easily shared across all those departments. So, for me, that really was a huge win this first year. |
| How do you measure program success? | So, in this first year, measuring internal use and changing their behaviors is probably the number one measurement. Changing internal behaviors is probably the number one challenge. Once the sales team sees the benefits not only to themselves but to the overall company and they trust you as a key component to their relationship-building with the customer, then it becomes a win-win. Another measure is the program growth: the number of customer nominations for the program, content creation, and expanding how customer references can be used. For content, we're looking at how many win stories, customer quotes, and reviews we have overall and by each product line. Being able to tie revenue to the program is always a goal, but with A10, I've found that it's more important, at least for now, to arm the A10 sales team with customer names for namedropping and to share how those customers benefit from the A10 solutions. Once the sales team realizes the benefits not only to themselves but to the overall company (and they have to trust you as a key component to their relationship-building with the customer), then it becomes a win-win. At that point, I can track and follow the customers' journey easier through the ReferenceEdge tool by capturing that win story, following up to get the nomination, and then determine how we might leverage that customer for future marketing use. |
| How is your relationship with Point of Reference? | Point of Reference has been really wonderful for me to work with over the years (at a few different companies), and it's a true partnership; they actually do listen to their customers. I've always felt that if I require a new process, or for something to work a little bit differently, that they listen. I've had a few different account managers over the years with Point of Reference and have always been treated very well. They'll always consider my requests, and they either make it happen, or they might suggest a new way for me to think about that issue or that business problem based on industry best practices. |
| What are your future plans for your program? | Now, it's definitely all about program growth. As I said, the first year was for implementation, setting the foundation, identifying the processes, rolling it out to sales users, and then continued education. I think the second year will be more about increasing the participation—getting the program's internal customers, primarily sales, to nominate customers and getting new customers to participate. I'm going to focus a lot this second year on looking for ways to speed up our content creation. I'm thinking about integration with a community platform or maybe integration with third-party review sites; those might be other areas to investigate. I want to also focus on other initiatives, such as creating more exclusive groups within our overall customer advocacy program. We can then focus on customer relationships with our strongest advocates and provide a more unique experience with them. Having ReferenceEdge as a foundational tool makes managing reference initiatives so much easier. Customer advocacy touches all parts of the business, not just sales, and marketing. Anybody in the company that has interaction with the customers, this program can relate to them or can be a part of their plans as well. We want to be able to motivate the employees to let them know 'Hey, we have all these great customers. You all should be very proud of where you work.' Having the foundation of ReferenceEdge gives us the power to expand the advocacy program and focus on customer relationships. |