"To test the effectiveness of any solution, you have to be objective and see if it genuinely addressed the problem it set out to solve. Everything in our business runs on KPIs, so when we introduce any initiative, we can see how it is or is not impacting those measurements. One example of this was when I assigned specific accounts to my team of buyers, instead of just attaching as they came up. The idea was to get a buyer to become an expert on that account, their buying habits, and therefore be more effective in the long term at sourcing for their needs. At first, it didn't seem all that impactful, as the close rate was still around 42% overall. However, over the course of 10 weeks, we saw an uptick in close ratios on the assigned, dedicated accounts versus the randomly distributed ones, resulting in 53% close ratio. It's something that became so effective that other sales pods adopted it as their practice as well."

"I like to collect data, as well as anecdotal assessments of new policies. It's great to have data to confirm if it was or was not effective, but I am a firm believer, too, in getting the team on board. Plus, as you implement a solution, sometimes those doing the actual day-to-day work with customers or in the actual implementation have a more accurate understanding of what's going on or what could be improved. Therefore, I am sure to ask the staff how they think it's going, if it's impactful, or what they still see as an area for growth."

"For me, numbers play an important part in teaching but do not paint the full picture. So, after implementing a change, it is certainly important for me to collect data from our unit tests to gauge the efficacy of the lessons we're teaching and the lesson plans we are using. However, I also am sure to check-in with the students on a more regular basis to check for comprehension. Testing is only truly reflective of the way some students learn, whereas others are terrible test takers, even though they've learned the material. That is why I like to take a two-pronged approach."

"One solution that I recently implemented was the use of Google calendar with the executive that I support. She was rarely updating her Outlook calendar because she found it to be too difficult to do on her smartphone. Since this implementation, we have minimized our crossed wires significantly! I have measured the effectiveness of this new calendar strategy by marking down any appointments that need to be rescheduled. So far, for the month, the number of reschedules is down by 80%."

"Once our team comes up with a new marketing strategy for a client we will conduct two focus groups. One test group will be on the original marketing plan and the second, on the plan that we want to pitch. The use of focus groups is the best way for us to measure if our new strategy will be effective enough to justify the changes for the client."

The interviewer wants to see that you have strong follow-through skills and the ability to use data and analytics to support your decisions. The only way to test the effectiveness of a new solution is to keep a close eye on the immediate, and often longer-term, results!

Depending on the situation, you can use data, run reports, and compare/contrast your findings. If you have records of the data before your problem-solving solution, you can track the results of your new solution and analyze in a month, or beyond.

It can take time to see the results, so having a method for measuring them is essential. Give an example of a time you implemented a solution and found a way to measure the results to check its efficacy.

"Last year, our company was having a very high rate of turnover due to employee burnout during overtime hours worked. I implemented a third shift which alleviated the need for excessive overtime. Yes, it did increase our payroll costs by 33%; however, it decreased our turnover which was costing us more and more every year. From the analytics I have been watching, the change will pay for itself by the end of year two."