Assessment Technology

Talent Management: 5 Reasons Why Choosing an Assessment Vendor Can Be Hard

Tuesday, January 17th, 2012

Wordle: Assessment Vendors 2012Now that we are halfway through the first month of a new year, we can turn away from celebrating the holidays, reading predictions and making resolutions – and get down to work. For many organizations the first quarter starts with a bang as a fresh fiscal year infuses departments with budgets to buy new and shiny tools or services to implement new processes.

Be honest – you know this is true.

For HR Talent Managers the new year brings a chance to find a solution to the ever-challenging needs of the organization to put the right people in the right roles at the right time, in order to achieve business outcomes. And the only sure fire way to find the right people for a job is through talent measurement, aka assessment.

No need to go into details about the benefits of well-designed assessment processes, because you likely wouldn’t be here reading this if you didn’t agree. So, cutting to the chase – it’s not all that easy to find your perfect match in the world of assessment providers.

Choosing an assessment vendor can be hard because:

  1. Assessment is a complex topic and understanding it can be confusing.
  2. There are literally hundreds of assessment vendors and it is hard to tell which ones are good and how they differ from one another.
  3. It’s not just about choosing tests – you need to build a process first.
  4. Despite what your vendor may say – not every assessment strategy is effective in every situation.
  5. Assessments do not live alone in a neat box, but instead need to play well with your organization’s other talent technology. Uncovering whether or not a vendor is capable of integrating with your systems can be time and cost consuming.

If  you find yourself lost in this confusing labyrinth of a ‘vendor selection process’ with no map, instructions or magical abilities, you should consider using our own Buyer’s Guide to Screening and Assessment Systems v3.0

As you can see by the 3.0 appended, this is the latest addition of a popular tool we first published 10 yrs ago. This newest edition provides even more expert, objective details about talent measurement vendors. We cut through the smoke and mirrors to help you make informed decisions, ultimately saving you time and money.

Check it out now, then you can get on to achieving other pressing business goals.

 

Enhanced by Zemanta

“Everything in the future online is going to look like a multiplayer game”- Eric Schmidt (CEO, Google).

Wednesday, July 20th, 2011

So, besides causing serious concerns about personal privacy, when has Google ever been wrong?  I am sure they have had a few projects that have not worked out but few can argue that they have been a major driver in the evolution of the web.  I was almost moved to tears by Eric Schmidt’s words because they are in-line with my thoughts about the future of assessment.  As new technology has become available it has been applied to solving problems and creating opportunities in all walks of life, from banking to shopping, to dating to hiring.  Why should we expect this trend to stop now and why should we expect that hiring and pre-employment assessment will be exempt from this truisim?

While the world of assessment still has one foot firmly in the horn rimmed paper and pencil world from which we came, we are slowly marching towards a new era where complex relationships in data will fuel amazing levels of insight and the ability to support decision making.  A big part of this march forward will involve the simulation of reality in a manner that is highly interactive, educational, and relevant.  What the specifics of this will look like are unclear as we have still to wait for the technology that will allow it to happen.  It’s pretty exciting stuff and it’s going to happen faster then you think.  Just turn the clock back 20 years and think about what luddites we were faxing things back and forth and storing our info on those big floppy discs that have 1000 times less capacity then my USB ink pen.

Please do note that I do not advocate removing humans from the decision making process.  I still see the role of game like simulations in the hiring process as collecting data and providing insight based on it.  As long as it comes to decisions about people and their lives, we humans need to remain involved.

Rocket-Hire is 10: Reflections on a decade of testing

Friday, May 20th, 2011

We are very excited to announce our Tenth anniversary!!!  That’s right, through good times and bad we at Rocket-Hire continue to work hard to promote the benefits of best practices based screening and assessment programs.  For testing geeks like us, the past decade has seen some very very exciting innovations.  It is easy to lose the forest for the trees, as our daily efforts to implement assessment often keep us focused on the issues that still hold us back. In reflecting on the past decade as a thought leader for the assessment world, I have worked hard to refocus on the big picture and zooming out to the treetops has presented a view that is extremely positive and encouraging.  This vantage has reminded me that we have seen some quantum leaps in the testing game that have made the use of pre-employment screening and assessment an even bigger value add then ever.  Here is a quick review of the big picture when it comes to innovation and progress in our industry over the past decade.

#1: Test usage has crossed a major plateau- Ten years ago the testing industry was in total plateau mode.  Uptake was at the same level as it had been for decades with a handful of firms, mostly test publishers and consulting firms offering administratively heavy tests in two modes.  Ten years ago one could either buy a test off the shelf and drop it in place, sometimes doing validation work to support its use or sometimes not; or one could hire a consulting firm to do an expensive local validation study using their own content.  These options and the universal truth that testing required a good deal of resources to administer and manage, cost a butt load of money, and provided a cold war-sih icky feel to those taking the tests; served to really keep testing down.  We are way past all this now!!  Test uptake and the available revenue from selling tests has skyrocketed based solely on our friend, technology.  This technology enabled shift is the #1 big picture trend in the past decade.  This shift has been facilitated by several other important trends (discussed below).

#2: Data shows us the truth- Ease of administration and increased uptake have allowed us to capture millions of data points.  This information has greatly accelerated our understanding of what job performance is and how to accurately measure it.  We really do know how to accurately measure the traits that drive important work outcomes such as customer service and how to predict which applicants are most likely to achieve these outcomes.  This knowledge serves as the basis for increasing speed and accuracy in testing.

#3: Methods of demonstrating validity are changing- Please note, I am not saying that the concept of validity itself is changing.  I am saying that we have increasingly powerful tools to help us configure job relevant assessment content for local situations (thanks to Trend #2-above).  Most vendors have begun to bake a good deal of flexibility into the process and tools used to configure assessment content, building on the data they have harvested and then allowing end users to lightly customize their specific measurement model.  In a way this is the holy grail for validity as we begin to see criterion, content, and transportation of validity strategies merge to show us what content is correct for a given situation.  Isn’t this kinda what Landy (1986) was talking about when he rejected stamp collecting in favor of identifying ways to show how the rubber meets the road when it comes to showing a relationship between predictor and criterion space?

#4: Remote, unproctored testing is here to stay- Like it or not, there is no way to beat the convenience of remote testing.  I have served on more panels then I can remember on this topic over the past decade and all have reached the same conclusion, we do not have any strong evidence that remote testing is a problem.  This does not mean we can ignore the fact that we need to be vigilent.  Again, technology is our friend as we enter the age of IRT driven adaptive testing and increasing security tools such as bio-metrics.  The interesting thing in the decade to come will be the acceptance for remote testing via smart phones.  The jury is still out on this one.

#5: Candidate experience is becoming a key driver- A decade ago it was still common to see 2 and 3 hundred item long tests that asked question with no perceptible link to the job performance domain.  This is no longer the case as we begin to explore ways to increase simulations and games that make the assessment experience transparent and can easily be woven into employee branding.  This will be one of the most significant trends over the next decade as we begin to put the radio buttons of decades old personality tests in the rear view mirror.  If nothing else, the next generation of job applicants will begin to demand this type of treatment, and I really believe that this population is going to begin the redefinition of terms like “job” and “career” forcing us to adapt our hiring and assessment processes.

#6: Assessment is becoming an integral part of the employee lifecycle- We continue to see progress (albeit slow) towards a more unified vision of what talent is and how it fits within the organization.  Assessment has long been used as a tool for succession planning and development.  But there has been no continuity with the information collected during the hiring process.  Most of this time this info is basically industrial waste, going down the drain and taking value with it.  The rise of a talent management mindset has started to help promote a more strategic focus that covers the entire employee lifecycle.

All of the trends above have combined to open the door for increasing levels of value from assessment based on new levels of efficiency and effectiveness.  I encourage our readers to take a moment to reflect on just how far we have come.  Don’t even get me started talking about what we can expect to see in the next decade.  Almost daily I am seeing testing firms leveraging cool new technologies to help meet the end goal of providing realistic, accurate and efficient ways to predict applicant performance.   Just prepare to have your mind blown wide open.  The strong forward march of technology is going to make all aspects of our lives extremely interesting (and maybe a bit scary?).

Hot News: Thoughts on the PreVisor and SHL merger

Friday, January 14th, 2011

In what is is surely the biggest move in the history of the pre-employment assessment space, PreVisor and SHL have joined forces to create the largest and most far reaching assessment company in the global market. Note this is a true merger with both companies’ private equity owners coming together such that one entity does not “own” the other.

So, why did this merger occur? Its actually pretty simple. Both organizations, while being quite strong in many areas, are less strong in others. True to the idea behind most mergers, the combined entity allows for a whole is greater than the sum of its parts scenario. For example, PreVisor offers the best technology platform in the business and leads the market in driving innovation but they lack a truly global reach. Furthermore, PreVisor’s approach to creating modular scales that can be “stacked” into situationally customized tests means they are always hungry for quality content. On the other hand, SHL while less competitive here in the US, is a powerhouse when it comes to assessment in other countries around the globe. Furthermore, SHL, while having a very sound stable of great content, has traditionally not been a strong technology player or a force in innovation. You do the math and see that these strengths and weaknesses are highly complimentary and will allow the bigger entity to be a serious player in global technology based assessments of the highest quality.

So what does this mean for the assessment space? We can’t know for sure but I expect that it will continue to drive the major trends we have been seeing unfold over the past few years. Namely increased aggregation within the HCM space, increases in the uptake of assessments, the continued commoditization of assessment content, an increase in assessment innovation, and an increase in the global use of assessment, including an increase in the presence of unified assessment programs amongst multinational corporations.

You may wonder what the drawbacks of this deal may be. Besides the obvious need for some time to get all the details sorted out with merging all aspects of the companies while removing duplication, I think the movement here is towards the ability to offer easily tweaked content in a very transactional manner. While this is not a bad thing at all, I wonder how such a big company will ensure the highest levels of customer service and how they will align to create high touch custom work. I’m sure these things will be sorted out but going for the gold globally is bound to make keeping the high touch element something to work on.

Overall, I feel good about this merger. I know both companies well and have a lot of respect for each of them. They are both innovators in their own way and now they have a chance to combine forces to really accelerate the cache and value of pre-employment testing

Webcast Preview: Top 5 Assessment Innovations for 2010

Monday, February 22nd, 2010

I am honored to have been asked to team up with my friend and colleague Ken Lahti of PreVisor to conduct a webcast about innovations in pre-employment assessment.  I encourage anyone who is interested in learning about the newest trends and what they mean for the long-term future of assessment to join us for the webcast.

Here is a preview of the top 5 innovations we will be discussing:

Evolution of technology platforms- Many assessment vendors are now offering a technology platform that greatly adds to the usability of assessments.  These platforms provide the ability to quickly configure assessments, manage applicants through the hiring process and provide flexible reports to help support good decision-making.   These platforms have the most benefits for small to medium sized businesses because they provide access to many of the functions previously available only to enterprise level users.  Today’s assessment platforms also support easy integration with other systems, allowing users increased flexibility.  This trend is an important because it reinforces the fact that assessment is not always just about “a test”.  The ability to configure, manage, and interpret tests is also essential to the success of any testing program.

Off the shelf tests- The past decade has seen a huge increase in the amount of assessments that have been given and as a result we have unprecedented amounts of data about what assessments work in what situations.  This has allowed test providers to create a new generation of off the shelf tests that are more accurate then ever.  In the past, using an off the shelf test meant that you may end up missing some important constructs and measuring others that were not relevant.  Today’s off the shelf tests, while still general in nature, are able to provide excellent information about a candidate’s potential for specific types of jobs (i.e., customer service, sales).  These tests have also made quality testing more accessible to small and medium sized businesses.

Improved security- Test security has been a hot button issue since the start of Internet testing.  There are legitimate concerns about remote, un-proctored testing that have definitely limited the uptake of testing.  Despite this research and practice show that security is not seriously compromising the effectiveness of testing.  More good news here- many vendors have begun to offer solutions that greatly reduce the risks involved with remote testing.  The best amongst these utilize advanced computer adaptive testing techniques to ensure that every test is slightly different but provides equal measurement results.  Advances in biometrics will allow for increased ability to ensure that the test taker is actually who they say they are.  Remote testing may never be fully secure but advanced strategies for test security will continue to help provide piece of mind for those using remote testing.

Better simulations- Simulations have always been an excellent way to provide test takers with a realistic assessment experience while also measuring ability to perform a specific job.  The future is very bright when it comes to simulations but there are still significant barriers to be overcome.  Simulations are expensive to create and they are still relatively basic.  It will take new technologies and innovative thinking to create simulations that can realistically approximate a real job.  The exception here is call centers where some really great simulation products are readily available.  Another type of simulation that is really strong is the on-line in-basket.  These exercises measure how well a candidate can communicate, solve problems, and interpret information by simulating a real work environment.

Integration with broader talent strategy- Assessment is slowly moving away from its academic and clinical roots towards a more business focused future.  The most significant force in this regard is the ability to link assessment results directly to business outcomes and to other people-related functions within the organization.  This has traditionally been a challenge because of the extra time and effort required to set up measurement systems and a lack of strategic vision around the value of assessment.  The change in mindset is happening, but has proven to be unfolding slowly.  An increasing number of vendors are working to create products and systems that are focused on bottom line results and on integrating assessment into the bigger picture.  I believe we are really at the tip of the iceburg when it comes to this trend.

On-line assessment is really only about a decade old and looking back, we have come a really long way in a short time.  The next decade is going to bring some changes that I feel represent quantum leaps forward and the issues discussed here.

Welcome To Our New Website

Thursday, November 19th, 2009

Rocket-Hire is excited to announce the launch of our revamped website!

Besides providing the usual stuff about who we are and what we do, our new site maintains our mission of providing useful information and expert commentary about the use of pre-employment assessment tools within the modern recruitment and hiring process.

Our new site offers several easy ways for readers to share our views and opinions:

Blog-
First and foremost is our new blog feature.  Our blog supports our core mission of providing expert, unbiased information about everything related to pre-employment assessment tools.  It will also help support our mission to bridge the gap between the science behind assessments and their practical application.  To these ends, we plan to use our blog as a forum to share our thoughts and opinions about news and trends that are shaping the future of technology-based hiring and pre-employment assessments.  We are excited about sharing our opinions on news and hot topics from our field, and we invite others who are interested in these things to join in the discussion.
Make sure to try the RSS feature, which will allow you to sign up to automatically receive our blog posts.

Twitter-
Rocket-Hire is now on Twitter, so be sure to sign up to follow us.  We will be tweeting news and information we want to share, including notification of new blog postings.  We are excited about keeping in touch with you!

Articles and research-
The new site will continue to provide us with a way to share our latest articles, research and whitepapers. Over the past 8 years, we have been writing articles for the Electronic Recruiting Exchange and other media outlets, cranking out lots of useful whitepapers, and publishing our own research.  Our new site provides an easy way for you to access all of our various writings.

We look forward to keeping in touch with you. Enjoy the new site!