Manual Review is the process of human reviewers painstakingly reviewing documents collected as part...

The Elusion Test is a validatory test run at the stabilisation point of a Technology Assisted Review (or TAR), that estimates the accuracy of your active learning algorithm in identifying relevant documents. There are two types of Elusion Tests, allowing you to run tests specific to your data and desired outcomes, these tests are:
• Fixed Testing – A test sample of a specified size is created.
• Statistical Testing – A random test sample is created where the size of the sample is dependent on a given Confidence and Margin of Error.
Regardless of which test you choose, the confidence level and margin of error are crucial statistics to understand in order to properly interpret the results of your Elusion Test, yet they are not entirely clear in their meaning. To understand what confidence level and margin of error refer to in the case of an Elusion Test, we must first understand that the Elusion Test is run on a sample of documents taken from the ’discard pile’ created by the active learning algorithm. The discard pile is made up of all the documents the algorithm has deemed to have a relevancy score below your desired cutoff. None of these documents has been reviewed, therefore we as reviewers have no idea what the document landscape of this pile may look like. This is where confidence level and margin of error come into play.
Figure 1: A random sample of documents are taken from the discard pile to create the sample set upon which the Elusion Test is run.
Manual Review is the process of human reviewers painstakingly reviewing documents collected as part...
Ever since Relativity announced their new GenAI aiR suite of tools based on OpenAI's GPT-4 model,...
Since the launch of Chat GPT in November 2022, there has been an unprecedented uptake in the use of...
It has come to our attention in recent months that a fair amount of interest has been shown in...