Aims Point-of-care (POC) tests for influenza and respiratory syncytial virus (RSV) offer the potential to improve patient management and antimicrobial stewardship. Studies have focused on performance; however, no workflow assessments have been published comparing POC molecular tests. This study compared the Liat and ID Now systems workflow, to assist end-users in selecting an influenza and/or RSV POC test.
Methods Staffing, walk-away and turnaround time (TAT) of the Liat and ID Now systems were determined using 40 nasopharyngeal samples, positive for influenza or RSV. The ID Now system requires separate tests for influenza and RSV, so parallel (two instruments) and sequential (one instrument) workflows were evaluated.
Results The ID Now ranged 4.1–6.2 min for staffing, 1.9–10.9 min for walk-away and 6.4–15.8 min for TAT per result. The Liat ranged 1.1–1.8 min for staffing, 20.0–20.5 min for walk-away and 21.3–22.0 min for TAT. Mean walk-away time comprised 38.0% (influenza positive) and 68.1% (influenza negative) of TAT for ID Now and 93.7% (influenza/RSV) for Liat. The ID Now parallel workflow resulted in medians of 5.9 min for staffing, 9.7 min for walk-away and 15.6 min for TAT. Assuming prevalence of 20% influenza and 20% RSV, the ID Now sequential workflow resulted in medians of 9.4 min for staffing, 17.4 min for walk-away, and 27.1 min for TAT.
Conclusions The ID Now and Liat systems offer different workflow characteristics. Key considerations for implementation include value of both influenza and RSV results, clinical setting, staffing capacity, and instrument(s) placement.
- POC testing
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Respiratory tract infections are a major public health issue and significant cause of morbidity and mortality worldwide.1 Influenza virus2 3 and respiratory syncytial virus (RSV)4–6 are significant causes of respiratory illness and have overlapping clinical symptoms and seasonality.
Influenza is characterised by fever, cough, headache, muscle and joint pain, severe malaise, sore throat and runny nose.2 It can affect people of all ages, although some groups are at greater risk of severe disease or complications (young children, pregnant women, the elderly, individuals with chronic medical conditions and those with immunosuppressive conditions).2 Influenza virus types A and B are responsible for annual epidemics estimated to cause 3–5 million cases of severe illness and 290 000–650 000 deaths worldwide.2
RSV is typically associated with mild symptoms in adults, including runny nose, cough, fever and wheezing,4 but is known to cause more serious illness in infants and older adults, including bronchiolitis and pneumonia.4 RSV is a common cause of childhood acute lower respiratory infection, and was estimated, in 2015, to have caused 3.2 million hospital admissions and 59 600 in-hospital deaths in children younger than 5 years globally.5 In the same year, there were an estimated 336 000 hospitalisations and 14 000 in-hospital deaths due to RSV-associated acute respiratory infection in older adults.6
However, in adults, RSV is likely to be under-reported as the symptoms are similar to those of influenza, making it ‘nearly impossible’ to distinguish the two infections by clinical presentation alone.7 A recent study assessing laboratory-confirmed hospitalised RSV cases in the USA found that only 44% had RSV-specific International Classification of Diseases discharge codes (in the first nine positions), suggesting that administrative data underestimate adult RSV-related hospitalisations.8 Furthermore, studies suggest that antibiotic use, morbidity and mortality are higher among RSV-positive than influenza-positive adult hospitalised patients9–11 and RSV patients are more likely to need hospital re-admission.12
Increased detection of RSV would be valuable for appropriate management of patients and to minimise transmission to high-risk groups. Reducing the time to detection of influenza and RSV could improve infection control and reduce in-hospital costs by improving the efficiency of patient triage and minimising the time patients are kept in isolation while waiting for test results.13 A fast and highly accurate diagnosis could also enable time-critical antivirals to be administered sooner14 and reduce inappropriate antimicrobial administration.15
The recent introduction of point-of-care (POC) molecular tests for RSV and influenza A/B offers the potential for clinicians to have rapid nucleic acid amplification test results for these infections.16 17 These include the ID Now RSV assay and the ID Now Influenza A and B assay for use on the ID Now (formerly referred to as Alere i) system (ID Now), and the cobas Influenza A/B and RSV assay for use on the cobas Liat PCR System (Liat). To date, comparison studies have focused on performance based on the sensitivity and specificity of the ID Now and Liat assays.18 19 Differences between the two systems in terms of test operation or workflow have been mentioned but have not been the focus of the studies.19 20
The two systems differ in terms of the manual steps involved, turnaround times (TAT) and multiplexing capabilities, which may impact choice of instrument for influenza and RSV testing. To further help clinicians and laboratory directors select their influenza and RSV testing methods, this study aimed to assess the workflow and ease of use of the ID Now and Liat systems. Specific features that were considered include TAT, staffing time, walk-away time and the early call-out feature of the ID Now system.
Materials and methods
Influenza A/B and RSV tests were run on the ID Now and Liat systems. For the ID Now system, sequential and parallel workflow modes were assessed because two tests (influenza A/B test and RSV test) are required to detect all three viruses. The tests were run by four trained operators, each working four 4-hour shifts (two shifts per day over two consecutive days). An independent time motion expert measured TAT and operator staffing and walk-away times. All operators spent at least 1 day using both systems before the ease of use and workflow testing to ensure the data captured routine use not initial use. All testing was conducted at TriCore Reference Laboratories (Albuquerque, New Mexico, USA) in November 2018.
Forty positive residual de-identified nasopharyngeal samples, previously collected for routine clinical care, were used for this study. The samples were all positive for either influenza A, influenza B or RSV according to routine laboratory PCR testing when fresh and had been frozen after all of the standard of care (SOC) testing was complete. The samples were not re-tested with the routine laboratory PCR test to confirm positivity post freeze/thaw. Ten samples were provided for testing in a random order for each 4-hour shift (four positive for influenza A, two positive for influenza B and four positive for RSV prefreeze/thaw cycle). Each sample was tested for all three viruses and run twice on each system using the workflow modes described below: parallel (n=40) and sequential (n=40) workflows on the ID Now system and standard workflow on the Liat system (n=80). Sample volumes used were 200 µL for each ID Now assay (400 µL total) and 200 µL for the Liat influenza A/B and RSV assay. Two controls for each assay were run for each reagent lot.
Assays and instruments
The testing used the ID Now Influenza A and B 2 assay and the ID Now RSV assay performed on the ID Now system (Abbott Diagnostics, Lake Forest, Illinois, USA) and the cobas Influenza A/B and RSV assay for use on the cobas Liat PCR System (Roche Molecular Diagnostics, Pleasanton, California, USA).
The ID Now system uses isothermal nucleic acid amplification technology and the Liat system uses PCR to detect specific nucleic acid sequences. The ID Now influenza A/B assay detects and differentiates influenza A and influenza B, and the ID Now RSV assay detects RSV. The Liat influenza A/B and RSV assay detects and differentiates influenza A, influenza B and RSV from a single sample. All three assays are Clinical Laboratory Improvement Amendments-waived in vitro diagnostic tests.21–23
The ID Now sequential workflow involved one operator running the ID Now influenza A/B assay followed by the ID Now RSV assay. The ID Now parallel workflow involved one operator running both ID Now assays at the same time on two separate instruments. Both workflows were evaluated to consider the different methods clinical sites may use to execute both tests. Each sample was run twice on the ID Now system, once in a parallel workflow and once in a sequential workflow shift. The Liat influenza A/B and RSV assay is a multiplex PCR test that provides results for influenza A, influenza B and RSV from one sample run; therefore, multiple workflows were not required. However, each operator still ran through two Liat shifts so that they interacted equally with both systems.
TAT, staffing time and walk-away time (mean, median and range) were determined for the ID Now and Liat systems for all workflows. TAT was the total time from the point when the initial set-up began to when the test result was released. Staffing time corresponded to the sum of the labour time (hands-on time) and oversight time (time that the operator was not directly engaged with the testing but had to remain close to the instrument). Walk-away time corresponded to the wait times when the operator was not required to be close to the instrument.
The ID Now system has an early call-out feature for positive test results. Therefore, for ID Now, TAT, staffing time and walk-away time were calculated separately for positive and negative results. The early call-out feature does not guarantee that all positive results terminate early so waiting the full run time is still required. The Liat system does not have an early call-out feature and one test covers all three viruses, therefore, all results were combined for the Liat analyses.
The impact of early call-out on the average TAT, staffing and walk-away times in a real-world clinical setting was estimated by analysing the expected median TAT, staffing and walk-away times based on different influenza and RSV prevalence levels.
Expected median time for prevalence ranging from 5% (0.05) to 30% (0.3) was calculated as follows:
Prevalence expressed as a decimal×median time (TAT/staffing/walk-away) for a positive result+(1−prevalence expressed as a decimal)×median time (TAT/staffing/walk-away) for a negative result.
The nasopharyngeal specimens used in the study were de-identified by an honest broker using an Institutional Review Board-approved procedure.
Workflow steps per run
The ID Now system has eight manual steps (opening lid, inserting test base, inserting sample receiver, removing seal and inserting swab, transferring cartridge to receiver, transferring cartridge to test base, running test, discarding components) (figure 1). The operator must wait for 3 min for the system to warm up before inserting the swab/sample between steps 3 and 4, calculated as staffing time in the analysis.
The Liat system has four manual steps (scanning assay tube and inserting sample, close tube and scan, inserting assay tube and running test, discarding the tube).
Workflow timings per run
The ID Now workflow timings varied per run by test type (influenza or RSV) and result, ranging 4.1–6.2 min for staffing time, 1.9–10.9 min for walk-away time and 6.4–15.8 min for TAT per test (table 1). The early call-out feature of the ID Now system was used for the study, which resulted in much shorter TAT and walk-away times for positive results than for negative results (table 1 and figure 2). For the ID Now assays, TAT ranged 6.4–9.6 min for positive results and 14.4–15.8 min for negative results, and walk-away time ranged 1.9–4.2 min for positive results and 10.0–10.9 min for negative results (table 1). Overall staffing time for the ID Now assays was comparable for positive (4.1–6.2 min) and negative results (4.1–5.6 min) (table 1), and 31.9%–38% of the TAT for influenza runs (figure 3A and B).
The Liat ranged 1.1–1.8 min for staffing time, 20.0–20.5 min for walk-away time and 21.3–22.0 min for TAT for influenza and RSV results (table 1). The Liat combined influenza/RSV test and no early call-out feature made results consistent for all testing scenarios, with staffing time accounting for 6.3% of the TAT (figure 3C).
Workflow timings for influenza A/B and RSV
For the ID Now parallel workflow, the median (range) times for all influenza and RSV tests were 5.9 min (5.0–7.4 min) for staffing time, 9.7 min (9.4–11.1 min) for walk-away time and 15.6 min (14.7–16.8 min) for TAT. However, for the ID Now system, the early call-out for positive results means that test results will influence TAT. When assessing ID Now negative results only, the parallel workflow median TAT was shorter (15.1 min) compared with the sequential workflow (30.0 min) (figure 4).
For the ID Now sequential workflow in a real-world setting, the prevalence of influenza and RSV will be a key determinant of TAT. As a result, the data were used to make a theoretical calculation of TAT (table 2), as well as staffing time and walk-away time (table 3). Expected median TAT for the ID Now influenza A/B and RSV assays (sequential workflow) ranged from 25.6 min for a prevalence of 30% for each virus to 29.3 min for a prevalence of 5% for each virus (table 2). The walk-away time for the same prevalence range was 16.0–19.7 min (table 3). Staffing time remained consistent at 9.4 min for all prevalence ranges. For influenza alone, the median TAT was also calculated for the ID Now assay, which ranged from 12.9 to 14.7 min based on a prevalence range of 30%–5% (table 4). For the Liat influenza A/B and RSV assay, infection prevalence had no impact on expected median TAT, staffing time or walk-away time. In addition, the Liat per run workflow timing is identical to the influenza A/B and RSV workflow because of the three-analyte test.
There were discrepant results between the sequential and parallel workflow ID Now results for four samples in this study. Two samples (sample IDs: 404–125 and 404–136) that were positive for influenza A under the sequential workflow were negative for influenza A/B and RSV under the parallel workflow, and two samples (sample IDs: 404–128 and 404–133) that were negative for influenza A/B and RSV under the sequential workflow were positive for RSV under the parallel workflow. For the Liat system, test results for all 40 samples matched between the two test runs during this study.
The ID Now and Liat systems offer different workflow options for rapid diagnosis of influenza A/B and RSV in POC settings such as emergency rooms, urgent care centres, physician offices and pharmacies. The median times reported in our study indicate that the ID Now sequential workflow has the longest TAT for influenza and RSV testing (up to 30 min) followed by the Liat system (21.6 min), and that the ID Now parallel workflow has the shortest TAT (15.1 min). The Liat has reduced staffing time (1.4 min compared with 5.9 (parallel)–9.3 (sequential) min) and increased walk-away time due to fewer manual steps compared with both ID Now workflows. The early call-out feature of the ID Now system enables shorter TATs for positive results compared with negative results (7.5 vs 15.1 min).
When selecting the most appropriate diagnostic tool for influenza and RSV testing, it is critical to consider the potential benefits and drawbacks of each testing method. The ID Now and Liat systems each have their own potential benefits that need to be considered in the context of the testing scenario/setting. Specific factors to consider include location of instruments (eg, whether they will be in a separate physician office lab, how much space is available for instruments), staffing and who will execute the tests (eg, whether there will be a dedicated operator available who will stay with the instrument for the run, whether staff need to be multitasking and return to check the instrument).
The Liat system requires less staffing time (sum of hands-on time and oversight time) (figure 2) and fewer manual steps (figure 1) than the ID Now system, providing advantages in settings without dedicated operators. The Liat system also has a consistent TAT, which is unaffected by pathogen prevalence. The consistent TAT may enable more effective planning because the time to results is fixed so that multitasking healthcare workers know when to return to the instrument to record the result. No manual intervention or operator wait times are required between test initiation and completion. The Liat system is also multiplexed to detect influenza A/B and RSV during a single run so only one instrument is required to simultaneously test a sample for both respiratory viruses.
The ID Now system offers faster TAT compared with the Liat system when using a parallel workflow. A faster TAT could improve clinical workflow in settings like primary care with shorter appointment windows during busy winter respiratory seasons. To leverage the faster TAT of the ID Now, two instruments would be required per patient requiring results, so space to house instruments could be considered. Utilisation of the ID Now system requires a high level of staffing time via direct interaction (figure 2) during each run so the availability and added cost of staff to operate the instruments should also be considered. The system will time out between steps 3 and 4 if the operation is not completed within 10 min.
The ID Now’s early call-out feature allows a very fast TAT for positive results. In our study, results were available at 6.4 min (minimum) to 9.6 min (maximum) for positive results and up to 15.8 min (maximum) for negative results. For a clinical site to leverage the workflow benefits of this 6–10 min TAT, an operator would have to stay close to the instrument for up to 10 min or repeatedly return to check the instrument. As a result, this feature will provide the most utility in clinical settings with staff who stay with the instruments during the entire run or settings where the instruments are placed in the exam room with healthcare providers, who can monitor the test status during the exam.
In a clinical setting, the majority of samples over the course of a respiratory infections season are negative; in the USA 2018–2019 influenza season the peak influenza prevalence was ~26%.24 As a result, the time to receive negative results with the ID Now system (median 15.1 min for influenza) is a closer reflection of median TAT than the earlier time to positive results (median 7.7 min for influenza).
The discrepant results observed in our study with the ID Now system indicate that such inconsistencies are possible in a clinical setting and should be taken into consideration.
This study provides quantitative workflow data to aid the selection of a POC molecular test for influenza and RSV; however, there are several limitations that should be taken into account. This study was not conducted in a real-world clinical setting. The operators were trained laboratory technicians experienced with using the instruments; the results may have differed if the users were less experienced. Workflow was assessed using samples in batches of 10; in the real-world setting, a smaller or larger number may need to be tested during a working day and would likely be executed on an on-demand basis instead of back to back. The operators were dedicated to executing the test operation, while in a real-world setting operators will often be multitasking staff who have other responsibilities, which may impact the organisation of how the testing is performed. In addition, the samples used for testing were all positive for either influenza A/B or RSV when originally frozen and 35/40 tested positive on both systems after thaw, so this scenario does not represent a typical set of clinical samples.
The ID Now and cobas Liat systems offer different workflow options for emergency rooms, urgent care centres, physician offices and pharmacies. When deciding which molecular test to implement, operational and workflow features as well as diagnostic performance/accuracy should be considered. Key considerations include the value of having both influenza and RSV results, staffing capacity and instrument placement.
Take home messages
This study provides data on workflow parameters (turnaround time (TAT), staffing time and walk-away time) for the ID Now and cobas Liat systems, which can help to support the selection of the most appropriate influenza and RSV tests for different implementation scenarios.
The cobas Liat system offers a consistent TAT (21.3–22.0 min), with 1.4 min of staff time and multiplexing capabilities so one test can provide influenza A, influenza B and RSV results.
The ID Now system offers TAT ranging 6.3–16.8 min, depending on analytes tested, workflow and utilisation of the early call-out feature, but staff are likely to stay with the instrument for 4.1–6.2 min per run.
Additional considerations for clinical sites adopting point-of-care nucleic acid amplification test to consider include the value of having both influenza and RSV results, staffing, instrument placement and reliability.
The authors would like to thank Papia Das for providing medical writing support. The authors would like to thank Elissa Robbins for editorial review of the manuscript. COBAS and LIAT are trademarks of Roche. All other trademarks are the property of their respective owners.
Handling editor Runjan Chetty.
Correction notice This article has been corrected since it was published Online First. In the take home messages box, the bulletpoint "The ID Now system offers…" has been updated.
Contributors SY and JS designed and planned the study. SC was the Study Monitor. SY, CG-F, AW and PJ conducted the study. ST analysed the study results. The workflow data were collected by Nexus. All authors interpreted the study results and contributed to the drafting and the review of the manuscript.
Funding This study was conducted at TriCore Reference Laboratories (Albuquerque, New Mexico, USA) and funded by Roche Molecular Systems, Inc (Pleasanton, California, USA).
Competing interests SY has participated in advisory boards for Roche Molecular Systems, Inc, Quidel, Inc and Mesa Biotech, Inc. JP is an employee of Roche Diagnostics Corporation, Indianapolis, Indiana, USA. ST and JS are employees of Roche Molecular Systems, Inc, Pleasanton, California, USA. SC was an employee of Roche Molecular Systems, Inc at the time of the study. CG-F, AW and PJ have no competing interests.
Patient consent for publication Not required.
Ethics approval The study was conducted in compliance with the International Conference on Harmonization Good Clinical Practice Guidelines, and applicable US Food and Drug Administration regulations.
Provenance and peer review Not commissioned; externally peer reviewed.
Data availability statement Data are available on reasonable request.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.