Sign up for an account

Already have an account? Sign In

Login

  • Home
  • About this site

About this site

In Knowsley we have an ambition for a healthier, happier population with a better quality of life, a reduction in health inequalities and improved access to healthcare when required, as close as possible to the patient.

NHS Knowsley Clinical Commissioning Group is investing in improved digital health services to provide greater choice and improve access. We want to support our population to make healthier lifestyle choices to prevent ill health and enable our residents to live well for longer, by providing the information and tools to look after their own health and digital options have a big role to play. We conducted a digital health survey to find out about current use of digital services and how we can develop and improve these - and had a fantastic response. The results of the over 2,500 responses to date have helped shaped this website.

Apps present a fantastic opportunity to provide us with valuable health information which can help us not only improve the quality of our healthcare, but also help us to live healthier lives. The market is awash with apps, though, and we know from the results of the survey that our citizens have concerns such as: the protection of our personal data, how user-friendly health & wellbeing apps are and the evidence behind the success of digital health.

The survey also tells us that many of us are adapting to mobile technology and looking for convenient and pro-active approaches to staying well and managing our health during illness. To meet this demand, therefore, Knowsley health and care services have partnered with ORCHA (the Organisation for the Review of Care and Health Applications) to provide this dedicated site.

ORCHA carry out independent and impartial reviews of health and care related apps, and you’ll see that the results are clearly presented for you throughout this website. You can be reassured that any apps shown on this site have undergone a rigorous review process, and can feel confident as you choose the best app that’s right for you.

By bringing this information to our fingertips, it’s now possible to identify and compare the best apps for our needs – and to ensure that you, and your friends and families can get access to quality assured apps that meet a standard that health care workers are comfortable with.

See How it Works

Icon Watch the video
Image

The Review Process

ORCHA is one of the leading providers of Health and Care App evaluations and reviews. It provides an objective and independent assessment of health and medical Apps. This is an advisory not regulatory service, but we do advise where regulatory issues may be important and should be considered further. It is however ultimately the responsibility of the developers and/or publishers of an App to ascertain its compliance with all relevant regulatory standards.

The ORCHA Baseline Review (“OBR”) is ORCHA’s first level of assessment and involves a detailed ‘desktop’ analysis of Digital Health solutions looking across all of the key areas of regulation and compliance. The OBR is largely undertaken proactively as part of ORCHA’s ongoing assessment and monitoring of the whole Digital Health market place and we review the most downloaded and most recently updated Apps and related Digital Health solutions across over 250 health and care categories and conditions.

The OBR is primarily an assessment of an Apps compliance with current standards, regulation and good practice (together “Standards”).

The OBR seeks to assess an App's performance through its compliance with these Standards. Our Review is regularly updated to reflect changes in these Standards. The higher the ORCHA Score achieved the more compliant the App is with these Standards and vice versa.

If you become aware of any inaccuracy in the information presented in our Reviews or have any other concerns, please report this to us immediately at feedback@orcha.co.uk.

ORCHA are not promoting or recommending any particular Apps through this process but are providing impartial information about an App's compliance with Standards and a mechanism for end users to easily identify those Apps that best meet those Standards and to check which ones don’t.

STAGE ONE - EXCLUSION FILTERS

The OBR process starts with a weekly analysis of all the Apps available on the App Store or Google Play in the ‘health, wellbeing/fitness and medical’ sections. We then filter out Apps that are not available to use in a supported jurisdiction (currently the UK, the Republic of Ireland, the Netherlands and Estonia) and Apps that have not been updated for 18 months or more. Of the remaining Apps we organise these into over 250 health and care condition categories and queue them within their category by most downloaded

STAGE TWO - LEVELS

There are a huge array of different types of health and care Apps available with an equally wide array of functionality and sophistication. At ORCHA we believe that just because an App offers more functionality it doesn’t mean it is automatically better than a functionally simple App. Apps that for example simply provide information and guidance – similar to health ‘leaflets’ – can be very useful in certain circumstances and this isn’t impacted by their relative functional simplicity.

In order to assess and score these Apps in a way that enables a fair comparison of like for like solutions, ORCHA has devised a sequence of Levels to attribute to an App. These Levels (currently ranging between Level 0-4), are indicative of the area of focus an App has (wellbeing, general health or specific conditions) and the level of functional complexity and associated risk. The Levels are an important part of the ORCHA Baseline scoring system which adjusts between each level to reflect a shifting prioritisation from the user experience measures towards the data security and clinical assurance review domains (outlined below).

STAGE THREE- FUNCTIONS & FEATURES

As part of our evaluation of an App's Level, we also capture all of the App's key functions and features. We have currently over 14 features that we regularly check for and we are constantly updating this as Apps develop new features and functions. The Functional assessment also dynamically changes the lines of enquiry that our Reviewers follow during the Review proper again to ensure that the assessment is as tailored to the type of App as possible. For example an App that collects sensitive and identifiable data will trigger a range of more detailed questions in regards to its Data compliance than an App that doesn’t collect this type of data.

The functional capabilities all become filterable search elements in the ORCHA App Finder, allowing all users to tailor their searches appropriately to find Apps that actually do the things that they want support around. For example, you can search for an App that simply provides Information and Guidance or an App that provides relevant forums or networks of support.

STAGE FOUR - REVIEW DOMAINS

The Review focusses on the three Review Domains outlined below. Each of these Review Areas has been designed by relevant experts and consists of a series of objective (Yes/No) questions which should be capable of being answered by our Reviewers from information in the App, on the relevant App Store or on a supporting website.

If our Reviewers cannot find evidence to support an answer from these sources they will assume that the App is not compliant with or capable of satisfying the relevant requirement.

There are often cases where an App is in fact capable of satisfying particular requirements but that this is not made clear in any obvious publicly available place. In these circumstances Users are left with uncertainty as to the real position and our view is that in this circumstance they should proceed with caution.

The OBR dynamically adjusts as the type or characteristics of an App evolves (i.e. does it collect Data or not, is it Clinical, does it interoperate with third party systems etc). This dynamic adjustment is a crucial part of the process and recognises that there are many different types of health Apps and applying a blanket assessment model is highly inefficient and ineffective. The dynamic nature of the review also applies to the scoring system that also adjusts to the characteristics of an App and provides a weighted impact dependent for example on the sensitivity of the data that an App handles or the level of clinical guidance it offers.

STAGE FIVE- THE SCORE

All this analysis results in an overall ORCHA score which is built up from the answers to each of the questions in the three Review Domains. Some questions earn positive points and some earn negative points. The ORCHA Score aims to deliver a meritocratic evaluation with all Apps being treated equally and fairly irrespective of their current popularity or the financial position of their Developers.

Any score below 65% would indicate that an App has some issues that users should investigate further prior to using this App. Scores below 45% indicate that an App has considerable issues or challenges and in its current form is potentially unhelpful or unsafe.

STAGE SIX- DEVELOPER NOTIFICATION & PUBLICATION

The final stage of the process is Developer notification and publication stage. When the review is complete, we send a notification to the relevant developer/publisher giving them an opportunity to preview the Review ahead of its publication. This gives them an opportunity to highlight any obvious errors or issues before we release the Review onto all our platforms. Once the notification period has expired, we publish the Review on all our platforms.

STAGE SEVEN– POST PUBLICATION REVIEW MONITORING & MANAGEMENT

All our reviews will remain valid until a new version of the App is produced. If a new version is not produced within 18 months of the current version, we mark the relating to the App as 'Out of Date' and the ORCHA App Score will start to degrade at the rate of 5% per month.

If the Developer implements a new version of this App we will automatically detect this via the relevant App Stores and we will mark the current review as being related to an old version of the App on all our platforms. The new version of your App will go back into the queue for a Re-Review and we will in time undertake this.

Sign up to our newsletter

Stay up-to-date with the latest developments in digital health and news from ORCHA.