Notice Information
Notice Title
NICE AI Multi Agency Service Evaluation
Notice Description
We are looking for an evaluation partner with experience evaluating national programmes of a similar scale and complexity, and where the scope could potentially evolve, to deliver a formative evaluation and hand-over a robust summative evaluation strategy (including proposed metrics and data sources) by March 2023. The supplier should also have the capability to deliver emerging learning throughout the project The Programme is for evaluation of the AI Multi-Agency Advice Service (MAAS) project this is a 2.75 year project, funded by the NHSx AI Lab. The aim of the project is to collaboratively research, test and develop a multi-agency advice service that will offer support, information and advice on the regulation and health technology assessment pathways for artificial intelligence (AI) in health and care, and potentially other data-driven technologies. The purpose of the formative evaluation is to support the MAAS to be as effective in implementation as possible. This will be done through activities such as analysing baseline data in order to make recommendations on focus of the service, and undertaking process evaluation, particularly with regard to the project's interdependencies within the wider innovation ecosystem. As this is a complex intervention which will necessarily evolve, we expect the evaluation partner to be comfortable in an ambiguous environment, and providing us with emergent messages on what they see is working and not working and why. The summative evaluation strategy, once implemented, will be used by MAAS collaborators and commissioners in order to make future decisions about funding for this and other similar initiatives. It will also allow NHSX to report back to HM Treasury on the impact and benefits realised by the MAAS. It must be co-developed with the developer and the MAAS collaborators. It should focus on a range of outputs, outcomes and benefits including near-term (e.g. satisfaction of developers / adopters using the service) to long-term impacts (e.g. patients and citizens benefitting from AI and data-driven technologies). It should be underpinned by a logical and plausible theory of change or logic model. It should also have clearly defined metrics which are prioritised and have recommendations for gathering data. Some outputs from the evaluation may be used for external purposes such as communications; however, this is not the primary purpose. These activities will require contact with the MAAS partners at predetermined time points, and potentially with wider stakeholders involved in the project (TBD), which the AI MAAS secretariat will support Full details in the attached documents Additional information: Bidding instructions are within the Requirement specification. Expressions of interest should be a simple email with contact details, and the contact details will be used to send the responses to any questions recived
Notice Details
Publication & Lifecycle
- Open Contracting ID
- ocds-b5fd17-a7872965-64ab-4b41-8ef0-b180dbeaca17
- Publication Source
- Contracts Finder
- Latest Notice
- https://www.contractsfinder.service.gov.uk/Notice/5351205a-b1f0-4ecc-a669-d86411360703
- Current Stage
- Award
- All Stages
- Tender, Award
Procurement Classification
- Notice Type
- Award Notice
- Procurement Type
- Standard
- Procurement Category
- Services
- Procurement Method
- Open
- Procurement Method Details
- Open procedure (below threshold)
- Tender Suitability
- SME
- Awardee Scale
- Large
Common Procurement Vocabulary (CPV)
- CPV Divisions
73 - Research and development services and related consultancy services
-
- CPV Codes
73300000 - Design and execution of research and development
Notice Value(s)
- Tender Value
- £138,000 £100K-£500K
- Lots Value
- Not specified
- Awards Value
- £121,950 £100K-£500K
- Contracts Value
- Not specified
Notice Dates
- Publication Date
- 24 Jun 20214 years ago
- Submission Deadline
- 24 Mar 2021Expired
- Future Notice Date
- Not specified
- Award Date
- 13 Jun 20214 years ago
- Contract Period
- 13 Jun 2021 - 31 Mar 2023 1-2 years
- Recurrence
- Not specified
Notice Status
- Tender Status
- Complete
- Lots Status
- Not Specified
- Awards Status
- Active
- Contracts Status
- Not Specified
Buyer & Supplier
Contracting Authority (Buyer)
- Main Buyer
- NATIONAL INSTITUTE FOR HEALTH AND CARE EXCELLENCE
- Contact Name
- Available with D3 Tenders Premium →
- Contact Email
- Available with D3 Tenders Premium →
- Contact Phone
- Available with D3 Tenders Premium →
Buyer Location
- Locality
- LONDON
- Postcode
- E20 1JQ
- Post Town
- East London
- Country
- England
-
- Major Region (ITL 1)
- TLI London
- Basic Region (ITL 2)
- TLI4 Inner London - East
- Small Region (ITL 3)
- TLI41 Hackney and Newham
- Delivery Location
- Not specified
-
- Local Authority
- Newham
- Electoral Ward
- Stratford Olympic Park
- Westminster Constituency
- Stratford and Bow
Further Information
Notice Documents
-
https://www.contractsfinder.service.gov.uk/Notice/5351205a-b1f0-4ecc-a669-d86411360703
24th June 2021 - Awarded contract notice on Contracts Finder -
https://www.contractsfinder.service.gov.uk/Notice/f9b6bea0-f4e1-4342-9702-c5c1aa2d0b15
1st March 2021 - Opportunity notice on Contracts Finder -
https://www.contractsfinder.service.gov.uk/Notice/Attachment/aee658d4-a49f-4ee3-943b-32f462c24647
Sample Terms and Conditions -
https://www.contractsfinder.service.gov.uk/Notice/Attachment/2e6ee651-5ac5-4aa4-8320-18221ff0cdd0
Bidders Response and Costing template -
https://www.contractsfinder.service.gov.uk/Notice/Attachment/c41b6245-33a2-42b5-870c-460ee76f98f8
Form of Offer and Terms and Conditions queries -
https://www.contractsfinder.service.gov.uk/Notice/Attachment/e691c662-ef7a-4463-aae3-76cfd8941a6b
Appendix to the specification Delivery Plan -
https://www.contractsfinder.service.gov.uk/Notice/Attachment/8ce9009d-1138-4827-8b7d-0c30ce697c86
Requirement specification -
https://www.contractsfinder.service.gov.uk/Notice/Attachment/05094c4f-5fde-405b-8fcd-3a065699b6a6
Doc1 requirements specification
Open Contracting Data Standard (OCDS)
View full OCDS Record for this contracting process
The Open Contracting Data Standard (OCDS) is a framework designed to increase transparency and access to public procurement data in the public sector. It is widely used by governments and organisations worldwide to report on procurement processes and contracts.
{
"tag": [
"compiled"
],
"id": "ocds-b5fd17-a7872965-64ab-4b41-8ef0-b180dbeaca17-2021-06-24T14:33:00+01:00",
"date": "2021-06-24T14:33:00+01:00",
"ocid": "ocds-b5fd17-a7872965-64ab-4b41-8ef0-b180dbeaca17",
"language": "en",
"initiationType": "tender",
"tender": {
"id": "NICE AIMASE01",
"title": "NICE AI Multi Agency Service Evaluation",
"description": "We are looking for an evaluation partner with experience evaluating national programmes of a similar scale and complexity, and where the scope could potentially evolve, to deliver a formative evaluation and hand-over a robust summative evaluation strategy (including proposed metrics and data sources) by March 2023. The supplier should also have the capability to deliver emerging learning throughout the project The Programme is for evaluation of the AI Multi-Agency Advice Service (MAAS) project this is a 2.75 year project, funded by the NHSx AI Lab. The aim of the project is to collaboratively research, test and develop a multi-agency advice service that will offer support, information and advice on the regulation and health technology assessment pathways for artificial intelligence (AI) in health and care, and potentially other data-driven technologies. The purpose of the formative evaluation is to support the MAAS to be as effective in implementation as possible. This will be done through activities such as analysing baseline data in order to make recommendations on focus of the service, and undertaking process evaluation, particularly with regard to the project's interdependencies within the wider innovation ecosystem. As this is a complex intervention which will necessarily evolve, we expect the evaluation partner to be comfortable in an ambiguous environment, and providing us with emergent messages on what they see is working and not working and why. The summative evaluation strategy, once implemented, will be used by MAAS collaborators and commissioners in order to make future decisions about funding for this and other similar initiatives. It will also allow NHSX to report back to HM Treasury on the impact and benefits realised by the MAAS. It must be co-developed with the developer and the MAAS collaborators. It should focus on a range of outputs, outcomes and benefits including near-term (e.g. satisfaction of developers / adopters using the service) to long-term impacts (e.g. patients and citizens benefitting from AI and data-driven technologies). It should be underpinned by a logical and plausible theory of change or logic model. It should also have clearly defined metrics which are prioritised and have recommendations for gathering data. Some outputs from the evaluation may be used for external purposes such as communications; however, this is not the primary purpose. These activities will require contact with the MAAS partners at predetermined time points, and potentially with wider stakeholders involved in the project (TBD), which the AI MAAS secretariat will support Full details in the attached documents Additional information: Bidding instructions are within the Requirement specification. Expressions of interest should be a simple email with contact details, and the contact details will be used to send the responses to any questions recived",
"datePublished": "2021-02-22T16:59:51Z",
"status": "complete",
"classification": {
"scheme": "CPV",
"id": "73300000",
"description": "Design and execution of research and development"
},
"items": [
{
"id": "1",
"deliveryAddresses": [
{
"countryName": "United Kingdom"
},
{
"countryName": "United Kingdom"
},
{
"countryName": "United Kingdom"
},
{
"countryName": "United Kingdom"
}
]
}
],
"value": {
"amount": 138000,
"currency": "GBP"
},
"procurementMethod": "open",
"procurementMethodDetails": "Open procedure (below threshold)",
"tenderPeriod": {
"endDate": "2021-03-24T16:00:00Z"
},
"contractPeriod": {
"startDate": "2021-05-03T00:00:00+01:00",
"endDate": "2023-03-02T23:59:59Z"
},
"suitability": {
"sme": true,
"vcse": false
},
"mainProcurementCategory": "services",
"documents": [
{
"id": "1",
"documentType": "tenderNotice",
"description": "Opportunity notice on Contracts Finder",
"url": "https://www.contractsfinder.service.gov.uk/Notice/f9b6bea0-f4e1-4342-9702-c5c1aa2d0b15",
"datePublished": "2021-02-22T16:59:51Z",
"format": "text/html",
"language": "en",
"dateModified": "2021-03-01T15:55:54Z"
},
{
"id": "2",
"documentType": "biddingDocuments",
"description": "Sample Terms and Conditions",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/aee658d4-a49f-4ee3-943b-32f462c24647",
"format": "application/msword"
},
{
"id": "3",
"documentType": "biddingDocuments",
"description": "Bidders Response and Costing template",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/2e6ee651-5ac5-4aa4-8320-18221ff0cdd0",
"format": "application/vnd.openxmlformats-officedocument.wordprocessingml.document"
},
{
"id": "4",
"documentType": "biddingDocuments",
"description": "Form of Offer and Terms and Conditions queries",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/c41b6245-33a2-42b5-870c-460ee76f98f8",
"format": "application/msword"
},
{
"id": "5",
"documentType": "biddingDocuments",
"description": "Competing interests form",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/444d1ac1-64b5-4fbb-b4b3-1043c8dc4aea",
"format": "application/msword"
},
{
"id": "6",
"documentType": "biddingDocuments",
"description": "Redaction Request form",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/1da7ed7d-61df-4deb-a799-4b0336175b0d",
"format": "application/msword"
},
{
"id": "7",
"documentType": "biddingDocuments",
"description": "Appendix to the specification Delivery Plan",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/e691c662-ef7a-4463-aae3-76cfd8941a6b",
"format": "application/pdf"
},
{
"id": "8",
"documentType": "biddingDocuments",
"description": "Requirement specification",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/8ce9009d-1138-4827-8b7d-0c30ce697c86",
"format": "application/vnd.openxmlformats-officedocument.wordprocessingml.document"
},
{
"id": "9",
"documentType": "biddingDocuments",
"description": "Doc1 requirements specification",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/05094c4f-5fde-405b-8fcd-3a065699b6a6",
"format": "application/vnd.openxmlformats-officedocument.wordprocessingml.document"
}
]
},
"parties": [
{
"id": "GB-GOR-PB474",
"name": "National Institute For Health And Care Excellence",
"identifier": {
"legalName": "National Institute For Health And Care Excellence",
"scheme": "GB-GOR",
"id": "PB474"
},
"address": {
"streetAddress": "2 Redman Place",
"locality": "LONDON",
"postalCode": "E20 1JQ",
"countryName": "England"
},
"contactPoint": {
"name": "Barney Wilkinson",
"email": "Barney.Wilkinson@nice.org.uk"
},
"roles": [
"buyer"
]
},
{
"id": "GB-COH-02728021",
"name": "RAND EUROPE COMMUNITY INTEREST COMPANY",
"identifier": {
"legalName": "RAND EUROPE COMMUNITY INTEREST COMPANY",
"scheme": "GB-COH",
"id": "02728021"
},
"address": {
"streetAddress": "Westbrook Centre Milton Road CAMBRIDGE Cambridgeshire CB4 1YG GB"
},
"details": {
"scale": "large",
"vcse": false
},
"roles": [
"supplier"
]
}
],
"buyer": {
"id": "GB-GOR-PB474",
"name": "National Institute For Health And Care Excellence"
},
"awards": [
{
"id": "ocds-b5fd17-a7872965-64ab-4b41-8ef0-b180dbeaca17-1",
"status": "active",
"date": "2021-06-14T00:00:00+01:00",
"datePublished": "2021-06-24T14:33:00+01:00",
"value": {
"amount": 121950,
"currency": "GBP"
},
"suppliers": [
{
"id": "GB-COH-02728021",
"name": "RAND EUROPE COMMUNITY INTEREST COMPANY"
}
],
"contractPeriod": {
"startDate": "2021-06-14T00:00:00+01:00",
"endDate": "2023-03-31T23:59:59+01:00"
},
"documents": [
{
"id": "1",
"documentType": "awardNotice",
"description": "Awarded contract notice on Contracts Finder",
"url": "https://www.contractsfinder.service.gov.uk/Notice/5351205a-b1f0-4ecc-a669-d86411360703",
"datePublished": "2021-06-24T14:33:00+01:00",
"format": "text/html",
"language": "en"
},
{
"id": "2",
"documentType": "biddingDocuments",
"description": "Sample Terms and Conditions",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/aee658d4-a49f-4ee3-943b-32f462c24647",
"format": "application/msword"
},
{
"id": "3",
"documentType": "biddingDocuments",
"description": "Bidders Response and Costing template",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/2e6ee651-5ac5-4aa4-8320-18221ff0cdd0",
"format": "application/vnd.openxmlformats-officedocument.wordprocessingml.document"
},
{
"id": "4",
"documentType": "biddingDocuments",
"description": "Form of Offer and Terms and Conditions queries",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/c41b6245-33a2-42b5-870c-460ee76f98f8",
"format": "application/msword"
},
{
"id": "5",
"documentType": "biddingDocuments",
"description": "Competing interests form",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/444d1ac1-64b5-4fbb-b4b3-1043c8dc4aea",
"format": "application/msword"
},
{
"id": "6",
"documentType": "biddingDocuments",
"description": "Redaction Request form",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/1da7ed7d-61df-4deb-a799-4b0336175b0d",
"format": "application/msword"
},
{
"id": "7",
"documentType": "biddingDocuments",
"description": "Appendix to the specification Delivery Plan",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/e691c662-ef7a-4463-aae3-76cfd8941a6b",
"format": "application/pdf"
},
{
"id": "8",
"documentType": "biddingDocuments",
"description": "Doc1 requirements specification",
"url": "https://www.contractsfinder.service.gov.uk/Notice/Attachment/05094c4f-5fde-405b-8fcd-3a065699b6a6",
"format": "application/vnd.openxmlformats-officedocument.wordprocessingml.document"
},
{
"id": "9",
"documentType": "awardNotice",
"url": "https://www.contractsfinder.service.gov.uk/Notice/SupplierAttachment/452908d1-ee20-4290-826c-2d147e902676",
"format": "application/pdf"
}
]
}
]
}