9 Firms' assessment of the scheme
Introduction
9.1 This chapter starts by examining whether the grant recipients used other support in addition to the support provided via the SMART scheme, where the support came from and how useful it was. It then focuses on the grant recipients' assessments of different aspects of SMART.
Other support used
9.2 Table 9.1 shows that almost half of the grant recipients used support over and above that provided by the scheme. It also shows that there was little variation in the use of other support according to class of respondent, except that very small firms and firms undertaking projects in the later period were more likely than respondents as a whole to have done so.
Table 9.1 Did you access any other support or advice in relation to your project in addition to the support from the scheme, e.g. from HEIs, consultants or other Government schemes?
| Percentage of all respondents Type of Grant Size of company Award Date |
|---|
Total | Feas Grant | R&D Grant | MR&B Review | <10 Empl | 10-49 Empl | 50+ Empl | Pre Apr04 | Post Mar04 |
|---|
Yes | 47 | 49 | 47 | 63 | 51 | 37 | 38 | 35 | 55 |
|---|
No | 53 | 51 | 53 | 38 | 49 | 63 | 62 | 65 | 45 |
|---|
Number of respondents | 285 | 125 | 163 | 32 | 215 | 46 | 13 | 108 | 176 |
|---|
- A number is shown in bold where, taking into account the margin of error due to sampling, we are 95% certain that it is different from the number in the left hand total column (using a Chi-Squared statistical test)
- Source: PACEC Survey (Q49A)
9.3 Table 9.2 indicates that the other support came mainly from advisers in the tertiary education sector. Firms undertaking feasibility projects were more likely than respondents as a whole to have used this source of support.
Table 9.2 If yes, what support was used?
| Percentage of all respondents Type of Grant Size of company Award Date |
|---|
Total | Feas Grant | R&D Grant | MR&B Review | <10 Empl | 10-49 Empl | 50+ Empl | Pre Apr04 | Post Mar04 |
|---|
Higher education / University advisers | 67 | 79 | 57 | 82 | 69 | 46 | 33 | 76 | 63 |
|---|
Larger research / technology companies | 25 | 23 | 28 | 29 | 21 | 46 | 33 | 28 | 24 |
|---|
SME/independent business advisers/consultants | 22 | 10 | 28 | 12 | 22 | 31 | 0 | 14 | 25 |
|---|
Venture capital / Business Angel advisers | 20 | 21 | 17 | 35 | 18 | 38 | 33 | 10 | 24 |
|---|
Business joint venture partners | 10 | 6 | 14 | 12 | 7 | 31 | 0 | 10 | 9 |
|---|
Other | 2 | 2 | 2 | 6 | 2 | 0 | 0 | 0 | 3 |
|---|
Number of respondents | 105 | 48 | 58 | 17 | 85 | 13 | 3 | 29 | 76 |
|---|
- Respondents could select more than one option; so percentages in any column may sum to more than 100
- A number is shown in bold where, taking into account the margin of error due to sampling, we are 95% certain that it is different from the number in the left hand total column (using a Chi-Squared statistical test)
- Source: PACEC Survey (q49B)
9.4 Table 9.3 describes how the grant recipients that had used other support rated it. It shows that the very large majority described the support as 'Useful' or 'Very useful'. About half of the respondents that had used particular sources of support described it as 'Very useful' in each case. The type of support that attracted the lowest proportion of 'Very useful' ratings was larger research/ technology companies.
9.5 The table also shows that firms undertaking feasibility projects were less likely than those undertaking R&D projects to describe each type of support as very useful. Similarly, with the exception of support from SME/ independent business advisers/consultants, respondents from the later period were more likely than those from the earlier period to rate the support used as very useful. Likewise, very small firms were comparatively likely to rate any particular type of support very highly.
Table 9.3 How useful was the support?
| Percentage of all respondents Type of Grant Size of company Award Date |
|---|
Total | Feas Grant | R&D Grant | MR&B Review | <10 Empl | 10-49 Empl | 50+ Empl | Pre Apr04 | Post Mar04 |
|---|
Higher education / University advisers |
|---|
Very useful | 51 | 42 | 61 | 71 | 56 | 17 | 0 | 50 | 52 |
|---|
Useful | 44 | 53 | 36 | 29 | 39 | 83 | 100 | 41 | 46 |
|---|
Not useful | 4 | 5 | 3 | 0 | 5 | 0 | 0 | 9 | 2 |
|---|
Number of respondents | 70 | 38 | 33 | 14 | 59 | 6 | 1 | 22 | 48 |
|---|
SME/independent business advisers/consultants |
|---|
Very useful | 45 | 20 | 53 | 50 | 50 | 25 | 0 | 50 | 44 |
|---|
Useful | 45 | 60 | 40 | 50 | 39 | 75 | 0 | 25 | 50 |
|---|
Not useful | 9 | 20 | 7 | 0 | 11 | 0 | 0 | 25 | 6 |
|---|
Number of respondents | 22 | 5 | 15 | 2 | 18 | 4 | 0 | 4 | 18 |
|---|
Larger research / technology companies |
|---|
Very useful | 17 | 0 | 29 | 0 | 24 | 0 | 0 | 14 | 18 |
|---|
Useful | 79 | 100 | 64 | 100 | 71 | 100 | 100 | 71 | 82 |
|---|
Not useful | 4 | 0 | 7 | 0 | 6 | 0 | 0 | 14 | 0 |
|---|
Number of respondents | 24 | 11 | 14 | 5 | 17 | 5 | 1 | 7 | 17 |
|---|
Venture capital / Business Angel advisers |
|---|
Very useful | 57 | 40 | 70 | 67 | 60 | 40 | 100 | 33 | 61 |
|---|
Useful | 43 | 60 | 30 | 33 | 40 | 60 | 0 | 67 | 39 |
|---|
Not useful | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
|---|
Number of respondents | 21 | 10 | 10 | 6 | 15 | 5 | 1 | 3 | 18 |
|---|
Business joint venture partners |
|---|
Very useful | 50 | 33 | 50 | 100 | 50 | 50 | 0 | 33 | 57 |
|---|
Useful | 50 | 67 | 50 | 0 | 50 | 50 | 0 | 67 | 43 |
|---|
Not useful | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
|---|
Number of respondents | 10 | 3 | 8 | 2 | 6 | 4 | 0 | 3 | 7 |
|---|
Other(s) |
|---|
Very useful | 67 | 50 | 100 | 100 | 67 | 0 | 0 | 0 | 100 |
|---|
Useful | 33 | 50 | 0 | 0 | 33 | 0 | 0 | 100 | 0 |
|---|
Not useful | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
|---|
Number of respondents | 3 | 2 | 1 | 1 | 3 | 0 | 0 | 1 | 2 |
|---|
- Respondents could select more than one option; so percentages in any column may sum to more than 100
- A number is shown in bold where, taking into account the margin of error due to sampling, we are 95% certain that it is different from the number in the left hand total column (using a Chi-Squared statistical test)
- Source: PACEC Survey (q49C6)
9.6 Grant recipients were also asked if they would continue to use other support in the future; and, if so, from where. Table 9.4 shows the responses and it reveals a very similar pattern of support to that shown in Table 9.2. This is not surprising, however, given that other support used to date was generally rated highly.
Table 9.4 Is the support likely to continue?
| Percentage of all respondents responding yes Type of Grant Size of company Award Date |
|---|
Total | Feas Grant | R&D Grant | MR&B Review | <10 Empl | 10-49 Empl | 50+ Empl | Pre Apr04 | Post Mar04 |
|---|
Higher education / University advisers | 67 | 81 | 54 | 88 | 71 | 40 | 50 | 72 | 66 |
|---|
Larger research / technology companies | 27 | 24 | 32 | 31 | 23 | 40 | 50 | 33 | 25 |
|---|
SME/independent business advisers/consultants | 20 | 7 | 29 | 13 | 19 | 40 | 0 | 11 | 23 |
|---|
Venture capital / Business Angel advisers | 18 | 21 | 12 | 25 | 17 | 30 | 0 | 17 | 18 |
|---|
Business joint venture partners | 10 | 7 | 15 | 6 | 7 | 30 | 0 | 11 | 9 |
|---|
Other | 2 | 2 | 2 | 6 | 3 | 0 | 0 | 0 | 3 |
|---|
Number of respondents | 83 | 42 | 41 | 16 | 69 | 10 | 2 | 18 | 65 |
|---|
- Respondents could select more than one option; so percentages in any column may sum to more than 100
- A number is shown in bold where, taking into account the margin of error due to sampling, we are 95% certain that it is different from the number in the left hand total column (using a Chi-Squared statistical test)
- Source: PACEC Survey (q49D)
Assessments of the scheme
9.7 Table 9.5 summarises how the grant recipients rated various aspects of the scheme; and it indicates that every aspect was rated relatively highly overall by all categories of respondent. The only aspect of the scheme that was rated as less than good on average was the application procedure.
Table 9.5 How would you assess the following aspects of the scheme? Mean Score (1=Very poor, 2=poor, 3=fair, 4=good 5=very good).
| Mean scores of all respondents Type of Grant Size of company Award Date |
|---|
Total | Feas Grant | R&D Grant | MR&B Review | <10 Empl | 10-49 Empl | 50+ Empl | Pre Apr04 | Post Mar04 |
|---|
Application procedures | 3.6 | 3.5 | 3.7 | 3.3 | 3.6 | 3.7 | 2.8 | 3.8 | 3.5 |
|---|
Support from the SMART team | 4.3 | 4.4 | 4.3 | 4.5 | 4.3 | 4.5 | 4.1 | 4.3 | 4.3 |
|---|
Support from other advisers | 4.3 | 4.4 | 4.2 | 4.4 | 4.4 | 4.2 | 4.2 | 4.2 | 4.4 |
|---|
Amount of grant | 4.1 | 4.3 | 4.0 | 4.3 | 4.1 | 4.3 | 4.3 | 4.2 | 4.1 |
|---|
What the grant can be spent on | 4.2 | 4.4 | 4.1 | 4.5 | 4.3 | 4.3 | 4.1 | 4.3 | 4.3 |
|---|
The flexibility of the scheme | 4.1 | 4.2 | 4.0 | 4.2 | 4.1 | 4.3 | 3.9 | 4.1 | 4.1 |
|---|
Time taken for payments to be made | 4.3 | 4.3 | 4.3 | 4.4 | 4.4 | 4.3 | 4.2 | 4.4 | 4.3 |
|---|
Benefits to your business | 4.4 | 4.5 | 4.3 | 4.5 | 4.4 | 4.6 | 4.1 | 4.3 | 4.5 |
|---|
Number of respondents | 274 | 120 | 157 | 31 | 208 | 44 | 14 | 105 | 168 |
|---|
- Source: PACEC Survey (Q50)
9.8 Table 9.6 delves deeper into grant recipients' assessments, by showing the proportion of respondents rating different aspects of the schemes highly or lowly. It shows that, apart from the application procedures, each aspect of the scheme considered was rated as Very good or Good by the overwhelming majority of respondents. The table also shows that the variations in the ratings according to category of respondent were not great, although it appears that companies undertaking later period projects were slightly more likely than those undertaking earlier projects to express dissatisfaction.
Table 9.6 Positive and negative assessments of different aspects of the scheme (% saying Very Poor/Poor and Good/Very Good. Excludes those saying Fair.)
| Percentage of all respondents Type of Grant Size of company Award Date |
|---|
Total | Feas Grant | R&D Grant | MR&B Review | <10 Empl | 10-49 Empl | 50+ Empl | Pre Apr04 | Post Mar04 |
|---|
Application procedures Very poor / poor | 18 | 22 | 14 | 29 | 15 | 14 | 46 | 10 | 21 |
|---|
Very good / Good | 58 | 52 | 60 | 42 | 57 | 63 | 38 | 65 | 53 |
|---|
Number of respondents | 274 | 122 | 155 | 31 | 210 | 43 | 13 | 105 | 168 |
|---|
Support from the SMART team Very poor / poor | 1 | 2 | 2 | 0 | 1 | 0 | 0 | 0 | 3 |
|---|
Very good / good | 88 | 90 | 87 | 90 | 88 | 95 | 79 | 89 | 88 |
|---|
Number of respondents | 273 | 122 | 154 | 31 | 208 | 43 | 14 | 106 | 166 |
|---|
Support from other advisers Very poor / poor | 3 | 4 | 3 | 7 | 3 | 8 | 0 | 1 | 5 |
|---|
Very good / good | 89 | 92 | 86 | 90 | 89 | 85 | 90 | 83 | 92 |
|---|
Number of respondents | 244 | 118 | 129 | 29 | 188 | 39 | 10 | 89 | 154 |
|---|
Amount of grant Very poor / poor | 2 | 2 | 3 | 3 | 2 | 0 | 0 | 0 | 3 |
|---|
Very good / good | 80 | 85 | 76 | 78 | 77 | 91 | 100 | 82 | 79 |
|---|
Number of respondents | 277 | 121 | 159 | 31 | 211 | 43 | 15 | 107 | 169 |
|---|
What the grant can be spent on Very poor / poor | 2 | 2 | 2 | 0 | 2 | 0 | 0 | 2 | 1 |
|---|
Very good / good | 87 | 93 | 82 | 90 | 86 | 91 | 87 | 90 | 86 |
|---|
Number of respondents | 280 | 122 | 161 | 31 | 212 | 44 | 15 | 108 | 171 |
|---|
Flexibility of the scheme Very poor / poor | 6 | 7 | 6 | 6 | 7 | 5 | 7 | 5 | 6 |
|---|
Very good / good | 79 | 83 | 76 | 77 | 77 | 89 | 73 | 81 | 79 |
|---|
Number of respondents | 265 | 120 | 148 | 31 | 199 | 43 | 15 | 98 | 166 |
|---|
Time taken for payments to be made Very poor / poor | 4 | 4 | 4 | 13 | 2 | 5 | 0 | 2 | 5 |
|---|
Very good / good | 90 | 89 | 89 | 88 | 89 | 90 | 100 | 91 | 89 |
|---|
Number of respondents | 274 | 120 | 157 | 31 | 208 | 44 | 14 | 105 | 168 |
|---|
Benefits to your business Very poor / poor | 2 | 0 | 2 | 0 | 1 | 0 | 0 | 1 | 2 |
|---|
Very good / good | 82 | 94 | 91 | 94 | 92 | 89 | 87 | 91 | 93 |
|---|
Number of respondents | 274 | 121 | 156 | 31 | 207 | 44 | 15 | 105 | 168 |
|---|
- Table does not show proportion of respondents rating aspects of the scheme as Fair.
- Source: PACEC Survey (Q50A8)
9.9 The requirement for match funding was raised as a problem by several businesses in the follow-up interviews. It was a particular problem for start-ups.
9.10 There were a number of criticisms of the application process. It was thought by several recipients that the forward predictions for three years were irrelevant and probably entirely hypothetical and unreliable, and that business plans for new or young companies could only reasonably look forward one or one and a half years. One year business plans followed by a further year's strategic forecast was suggested as a more reasonable target.
9.11 The forms were criticised as requiring too much information and needing to be simplified and focussed more on technological innovation. However, there was an alternative viewpoint that the selection procedure should be more rigorous in order to weed out unwise or incompetent users of taxpayers' money, and one recipient compared the SMART forms favourably with the "horrendously outrageous" procedure for applying for EU funds.
9.12 The application procedure was thought to be time-consuming and expensive, without any guarantee of results. "If SMART could publish a booklet for the guidance of young companies, with a template of how to apply (maybe with actual examples if permission could be obtained), it would be most helpful."
9.13 One respondent thought SMART funds should not go to university spin-out companies, since they already had access to proof-of-concept funding and appeared to be getting the lion's share of SMART funding as well.
9.14 There was some demand for additional advice and consultation from SMART, for example on patent acquisition which was seen as difficult and expensive, and a suggestion of a further round of funding. "More advice is also needed to lead companies on to SMART Plus, to route them on to a highway, as it were."
Summary of key findings
- Almost half of the grant recipients used support over and above that provided by the scheme (Table 9.1) and the very large majority of these described the support as Useful or Very useful (Table 9.3).
- Most of those who had used additional support would continue to do so (Table 9.4).
- Every aspect of the scheme was rated relatively highly by grant recipients (Table 9.5). The only aspect of the scheme that was rated as less than Good on average was the application process.
- Recipients were keen on more advice and support.