Evaluation of Smart: Scotland

Listen

9 Firms' assessment of the scheme

Introduction

9.1 This chapter starts by examining whether the grant recipients used other support in addition to the support provided via the SMART scheme, where the support came from and how useful it was. It then focuses on the grant recipients' assessments of different aspects of SMART.

Other support used

9.2 Table 9.1 shows that almost half of the grant recipients used support over and above that provided by the scheme. It also shows that there was little variation in the use of other support according to class of respondent, except that very small firms and firms undertaking projects in the later period were more likely than respondents as a whole to have done so.

Table 9.1 Did you access any other support or advice in relation to your project in addition to the support from the scheme, e.g. from HEIs, consultants or other Government schemes?

Percentage of all respondents
Type of Grant Size of company Award Date

Total

Feas Grant

R&D Grant

MR&B Review

<10 Empl

10-49 Empl

50+ Empl

Pre Apr04

Post Mar04

Yes

47

49

47

63

51

37

38

35

55

No

53

51

53

38

49

63

62

65

45

Number of respondents

285

125

163

32

215

46

13

108

176

  • A number is shown in bold where, taking into account the margin of error due to sampling, we are 95% certain that it is different from the number in the left hand total column (using a Chi-Squared statistical test)
  • Source: PACEC Survey (Q49A)

9.3 Table 9.2 indicates that the other support came mainly from advisers in the tertiary education sector. Firms undertaking feasibility projects were more likely than respondents as a whole to have used this source of support.

Table 9.2 If yes, what support was used?

Percentage of all respondents
Type of Grant Size of company Award Date

Total

Feas Grant

R&D Grant

MR&B Review

<10 Empl

10-49 Empl

50+ Empl

Pre Apr04

Post Mar04

Higher education / University advisers

67

79

57

82

69

46

33

76

63

Larger research / technology companies

25

23

28

29

21

46

33

28

24

SME/independent business advisers/consultants

22

10

28

12

22

31

0

14

25

Venture capital / Business Angel advisers

20

21

17

35

18

38

33

10

24

Business joint venture partners

10

6

14

12

7

31

0

10

9

Other

2

2

2

6

2

0

0

0

3

Number of respondents

105

48

58

17

85

13

3

29

76

  • Respondents could select more than one option; so percentages in any column may sum to more than 100
  • A number is shown in bold where, taking into account the margin of error due to sampling, we are 95% certain that it is different from the number in the left hand total column (using a Chi-Squared statistical test)
  • Source: PACEC Survey (q49B)

9.4 Table 9.3 describes how the grant recipients that had used other support rated it. It shows that the very large majority described the support as 'Useful' or 'Very useful'. About half of the respondents that had used particular sources of support described it as 'Very useful' in each case. The type of support that attracted the lowest proportion of 'Very useful' ratings was larger research/ technology companies.

9.5 The table also shows that firms undertaking feasibility projects were less likely than those undertaking R&D projects to describe each type of support as very useful. Similarly, with the exception of support from SME/ independent business advisers/consultants, respondents from the later period were more likely than those from the earlier period to rate the support used as very useful. Likewise, very small firms were comparatively likely to rate any particular type of support very highly.

Table 9.3 How useful was the support?

Percentage of all respondents
Type of Grant Size of company Award Date

Total

Feas Grant

R&D Grant

MR&B Review

<10 Empl

10-49 Empl

50+ Empl

Pre Apr04

Post Mar04

Higher education / University advisers

Very useful

51

42

61

71

56

17

0

50

52

Useful

44

53

36

29

39

83

100

41

46

Not useful

4

5

3

0

5

0

0

9

2

Number of respondents

70

38

33

14

59

6

1

22

48

SME/independent business advisers/consultants

Very useful

45

20

53

50

50

25

0

50

44

Useful

45

60

40

50

39

75

0

25

50

Not useful

9

20

7

0

11

0

0

25

6

Number of respondents

22

5

15

2

18

4

0

4

18

Larger research / technology companies

Very useful

17

0

29

0

24

0

0

14

18

Useful

79

100

64

100

71

100

100

71

82

Not useful

4

0

7

0

6

0

0

14

0

Number of respondents

24

11

14

5

17

5

1

7

17

Venture capital / Business Angel advisers

Very useful

57

40

70

67

60

40

100

33

61

Useful

43

60

30

33

40

60

0

67

39

Not useful

0

0

0

0

0

0

0

0

0

Number of respondents

21

10

10

6

15

5

1

3

18

Business joint venture partners

Very useful

50

33

50

100

50

50

0

33

57

Useful

50

67

50

0

50

50

0

67

43

Not useful

0

0

0

0

0

0

0

0

0

Number of respondents

10

3

8

2

6

4

0

3

7

Other(s)

Very useful

67

50

100

100

67

0

0

0

100

Useful

33

50

0

0

33

0

0

100

0

Not useful

0

0

0

0

0

0

0

0

0

Number of respondents

3

2

1

1

3

0

0

1

2

  • Respondents could select more than one option; so percentages in any column may sum to more than 100
  • A number is shown in bold where, taking into account the margin of error due to sampling, we are 95% certain that it is different from the number in the left hand total column (using a Chi-Squared statistical test)
  • Source: PACEC Survey (q49C6)

9.6 Grant recipients were also asked if they would continue to use other support in the future; and, if so, from where. Table 9.4 shows the responses and it reveals a very similar pattern of support to that shown in Table 9.2. This is not surprising, however, given that other support used to date was generally rated highly.

Table 9.4 Is the support likely to continue?

Percentage of all respondents responding yes
Type of Grant Size of company Award Date

Total

Feas Grant

R&D Grant

MR&B Review

<10 Empl

10-49 Empl

50+ Empl

Pre Apr04

Post Mar04

Higher education / University advisers

67

81

54

88

71

40

50

72

66

Larger research / technology companies

27

24

32

31

23

40

50

33

25

SME/independent business advisers/consultants

20

7

29

13

19

40

0

11

23

Venture capital / Business Angel advisers

18

21

12

25

17

30

0

17

18

Business joint venture partners

10

7

15

6

7

30

0

11

9

Other

2

2

2

6

3

0

0

0

3

Number of respondents

83

42

41

16

69

10

2

18

65

  • Respondents could select more than one option; so percentages in any column may sum to more than 100
  • A number is shown in bold where, taking into account the margin of error due to sampling, we are 95% certain that it is different from the number in the left hand total column (using a Chi-Squared statistical test)
  • Source: PACEC Survey (q49D)

Assessments of the scheme

9.7 Table 9.5 summarises how the grant recipients rated various aspects of the scheme; and it indicates that every aspect was rated relatively highly overall by all categories of respondent. The only aspect of the scheme that was rated as less than good on average was the application procedure.

Table 9.5 How would you assess the following aspects of the scheme? Mean Score (1=Very poor, 2=poor, 3=fair, 4=good 5=very good).

Mean scores of all respondents
Type of Grant Size of company Award Date

Total

Feas Grant

R&D Grant

MR&B Review

<10 Empl

10-49 Empl

50+ Empl

Pre Apr04

Post Mar04

Application procedures

3.6

3.5

3.7

3.3

3.6

3.7

2.8

3.8

3.5

Support from the SMART team

4.3

4.4

4.3

4.5

4.3

4.5

4.1

4.3

4.3

Support from other advisers

4.3

4.4

4.2

4.4

4.4

4.2

4.2

4.2

4.4

Amount of grant

4.1

4.3

4.0

4.3

4.1

4.3

4.3

4.2

4.1

What the grant can be spent on

4.2

4.4

4.1

4.5

4.3

4.3

4.1

4.3

4.3

The flexibility of the scheme

4.1

4.2

4.0

4.2

4.1

4.3

3.9

4.1

4.1

Time taken for payments to be made

4.3

4.3

4.3

4.4

4.4

4.3

4.2

4.4

4.3

Benefits to your business

4.4

4.5

4.3

4.5

4.4

4.6

4.1

4.3

4.5

Number of respondents

274

120

157

31

208

44

14

105

168

  • Source: PACEC Survey (Q50)

9.8 Table 9.6 delves deeper into grant recipients' assessments, by showing the proportion of respondents rating different aspects of the schemes highly or lowly. It shows that, apart from the application procedures, each aspect of the scheme considered was rated as Very good or Good by the overwhelming majority of respondents. The table also shows that the variations in the ratings according to category of respondent were not great, although it appears that companies undertaking later period projects were slightly more likely than those undertaking earlier projects to express dissatisfaction.

Table 9.6 Positive and negative assessments of different aspects of the scheme (% saying Very Poor/Poor and Good/Very Good. Excludes those saying Fair.)

Percentage of all respondents
Type of Grant Size of company Award Date

Total

Feas Grant

R&D Grant

MR&B Review

<10 Empl

10-49 Empl

50+ Empl

Pre Apr04

Post Mar04

Application procedures
Very poor / poor

18

22

14

29

15

14

46

10

21

Very good / Good

58

52

60

42

57

63

38

65

53

Number of respondents

274

122

155

31

210

43

13

105

168

Support from the SMART team
Very poor / poor

1

2

2

0

1

0

0

0

3

Very good / good

88

90

87

90

88

95

79

89

88

Number of respondents

273

122

154

31

208

43

14

106

166

Support from other advisers
Very poor / poor

3

4

3

7

3

8

0

1

5

Very good / good

89

92

86

90

89

85

90

83

92

Number of respondents

244

118

129

29

188

39

10

89

154

Amount of grant
Very poor / poor

2

2

3

3

2

0

0

0

3

Very good / good

80

85

76

78

77

91

100

82

79

Number of respondents

277

121

159

31

211

43

15

107

169

What the grant can be spent on
Very poor / poor

2

2

2

0

2

0

0

2

1

Very good / good

87

93

82

90

86

91

87

90

86

Number of respondents

280

122

161

31

212

44

15

108

171

Flexibility of the scheme
Very poor / poor

6

7

6

6

7

5

7

5

6

Very good / good

79

83

76

77

77

89

73

81

79

Number of respondents

265

120

148

31

199

43

15

98

166

Time taken for payments to be made
Very poor / poor

4

4

4

13

2

5

0

2

5

Very good / good

90

89

89

88

89

90

100

91

89

Number of respondents

274

120

157

31

208

44

14

105

168

Benefits to your business
Very poor / poor

2

0

2

0

1

0

0

1

2

Very good / good

82

94

91

94

92

89

87

91

93

Number of respondents

274

121

156

31

207

44

15

105

168

  • Table does not show proportion of respondents rating aspects of the scheme as Fair.
  • Source: PACEC Survey (Q50A8)

9.9 The requirement for match funding was raised as a problem by several businesses in the follow-up interviews. It was a particular problem for start-ups.

9.10 There were a number of criticisms of the application process. It was thought by several recipients that the forward predictions for three years were irrelevant and probably entirely hypothetical and unreliable, and that business plans for new or young companies could only reasonably look forward one or one and a half years. One year business plans followed by a further year's strategic forecast was suggested as a more reasonable target.

9.11 The forms were criticised as requiring too much information and needing to be simplified and focussed more on technological innovation. However, there was an alternative viewpoint that the selection procedure should be more rigorous in order to weed out unwise or incompetent users of taxpayers' money, and one recipient compared the SMART forms favourably with the "horrendously outrageous" procedure for applying for EU funds.

9.12 The application procedure was thought to be time-consuming and expensive, without any guarantee of results. "If SMART could publish a booklet for the guidance of young companies, with a template of how to apply (maybe with actual examples if permission could be obtained), it would be most helpful."

9.13 One respondent thought SMART funds should not go to university spin-out companies, since they already had access to proof-of-concept funding and appeared to be getting the lion's share of SMART funding as well.

9.14 There was some demand for additional advice and consultation from SMART, for example on patent acquisition which was seen as difficult and expensive, and a suggestion of a further round of funding. "More advice is also needed to lead companies on to SMART Plus, to route them on to a highway, as it were."

Summary of key findings

  • Almost half of the grant recipients used support over and above that provided by the scheme (Table 9.1) and the very large majority of these described the support as Useful or Very useful (Table 9.3).
  • Most of those who had used additional support would continue to do so (Table 9.4).
  • Every aspect of the scheme was rated relatively highly by grant recipients (Table 9.5). The only aspect of the scheme that was rated as less than Good on average was the application process.
  • Recipients were keen on more advice and support.

Page updated: Monday, September 28, 2009