Scottish Government

Chapter Two : Method and Sampling

This section of the report describes the methodology and sampling used in conducting the survey. This is a brief summary of the key points with a full description of the method and sampling provided in Appendix 2 - Technical Information.

2.1 Summary of Method

The approach used for the 2006 study was adopted from the approach used in previous studies. This involved telephone interviews with a representative sample of farmers/crofters across Scotland. A total of 1020 interviews were conducted with the person at the farm/croft who was responsible for completing grants and/or subsidy claims. Accurate results were provided to +/- 3.1% at the 95% level of confidence (for a minimum answer of 50%). All interviews were completed between 31 ^st January 2006 and 20 ^th February 2006.

2.2 Sampling

As in previous years, the SIACS database which holds farmers'/crofters' land and payments details was used as a basis for the sampling frame. Across the sample, as with last year, quotas were set on size of farm (based on level of IACS claim) and Local Area Office. These quotas were reflective of a random sample drawn from the Scottish IACS database of farmers/crofters and represent the proportion of farms/crofts throughout Scotland.

There are three equal sizes of farm categories. They are defined as:

• Level 1 - Small Claims.
• Level 2 - Medium Claims.
• Level 3 - Large Claims.

The full sample breakdown of interviews achieved is indicated in Table 2.1.

Table 2.1 Sample Breakdown

2.3 Questionnaire Design

The questionnaire designed for the 2006 survey was based on the questionnaire from previous surveys. Minimal changes were made. The questions relating to CAP Reform and cattle ownership were removed. A few additional questions were added along with some modifications to wording and ordering. Where questions have remained the same across the four years of the survey, comparisons where relevant have been made within the report. A full copy of the questionnaire is provided in Appendix 1.

2.4 Interviewing Process

As mentioned earlier, interviews with farmers/crofters were conducted over a three week period. Most were carried out between 9am and 5pm. Early morning and around lunch time again proved to be successful. The average time for completing an interview was around 20 minutes.

A total of 1562 farmers/crofters were contacted in order to achieve the 1020 interviews giving an overall responses rate of 65% (slightly down from the 76% recorded in 2005). Reasons for non response during contact ³ were as follows:

• Refused to take part in the survey (N=168).
• Three to five unsuccessful attempts at contact made (N=173).
• Made no grants/subsidy claims in 2005 (N=12).
• Wrong number on contact sheet/number not available (N=132).
• Part interview achieved (N=3).
• "Other" reason given (N=54).

2.5 Reporting

For the purpose of this report and its reliability, our reporting focuses, in the main, on the more recent change from 2005 to 2006 (thereby highlighting the impact of the Single Farm Payment Scheme), but also contains information on the general trend over the four years since the 2003 survey.

Throughout the report various differences between the figures for 2005 and 2006 are referred to as 'significant'. These figures have been tested for statistical significance at the 95% level of confidence. The statistical significance of a result is an estimated measure of the degree to which it is "true" or 'real' (in the sense of "representative of the population" of the population of farmers/crofters in Scotland) . Being statistically significant at a 95% level shows that there is only, on average, a 5% chance that a sample would produce an estimate that notably differs from the true value. Thus, while many measures may show a change in response over time, these changes may or may not be significant at the 95% level depending primarily on the size of the change and the size of each respective base ⁴.

Commentary on sub-group analysis has been provided throughout the report. It should be noted that the base size for the 16-34 sub-group and business managers sub-groups is small and should be taken as indicative at best. We would stress that many sub-groups overlap (particularly in terms of age and length of time in farming) so that a significant difference for one particular sub-group may well result in a significant difference for a 'different' sub-group.

We would also stress that significance does not necessarily equate to causality. In other words, because there is a significant difference between one sub-group and not another on a particular variable, it cannot necessarily be assumed that it is the nature of that sub-group (e.g. their age) that has caused their different response.

2.6 Sample Profile

All interviews were conducted with the person at the farm/croft responsible for completing grants/subsidy applications at the farm/croft. The profile of farmers/crofters participating in the survey is indicated in Table 2.2.

The sample profile has remained relatively consistent throughout the four years of this study. Key points to note on the profile of farmers/crofters participating in the survey are as follows:

• The majority were male (79%).
• Most were aged 45 or over (76%).
• The vast majority had been in farming for over 10 years, with only 4% having been in farming for 5 years or less and 5% for 6-10 years.
• Respondents were spread evenly between the three claim levels, with proportions almost identical to those recorded in previous years of the study.
• Interviewees were more likely to be from the North East (33%) than from the other areas.

Table 2.2 Profile of Respondents

Notes to table
Base: All respondents
Source: Classification questions
Note: In some cases, percentages do not add up to 100 due to rounding

2.7 Main Role/Job Title

The first question at the beginning of the questionnaire was to establish the respondent's main job title in relation to their farm/croft. The following table (2.3) indicates the proportion of each.

As can be seen just under half of the respondents who were spoken to were the owners (44%); 20% were business partners; and 15% were tenants on the farm/croft. The proportion of tenants was slightly smaller than that seen in 2005 (20%), but it was similar to the proportion interviewed in 2004 (16%).

Table 2.3 Main Role/Job Title of Respondents

Notes to table
Base: All respondents
Source: Q1

2.8 Internet Access

Section E of the questionnaire concerned Agri E-Business and all respondents were asked if they currently had access to the Internet.

Almost seven in ten respondents (68%) said they had access to the Internet with 32% indicating they did not. This represents an increase over the 2005 figures of 58% which itself represents a steady increase since 2004 (53%).

Those that did not have access to the Internet tended to be:

• Older - 63% of people aged over 65 did not have access to the Internet.
• Level 1 (small claim) - 44%.
• From the North West (48%) or the North East (36%) of Scotland.
• In farming for over 30 years (75%).

The proportion of respondents with access to the Internet is broadly in line with the proportion of the general Scottish population with access to the Internet at home (44% in general have access to the Internet; 41% have Internet access at home) ⁵ and the proportion of Scottish businesses with access to the Internet (72%) ⁶.

Chart 2.1 Access to Internet

Notes to Chart
Base: All respondents
Source: Q10