The worries were cited as a leading factor for 42 of UK-based businesses cutting their outlook for annual profits last year.