It might come as a surprise to most people that the very worst pest of orchards is the grey squirrel, in urban or semi-urban areas at least. Most people are completely unaware that much of a crop can be lost this early to squirrels. If they do spot the damage, it's usually misattributed to birds.
Squirrel damage is very easy to identify. If you look carefully you can see two identical upper incisor marks, with a 'spooned out' mark above made by the lower incisors. Other fruitlets in this cluster just show tooth marks which match. Squirrels rarely eat the whole fruit at this stage, but can fatally damage a large number by 'mouthing' them out of curiousity.
Two year ago I was not at home to monitor the problem at this stage, and lost the entire crop from my 50-odd cultivars. One pear, two apples and no plums, the entire result from a sizeable, mature orchard. The problem is largely due to a particular neighbour who has numerous bird feeders that are not squirrel proof, and the population had grown from a single pair to numerous competing ones over the exact time period that has been excess supply food in the environment. I trapped and disposed of 10 squirrels last year, and this had a very positive effect on the crop which was very large despite a particularly poor growing season.
This is not something I like doing, but it is impossible to get worthwhile results from fruit growing where there are significant numbers of squirrels. They are also a serious pest of nesting birds particularly where there are population explosions. It may be a coincidence but since the recent spike in squirrel numbers, the reed warbler population in the lake complex that neighbours our garden has crashed; the squirrels have easy access to the reed beds from many poorly-managed fallen willows. Peanut feeders also encourage Greater Spotted Woodpeckers, of which we have 2 nesting pairs currently; these are also voracious predators of smaller nesting birds and have pecked their way into our blue-tit boxes and eaten all the chicks on several occasions.