They look like wooly aphids. The white ones in later stages, the grey ones in younger stages.
They are not true aphids so most insecticides are useless against it.
Try to find something systemic that has them on the label.
It could be that you're dealing with scale too.
If you treat with systemics, don't eat the olives from that year.