Seems like I forgot to select reply all earlier. I'm going to look into that next week. I failed to resetup my monitoring after I left my previous customer and I've reinstalled icinga just this week.
I don't understand people's insistence with a single product herd given we don't have enough manpower yet and I don't want to have an explosion of aliases I need to subscribe to, the spam is enough as it is.