Design a notification ranking system

Many products send notifications to the same user: new products, friends' activity, results of advertisers' campaigns and more. Design the ML system that decides which notifications to send, in what order and how often, so users stay engaged without being annoyed.

Discuss the objective and how you would trade off clicks against opt-outs, the labels and features, the model, volume caps, timing, and how you would test changes.