Does It Matter How You Pick Your Batches?
- Andy Cai, Yvonne Yifeng Peng
Shuffle-without-replacement is widely used as a drop-in for Poisson subsampling in DP-SGD — but the two carry very different privacy guarantees, and the gap can reach 10× in the worst case. We benchmark all three classical sampling strategies (Poisson,... Continue reading