Multiply two matrices across two GPUs

Matrices A and B must be multiplied using two GPUs, with both matrices split between them. How do you partition the work (by rows, by columns, by blocks), what has to move between the GPUs, and how do you gather the result? Compare the communication cost of each scheme.